Moses-support Digest, Vol 86, Issue 4

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Word-to-word alignment when moses-parallel.pl is used
(Dimitris Mavroeidis)
2. Re: Regarding Transliteration using Moses (Pratik Jain)


----------------------------------------------------------------------

Message: 1
Date: Mon, 02 Dec 2013 11:10:37 +0200
From: Dimitris Mavroeidis <dmavroeidis@csri.gr>
Subject: Re: [Moses-support] Word-to-word alignment when
moses-parallel.pl is used
To: Thomas.Meyer@idiap.ch
Cc: moses-support <moses-support@mit.edu>
Message-ID: <529C4E8D.3060000@csri.gr>
Content-Type: text/plain; charset="utf-8"

Hi all,

We still use SGE for moses, since we have a cluster of low-end machines.
It is very convenient for us.

It would be nice if we could use SGE with the _latest_ version of moses.
So, Thomas, feel free to share your modifications with the rest of the list.

Best regards,
Dimitris


On 29/11/2013 08:52 ??, Thomas Meyer wrote:
> Hi all,
>
> I 'still' do and find it quite convenient. At least with release 1.0
> and some modifications to moses-parallel.pl
>
> Thomas
>
>
> *From: *CHATZITHEODOROU Konstantinos
> *Sent: *Friday, 29 November 2013 7:48 PM
> *To: *Hieu Hoang
> *Cc: *moses-support@mit.edu
> *Subject: *Re: [Moses-support] Word-to-word alignment when
> moses-parallel.pl
> is used
>
>
> Hi Hieu,
>
> Thanks for your reply. I have a question. Why not many people still
> use SGE to run Moses?
>
> Thank you in advance.
>
> Best,
> Konstantinos
>
>
> 2013/11/29 Hieu Hoang <Hieu.Hoang@ed.ac.uk <mailto:Hieu.Hoang@ed.ac.uk>>
>
> I'm not sure if many people still uses Sun Grid Engine to run
> Moses. If not, scripts like moses-parallel.pl
> <http://moses-parallel.pl> may become outdated.
>
> I know at Edinburgh, we no longer use SGE. Instead we run our
> experiment on 1 large multi-core machine. Most of moses has been
> re-engineered to be multithreaded to take advantage of multicores
>
>
> On 28 November 2013 10:25, CHATZITHEODOROU Konstantinos
> <dinosaxon@gmail.com <mailto:dinosaxon@gmail.com>> wrote:
>
> Hi Philipp,
>
> Thank you your your prompt reply. I have tried the option
> "alignment-output-file" for moses-parallel.pl
> <http://moses-parallel.pl> but didn't use it as part of the
> decoder setting. But it didn't work. Each individual sub-job
> finished with an error status stating something the sub-job is
> untranslated.
>
> Thank you for your time and consideration.
>
> Regards,
> Konstantinos
>
>
>
> 2013/11/27 Philipp Koehn <pkoehn@inf.ed.ac.uk
> <mailto:pkoehn@inf.ed.ac.uk>>
>
> Hi,
>
> the script has an option "alignment-output-file" - did you
> try this?
>
> -phi
>
> On Tue, Nov 26, 2013 at 8:13 PM, CHATZITHEODOROU Konstantinos
> <dinosaxon@gmail.com <mailto:dinosaxon@gmail.com>> wrote:
> > Hi all,
> >
> > Could you please give an example on how to output the
> word-to-word alignment
> > during decoding when moses-parallel.pl
> <http://moses-parallel.pl> is used?
> >
> > Thank you in advance for your help.
> >
> > Regards,
> > Konstantinos
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
>
>
>
>
> --
> CHATZITHEODOROU Konstantinos
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
>
> --
> CHATZITHEODOROU Konstantinos
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131202/a838b5e0/attachment-0001.htm

------------------------------

Message: 2
Date: Mon, 2 Dec 2013 15:10:01 +0530
From: Pratik Jain <tunetopj@gmail.com>
Subject: Re: [Moses-support] Regarding Transliteration using Moses
To: Hassan Sajjad <sajjad@ims.uni-stuttgart.de>
Cc: moses-support <moses-support@mit.edu>, Hieu Hoang
<hieu.hoang@ed.ac.uk>, Pranjal Das <pranjal4456@gmail.com>, Prashant
Mathur <pm.prashant@gmail.com>
Message-ID:
<CACXoyhC7-RLH3gjxKH5Hw5PzFZkAMbsHR3MsaCpJjaym_cy12w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Pranjal,
All you have to do is write any script in the language of your choice to
add and remove spaces.


On Sun, Dec 1, 2013 at 12:33 PM, Hassan Sajjad
<sajjad@ims.uni-stuttgart.de>wrote:

> Hi Pranjal,
>
> If the command you mentioned is of your transliteration system then you
> are very close to done. Rather than specifying like the following:
> echo '????'| ~/mosesdecoder/bin/moses -f ~/work1/train/model/moses.ini
>
> put space between the characters of the input word. So, moses considers it
> as a complete sentence and outputs its translation (transliteration)
> according to the model.
> echo '? ? ? ?'| ~/mosesdecoder/bin/moses -f ~/work1/train/model/moses.ini
>
> Now your output will look something like 'bh a r a t'. You can use a
> simple perl script to remove spaces from the characters.
>
> You can also generate an N-best list of transliteration by using -n-best-list
> listfile 100. See
> http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc8
>
> Cheers,
> Hassan
>
>
>
>
> On Sun, Dec 1, 2013 at 3:13 AM, Pratik Jain <tunetopj@gmail.com> wrote:
>
>> Pranjal. as I told you in my previous reply, you can't get the whole word
>> transliterated. You have to break it, transliterate and join it again.
>>
>>
>> On Sat, Nov 30, 2013 at 12:24 PM, Pranjal Das <pranjal4456@gmail.com>wrote:
>>
>>> Thank you prashant and pratik...i have done the splitting character-wise
>>> and then the training part...as you said...but i am unable to do the
>>> reassemble part. For eg The letter ' ? ' is translietrated to bh, ' ? '
>>> is transliterated to r..but the complete word
>>> ???? is not transliterated. it gives the same output ????. please can
>>> you guide me...how i can get the complete word.
>>> echo '????'| ~/mosesdecoder/bin/moses -f ~/work1/train/model/moses.ini
>>> gives the output ????
>>>
>>> *Pranjal Das*
>>> Department of Information Technology,
>>> Institute of Science and Technology,
>>> Gauhati University,Guwahati,Assam
>>> Phone- +91-8399879454
>>>
>>>
>>> On Fri, Nov 29, 2013 at 1:02 PM, Prashant Mathur <pm.prashant@gmail.com>wrote:
>>>
>>>> hi pranjal,
>>>>
>>>> when you trained the system there is no rule for translating ???? but
>>>> there is a translation rule for translating ?? and ??..
>>>> having said that if you want a good transliteration system you should
>>>> separate the vowels from consonants.. like if you want to split ???? try
>>>> spring it like
>>>> ? + ? + ? + ? -> bh + a + ra + ta
>>>> it can be even more fine grained
>>>>
>>>> and when you want to transliterate a word you would have to split the
>>>> test set like the training data.
>>>>
>>>> this is how i would do it.
>>>> i don't know how pratik did.
>>>>
>>>> just being curious.. have you tried translating from english to wx
>>>> notation in hindi
>>>>
>>>> Prashant
>>>> On Nov 29, 2013 10:33 AM, "Pranjal Das" <pranjal4456@gmail.com> wrote:
>>>>
>>>>> hii ,
>>>>> hav tried as you said pratik..but cant get the original word.as for
>>>>> example ???? as
>>>>> ?? ?? ->bha rat ,if i echo bha i get the word ?? but in its place if
>>>>> i write ???? not transliterated.plese help me out if you hav any idea
>>>>> about this..how to get that complete word..as those which are not
>>>>> translated i suppose must be transliterated.
>>>>> Thanks
>>>>>
>>>>>
>>>>> regards
>>>>>
>>>>> *Pranjal Das*
>>>>> Department of Information Technology,
>>>>> Institute of Science and Technology,
>>>>> Gauhati University,Guwahati,Assam
>>>>> Phone- +91-8399879454
>>>>>
>>>>>
>>>>> On Wed, Nov 27, 2013 at 9:44 PM, Pratik Jain <tunetopj@gmail.com>wrote:
>>>>>
>>>>>> Just get a parallel list of words in the 2 languages. Try to break
>>>>>> each word syllable-wise or simply character-wise. Thus, each line of the
>>>>>> two files would have single words with a space between each character (or
>>>>>> each syllable). Use these 2 files to train the system as normal translation
>>>>>> task.
>>>>>> If your word list is large enough, this works quite nice. Try it out,
>>>>>> it worked good for me.
>>>>>>
>>>>>>
>>>>>> On Wed, Nov 27, 2013 at 10:49 PM, Hieu Hoang <Hieu.Hoang@ed.ac.uk>wrote:
>>>>>>
>>>>>>> There's no support for transliteration in Moses. If you create 1,
>>>>>>> please let us know and we can add it to Moses
>>>>>>>
>>>>>>>
>>>>>>> On 27 November 2013 07:44, Pranjal Das <pranjal4456@gmail.com>wrote:
>>>>>>>
>>>>>>>> hii,
>>>>>>>> i have completed my translation using moses toolkit,following the
>>>>>>>> manual for installing moses,GIZZA++,IRSTLM and have tried out the sample
>>>>>>>> models for translation and applying those on my own parallel
>>>>>>>> corpus(fr-en),now i am facing problems regarding transliteration as there
>>>>>>>> is no proper way given in the manual for Transliteration using moses.kindly
>>>>>>>> help me with transliteration steps.where i can find them.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Thanku
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>>
>>>>>>>> *Pranjal Das*
>>>>>>>> Department of Information Technology,
>>>>>>>> Gauhati University Institute of Science and Technology,Guwaha
>>>>>>>> ti,India
>>>>>>>> Phone- +91-8399879454
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Moses-support mailing list
>>>>>>>> Moses-support@mit.edu
>>>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Hieu Hoang
>>>>>>> Research Associate
>>>>>>> University of Edinburgh
>>>>>>> http://www.hoang.co.uk/hieu
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Moses-support mailing list
>>>>>>> Moses-support@mit.edu
>>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131202/da0e2c7b/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 86, Issue 4
********************************************

Tweet