Moses-support Digest, Vol 85, Issue 55

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Word-to-word alignment when moses-parallel.pl is used
(CHATZITHEODOROU Konstantinos)
2. Re: Word-to-word alignment when moses-parallel.pl is used
(Thomas Meyer)
3. Re: Regarding Transliteration using Moses (Pratik Jain)


----------------------------------------------------------------------

Message: 1
Date: Fri, 29 Nov 2013 18:42:48 +0000
From: CHATZITHEODOROU Konstantinos <dinosaxon@gmail.com>
Subject: Re: [Moses-support] Word-to-word alignment when
moses-parallel.pl is used
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAB+50nOTB6UfeoSo7d2azF+NA_LEAHA78GpgVVEkYWk_pfehcw@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi Hieu,

Thanks for your reply. I have a question. Why not many people still use SGE
to run Moses?

Thank you in advance.

Best,
Konstantinos


2013/11/29 Hieu Hoang <Hieu.Hoang@ed.ac.uk>

> I'm not sure if many people still uses Sun Grid Engine to run Moses. If
> not, scripts like moses-parallel.pl may become outdated.
>
> I know at Edinburgh, we no longer use SGE. Instead we run our experiment
> on 1 large multi-core machine. Most of moses has been re-engineered to be
> multithreaded to take advantage of multicores
>
>
> On 28 November 2013 10:25, CHATZITHEODOROU Konstantinos <
> dinosaxon@gmail.com> wrote:
>
>> Hi Philipp,
>>
>> Thank you your your prompt reply. I have tried the option
>> "alignment-output-file" for moses-parallel.pl but didn't use it as part
>> of the decoder setting. But it didn't work. Each individual sub-job
>> finished with an error status stating something the sub-job is untranslated.
>>
>> Thank you for your time and consideration.
>>
>> Regards,
>> Konstantinos
>>
>>
>>
>> 2013/11/27 Philipp Koehn <pkoehn@inf.ed.ac.uk>
>>
>>> Hi,
>>>
>>> the script has an option "alignment-output-file" - did you try this?
>>>
>>> -phi
>>>
>>> On Tue, Nov 26, 2013 at 8:13 PM, CHATZITHEODOROU Konstantinos
>>> <dinosaxon@gmail.com> wrote:
>>> > Hi all,
>>> >
>>> > Could you please give an example on how to output the word-to-word
>>> alignment
>>> > during decoding when moses-parallel.pl is used?
>>> >
>>> > Thank you in advance for your help.
>>> >
>>> > Regards,
>>> > Konstantinos
>>> >
>>> >
>>> > _______________________________________________
>>> > Moses-support mailing list
>>> > Moses-support@mit.edu
>>> > http://mailman.mit.edu/mailman/listinfo/moses-support
>>> >
>>>
>>
>>
>>
>> --
>> CHATZITHEODOROU Konstantinos
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>


--
CHATZITHEODOROU Konstantinos
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131129/f2397850/attachment-0001.htm

------------------------------

Message: 2
Date: Fri, 29 Nov 2013 19:52:20 +0100
From: Thomas Meyer <Thomas.Meyer@idiap.ch>
Subject: Re: [Moses-support] Word-to-word alignment when
moses-parallel.pl is used
To: CHATZITHEODOROU Konstantinos <dinosaxon@gmail.com>, Hieu Hoang
<Hieu.Hoang@ed.ac.uk>
Cc: moses-support@mit.edu
Message-ID: <20131129185220.5632146.93375.15327@idiap.ch>
Content-Type: text/plain; charset="us-ascii"

An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131129/06cd882b/attachment-0001.htm
-------------- next part --------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support

------------------------------

Message: 3
Date: Sat, 30 Nov 2013 02:02:06 +0530
From: Pratik Jain <tunetopj@gmail.com>
Subject: Re: [Moses-support] Regarding Transliteration using Moses
To: Prashant Mathur <pm.prashant@gmail.com>
Cc: moses-support <moses-support@mit.edu>, Hieu Hoang
<hieu.hoang@ed.ac.uk>, Pranjal Das <pranjal4456@gmail.com>
Message-ID:
<CACXoyhDEaZLej8dgYvj5zoc-6nDbxV-2gEZm+X4nfUZLdMA4oA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

I agree with Prashant. So, the first step of your transliterating system
would be to split up each word as it is done for the training data and
insert each word in a new line. Then run the transliteration and then
reassemble.


On Fri, Nov 29, 2013 at 4:32 PM, Prashant Mathur <pm.prashant@gmail.com>wrote:

> hi pranjal,
>
> when you trained the system there is no rule for translating ???? but
> there is a translation rule for translating ?? and ??..
> having said that if you want a good transliteration system you should
> separate the vowels from consonants.. like if you want to split ???? try
> spring it like
> ? + ? + ? + ? -> bh + a + ra + ta
> it can be even more fine grained
>
> and when you want to transliterate a word you would have to split the test
> set like the training data.
>
> this is how i would do it.
> i don't know how pratik did.
>
> just being curious.. have you tried translating from english to wx
> notation in hindi
>
> Prashant
> On Nov 29, 2013 10:33 AM, "Pranjal Das" <pranjal4456@gmail.com> wrote:
>
>> hii ,
>> hav tried as you said pratik..but cant get the original word.as for
>> example ???? as
>> ?? ?? ->bha rat ,if i echo bha i get the word ?? but in its place if i
>> write ???? not transliterated.plese help me out if you hav any idea
>> about this..how to get that complete word..as those which are not
>> translated i suppose must be transliterated.
>> Thanks
>>
>>
>> regards
>>
>> *Pranjal Das*
>> Department of Information Technology,
>> Institute of Science and Technology,
>> Gauhati University,Guwahati,Assam
>> Phone- +91-8399879454
>>
>>
>> On Wed, Nov 27, 2013 at 9:44 PM, Pratik Jain <tunetopj@gmail.com> wrote:
>>
>>> Just get a parallel list of words in the 2 languages. Try to break each
>>> word syllable-wise or simply character-wise. Thus, each line of the two
>>> files would have single words with a space between each character (or each
>>> syllable). Use these 2 files to train the system as normal translation task.
>>> If your word list is large enough, this works quite nice. Try it out, it
>>> worked good for me.
>>>
>>>
>>> On Wed, Nov 27, 2013 at 10:49 PM, Hieu Hoang <Hieu.Hoang@ed.ac.uk>wrote:
>>>
>>>> There's no support for transliteration in Moses. If you create 1,
>>>> please let us know and we can add it to Moses
>>>>
>>>>
>>>> On 27 November 2013 07:44, Pranjal Das <pranjal4456@gmail.com> wrote:
>>>>
>>>>> hii,
>>>>> i have completed my translation using moses toolkit,following the
>>>>> manual for installing moses,GIZZA++,IRSTLM and have tried out the sample
>>>>> models for translation and applying those on my own parallel
>>>>> corpus(fr-en),now i am facing problems regarding transliteration as there
>>>>> is no proper way given in the manual for Transliteration using moses.kindly
>>>>> help me with transliteration steps.where i can find them.
>>>>>
>>>>>
>>>>>
>>>>> Thanku
>>>>>
>>>>> Regards,
>>>>>
>>>>> *Pranjal Das*
>>>>> Department of Information Technology,
>>>>> Gauhati University Institute of Science and Technology,Guwahati,India
>>>>> Phone- +91-8399879454
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Hieu Hoang
>>>> Research Associate
>>>> University of Edinburgh
>>>> http://www.hoang.co.uk/hieu
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131130/09237f7a/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 85, Issue 55
*********************************************

Tweet