Moses-support Digest, Vol 105, Issue 68

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Contrib Web - translate.cgi (Vincent Nguyen)
2. Parallelizer multi core (Vincent Nguyen)
3. Re: decoding-graph-backoff (Saumitra Yadav)


----------------------------------------------------------------------

Message: 1
Date: Wed, 29 Jul 2015 19:47:16 +0200
From: Vincent Nguyen <vnguyen@neuf.fr>
Subject: [Moses-support] Contrib Web - translate.cgi
To: moses-support <moses-support@mit.edu>
Message-ID: <55B911A4.1040908@neuf.fr>
Content-Type: text/plain; charset=utf-8; format=flowed

Hi,

As is, it was working fine except the tokenizer / detokenizer .perl code
is outdated.
It causes problem with the apostrophe in French.

so I changed the translate.cgi file to run the 2 perl file from
moses/scripts/share/tokenizer
but it does not work at all.
not same parameters ?

Cheers,
Vincent


------------------------------

Message: 2
Date: Wed, 29 Jul 2015 22:05:35 +0200
From: Vincent Nguyen <vnguyen@neuf.fr>
Subject: [Moses-support] Parallelizer multi core
To: moses-support <moses-support@mit.edu>
Message-ID: <55B9320F.6050808@neuf.fr>
Content-Type: text/plain; charset=utf-8; format=flowed

Hi,

I am wondering what tasks of the EMS are really parallelized.
I activated the script line + 8 cores.

Training / binarizing / Tuning all make only one core to actually work.

Am I correct ?


------------------------------

Message: 3
Date: Thu, 30 Jul 2015 05:27:14 +0530
From: Saumitra Yadav <yadav.saumitra07@gmail.com>
Subject: Re: [Moses-support] decoding-graph-backoff
To: Philipp Koehn <phi@jhu.edu>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAPeFGXah+D=MSxe1aW4Nycfzk9FGpF-THm=EFOa1n0Hz94VwdQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Sir,
Thank you for that option , it really helped. I just wanted to know if I'm
analysing it correctly
For initial analysis m just finding how many times which phrase tables were
called , so in attached file (formatted just for easy readability ) please
find the output of one sentence , is it correct to say that
TranslationModel0 was used 2 times and TranslationModel1 was used 5 times
for given input?

Regards,
Saumitra Yadav
M.Tech.
Department Of Computer Science And Technology
Goa University


On Wed, Jul 29, 2015 at 9:22 PM, Philipp Koehn <phi@jhu.edu> wrote:

> Hi,
>
> when you call the decoder with the option "-tt" then you get for
> each phrase pairs a list of all feature scores. You can use this
> to track down which phrase table was used for each phrase
> translation.
>
> -phi
>
> On Wed, Jul 29, 2015 at 10:59 AM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>
>> good question. no. You can try & write it yourself.
>>
>> in the TargetPhrase class, there is a method
>> GetContainer()
>> which points to the phrase-table that a particular rule comes from. You
>> can use this.
>>
>> On 29/07/2015 18:51, Saumitra Yadav wrote:
>>
>> Sir,
>> Is there a command or argument which can tell, which phrase in output is
>> taken from which phrase-table (incase we have multiple phrase-tables )?
>>
>> Regards,
>> Saumitra Yadav
>> M.Tech.
>> Department Of Computer Science And Technology
>> Goa University
>>
>>
>> On Sun, Jul 26, 2015 at 11:49 AM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>
>>> since you have 3 phrase-tables, you may have to have 3 entries in the
>>> [decoding-graph-backoff] section, eg
>>> [decoding-graph-backoff]
>>> 0
>>> 3
>>> 3
>>>
>>>
>>> Hieu Hoang
>>> Researcher
>>> New York University, Abu Dhabi
>>> http://www.hoang.co.uk/hieu
>>>
>>> On 25 July 2015 at 20:23, Saumitra Yadav <
>>> <yadav.saumitra07@gmail.com>yadav.saumitra07@gmail.com> wrote:
>>>
>>>> Sir,
>>>> Please find attached , moses.ini file i used and command used
>>>> was ~/Decoder/mosesdecoder/bin/moses -f moses.ini
>>>>
>>>> Regards,
>>>> Saumitra Yadav
>>>> M.Tech.
>>>> Department Of Computer Science And Technology
>>>> Goa University
>>>>
>>>>
>>>> On Sat, Jul 25, 2015 at 9:21 PM, Hieu Hoang <hieuhoang@gmail.com>
>>>> wrote:
>>>>
>>>>> can you please send me the moses.ini file that you used, that cause
>>>>> the segfault. And send me the exact command you typed
>>>>>
>>>>>
>>>>> On 24/07/2015 14:40, Saumitra Yadav wrote:
>>>>>
>>>>> But sir when i did that there was * segmentation fault* while loading
>>>>> first phrase-table, one walk around i got was giving phrase-table
>>>>> uncompressed to decoder.
>>>>>
>>>>> Regards,
>>>>> Saumitra Yadav
>>>>> M.Tech.
>>>>> Department Of Computer Science And Technology
>>>>> Goa University
>>>>>
>>>>>
>>>>> On Thu, Jul 23, 2015 at 8:06 PM, Hieu Hoang < <hieuhoang@gmail.com>
>>>>> hieuhoang@gmail.com> wrote:
>>>>>
>>>>>> i think you have to swap the phrase tables around. The decoder
>>>>>> always looks at the 1st phrase-table, then backoff to the 2nd if nothing is
>>>>>> found
>>>>>>
>>>>>>
>>>>>> On 22/07/2015 16:59, Saumitra Yadav wrote:
>>>>>>
>>>>>> Sir/Ma'am,
>>>>>> I'm trying to use multiple phrase tables for translation in Moses
>>>>>> decoder, with preference to 1st phrase-table, but was getting a
>>>>>> segmentation fault while loading 1st phrase table, so just switched the
>>>>>> positions of phrase-tables in moses configuration file and it was working ,
>>>>>> now the table i want to give preference is 2nd in list , can i use
>>>>>>
>>>>>> [decoding-graph-backoff]
>>>>>> 1
>>>>>> 3
>>>>>> in configuration file for backoff so that moses uses 2nd table and
>>>>>> uses 1st table only for words it couldn't find in 2nd phrase-table?
>>>>>>
>>>>>> Regards,
>>>>>> Saumitra Yadav
>>>>>> M.Tech.
>>>>>> Department Of Computer Science And Technology
>>>>>> Goa University
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Hieu Hoang
>>>>>> Researcher
>>>>>> New York University, Abu Dhabihttp://www.hoang.co.uk/hieu
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> Hieu Hoang
>>>>> Researcher
>>>>> New York University, Abu Dhabihttp://www.hoang.co.uk/hieu
>>>>>
>>>>>
>>>>
>>>
>>
>> --
>> Hieu Hoang
>> Researcher
>> New York University, Abu Dhabihttp://www.hoang.co.uk/hieu
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150730/f544396e/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: c1
Type: application/octet-stream
Size: 1728 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150730/f544396e/attachment.obj

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 105, Issue 68
**********************************************

Tweet