Moses-support Digest, Vol 111, Issue 77

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: unexpected reordering with xml-input exclusive
(Vito Mandorino)
2. Re: unexpected reordering with xml-input exclusive (He He)


----------------------------------------------------------------------

Message: 1
Date: Wed, 27 Jan 2016 10:01:53 +0100
From: Vito Mandorino <vito.mandorino@linguacustodia.com>
Subject: Re: [Moses-support] unexpected reordering with xml-input
exclusive
To: Miguel Domingo <midobal@prhlt.upv.es>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CA+8mSmFdjt5Q9H3vdMusZyAQRj78=oSAVVzNMrNyeSa2GVwsTw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Actually in my case adding <wall/> does not change the output. I think this
is because the reordering happen inside the text in the xml-markup. A
workaround which seems to work for me is to put just one word outside the
xml tags, i.e.

*echo '<np translation="and, on the monday , the tallboy on its back by the
bed , and the dressing table on its face by the door">oneword</np>' |
/mosesdecoder/bin/moses -f moses.ini -xml-input exclusive > translation*


Vito

2016-01-26 16:05 GMT+01:00 Miguel Domingo <midobal@prhlt.upv.es>:

> Hi Vito,
>
> I don't remember the reason of why this happens, but I faced this problem
> in the past. The solution I ended up with was creating a wall (hard
> reordering contraint) after each xml tag. Following your example:
>
>
> *echo '<np translation="and, on the monday , the tallboy on its back by
> the bed , and the dressing table on its face by the door">and, on the
> monday , the tallboy on its back by the bed , and the dressing table on its
> face by the door</np><wall/>' | /mosesdecoder/bin/moses -f moses.ini
> -xml-input exclusive > translation*
>
> Hope this helps.
>
> Best regards,
>
> Miguel
>
> On Tue, Jan 26, 2016 at 3:38 PM, Vito Mandorino <
> vito.mandorino@linguacustodia.com> wrote:
>
>> Dear all,
>>
>> running the decoder with the following command and the '-xml-input
>> exclusive' option yielded an unexpected behavior:
>>
>> echo '<np translation="and, on the monday , the tallboy on its back by
>> the bed , and the dressing table on its face by the door">and, on the
>> monday , the tallboy on its back by the bed , and the dressing table on its
>> face by the door</np>' | /mosesdecoder/bin/moses -f moses.ini -xml-input
>> exclusive > translation
>>
>> The output in the file 'translation' reads:
>>
>> on monday the and, , the tallboy on its back by the bed , and the table
>> on its dressing face by the door
>>
>> instead of the expected:
>>
>> and, on the monday , the tallboy on its back by the bed , and the
>> dressing table on its face by the door
>>
>> The translation has been reordered with respect to the content of the xml
>> markup. Is this kind of reordering allowed by the '-xml-input exclusive'
>> option? This seems to happen especially for fairly long sentences.
>>
>> Best regards,
>>
>> Vito Mandorino
>> --
>> *M**. Vito MANDORINO -- Chief Scientist*
>>
>>
>> [image: Description : Description : lingua_custodia_final full logo]
>>
>> *The Translation Trustee*
>>
>> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>>
>> *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89
>> <%2B33%206%2084%2065%2068%2089>*
>>
>> *Email :* *vito.mandorino@linguacustodia.com
>> <massinissa.ahmim@linguacustodia.com>*
>>
>> *Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
>> www.thetranslationtrustee.com <http://www.thetranslationtrustee.com/>*
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>


--
*M**. Vito MANDORINO -- Chief Scientist*


[image: Description : Description : lingua_custodia_final full logo]

*The Translation Trustee*

*1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89*

*Email :* *vito.mandorino@linguacustodia.com
<massinissa.ahmim@linguacustodia.com>*

*Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
www.thetranslationtrustee.com <http://www.thetranslationtrustee.com/>*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160127/6ac086a2/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20160127/6ac086a2/attachment-0001.jpg

------------------------------

Message: 2
Date: Wed, 27 Jan 2016 08:43:21 -0500
From: He He <hhe.xiy@gmail.com>
Subject: Re: [Moses-support] unexpected reordering with xml-input
exclusive
To: Vito Mandorino <vito.mandorino@linguacustodia.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAMdMQUN5CGvmYXXQjZWQu_aYrkyqX1B=zVKn2L9ACLyVHWidqg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

I had a similar case. This may be due to the maximum phrase length, which
is 20
by default.

You can change it by -max-phrase-length, say 100.

On Wed, Jan 27, 2016 at 4:01 AM, Vito Mandorino <
vito.mandorino@linguacustodia.com> wrote:

> Actually in my case adding <wall/> does not change the output. I think
> this is because the reordering happen inside the text in the xml-markup. A
> workaround which seems to work for me is to put just one word outside the
> xml tags, i.e.
>
> *echo '<np translation="and, on the monday , the tallboy on its back by
> the bed , and the dressing table on its face by the door">oneword</np>' |
> /mosesdecoder/bin/moses -f moses.ini -xml-input exclusive > translation*
>
>
> Vito
>
> 2016-01-26 16:05 GMT+01:00 Miguel Domingo <midobal@prhlt.upv.es>:
>
>> Hi Vito,
>>
>> I don't remember the reason of why this happens, but I faced this problem
>> in the past. The solution I ended up with was creating a wall (hard
>> reordering contraint) after each xml tag. Following your example:
>>
>>
>> *echo '<np translation="and, on the monday , the tallboy on its back by
>> the bed , and the dressing table on its face by the door">and, on the
>> monday , the tallboy on its back by the bed , and the dressing table on its
>> face by the door</np><wall/>' | /mosesdecoder/bin/moses -f moses.ini
>> -xml-input exclusive > translation*
>>
>> Hope this helps.
>>
>> Best regards,
>>
>> Miguel
>>
>> On Tue, Jan 26, 2016 at 3:38 PM, Vito Mandorino <
>> vito.mandorino@linguacustodia.com> wrote:
>>
>>> Dear all,
>>>
>>> running the decoder with the following command and the '-xml-input
>>> exclusive' option yielded an unexpected behavior:
>>>
>>> echo '<np translation="and, on the monday , the tallboy on its back by
>>> the bed , and the dressing table on its face by the door">and, on the
>>> monday , the tallboy on its back by the bed , and the dressing table on its
>>> face by the door</np>' | /mosesdecoder/bin/moses -f moses.ini -xml-input
>>> exclusive > translation
>>>
>>> The output in the file 'translation' reads:
>>>
>>> on monday the and, , the tallboy on its back by the bed , and the table
>>> on its dressing face by the door
>>>
>>> instead of the expected:
>>>
>>> and, on the monday , the tallboy on its back by the bed , and the
>>> dressing table on its face by the door
>>>
>>> The translation has been reordered with respect to the content of the
>>> xml markup. Is this kind of reordering allowed by the '-xml-input
>>> exclusive' option? This seems to happen especially for fairly long
>>> sentences.
>>>
>>> Best regards,
>>>
>>> Vito Mandorino
>>> --
>>> *M**. Vito MANDORINO -- Chief Scientist*
>>>
>>>
>>> [image: Description : Description : lingua_custodia_final full logo]
>>>
>>> *The Translation Trustee*
>>>
>>> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>>>
>>> *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89
>>> <%2B33%206%2084%2065%2068%2089>*
>>>
>>> *Email :* *vito.mandorino@linguacustodia.com
>>> <massinissa.ahmim@linguacustodia.com>*
>>>
>>> *Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
>>> www.thetranslationtrustee.com <http://www.thetranslationtrustee.com/>*
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>
>
> --
> *M**. Vito MANDORINO -- Chief Scientist*
>
>
> [image: Description : Description : lingua_custodia_final full logo]
>
> *The Translation Trustee*
>
> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>
> *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89
> <%2B33%206%2084%2065%2068%2089>*
>
> *Email :* *vito.mandorino@linguacustodia.com
> <massinissa.ahmim@linguacustodia.com>*
>
> *Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
> www.thetranslationtrustee.com <http://www.thetranslationtrustee.com/>*
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160127/67bd47c3/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20160127/67bd47c3/attachment.jpg

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 111, Issue 77
**********************************************

Tweet