Moses-support Digest, Vol 116, Issue 3

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Phrase align given word alignments (Motoki Wu)
2. Re: mosesserver and placeholder compatibility with tree-based
models (Vito Mandorino)
3. Re: Phrase align given word alignments (Rajen Chatterjee)


----------------------------------------------------------------------

Message: 1
Date: Thu, 2 Jun 2016 15:42:23 -0700
From: Motoki Wu <tokestermw@gmail.com>
Subject: [Moses-support] Phrase align given word alignments
To: moses-support@mit.edu
Message-ID: <17F25EB1-D782-45AD-8066-87A41C54BD33@gmail.com>
Content-Type: text/plain; charset=us-ascii

Hi,

I have the word alignments (e.g. 0-0, 0-1, 1-2...) from a monolingual corpus using another program.

I'd like to only use the phrase align part of the Moses pipeline directly.

Is it possible to do so?

Thanks

- Motoki


------------------------------

Message: 2
Date: Fri, 3 Jun 2016 11:43:20 +0200
From: Vito Mandorino <vito.mandorino@linguacustodia.com>
Subject: Re: [Moses-support] mosesserver and placeholder compatibility
with tree-based models
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CA+8mSmH3hZsfAWmk6XxSHXLXXU3sGiJK4P2HJdJNSxtdeq+rOg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Hieu,

There is also the mosesserver issue so I cannot say that's the only
difficulty from using tree-based models. If you can have a look it would be
great anyway. Speed is also an issue even though much less for hierarchical
than syntactic models in our tests.

Thank you and best regards,
Vito

2016-06-02 14:44 GMT+02:00 Hieu Hoang <hieuhoang@gmail.com>:

> I believe placeholders can be used but no-one has really tried. If thats
> the only thing holding you back from using hiero/syntax models, I can look
> into it for you.
>
> However, there's likely to be other issues, such as speed and memory
> consumption which may make these models unsuitable for commercial use.
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 2 June 2016 at 11:48, Vito Mandorino <vito.mandorino@linguacustodia.com
> > wrote:
>
>> Dear all,
>>
>> I am exploring hierarchical and syntactic models and I have two questions:
>>
>> 1. Is it possible to decode using mosesserver instead of moses_chart ?
>> According to " /mosesdecoder/bin/mosesserver --help " one can choose
>> different --search-algorithm values. I tried for instance, for a
>> target-syntax model,
>>
>> /mosesdecoder/bin/mosesserver -f moses.ini --search-algorithm 6
>>
>> but got no translation in return (and actually no error either).
>>
>> 2. Is it possible to use placeholders with a hierarchical or syntactic
>> model?
>> I tried something like
>>
>> echo '<ne translation="@num@" entity="7">@num@</ne> test' |
>> /mosesdecoder/bin/moses_chart -f moses.ini -xml-input inclusive
>>
>> which got me a Segmentation Fault. Is there any additional preprocessing
>> step needed to make them work together?
>>
>>
>> Thank you,
>>
>> Vito
>>
>> --
>> *M**. Vito MANDORINO -- Chief Scientist*
>>
>>
>> [image: Description : Description : lingua_custodia_final full logo]
>>
>> *The Translation Trustee*
>>
>> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>>
>> *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89
>> <%2B33%206%2084%2065%2068%2089>*
>>
>> *Email :* *vito.mandorino@linguacustodia.com
>> <massinissa.ahmim@linguacustodia.com>*
>>
>> *Website :*
>> *www.linguacustodia.finance <http://www.linguacustodia.com/>*
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>


--
*M**. Vito MANDORINO -- Chief Scientist*


[image: Description : Description : lingua_custodia_final full logo]

*The Translation Trustee*

*1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89*

*Email :* *vito.mandorino@linguacustodia.com
<massinissa.ahmim@linguacustodia.com>*

*Website :*
*www.linguacustodia.finance <http://www.linguacustodia.com/>*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160603/1711dcaf/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20160603/1711dcaf/attachment-0001.jpg

------------------------------

Message: 3
Date: Fri, 3 Jun 2016 13:49:33 +0200
From: Rajen Chatterjee <rajen.k.chatterjee@gmail.com>
Subject: Re: [Moses-support] Phrase align given word alignments
To: Motoki Wu <tokestermw@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAC4-+NzZkXvW__p=+JyTn=SzJ9X8W706vFC-W5JQDpEPkqFRFw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Motoki,

What do you mean by word alignments from a monolingual corpus?

I assume you have word alignments of a parallel corpus, and you want to
extract phrase pair using your alignment file. If this is the case then you
may look here
http://www.statmt.org/moses/?n=FactoredTraining.TrainingParameters
Scroll down to "if you may have your own method to generate a word
alignment, you want to skip ....."
You have to pass "--first-step 4" and "--alignment-file
/your-alignment-file" to train-model.perl



On Fri, Jun 3, 2016 at 12:42 AM, Motoki Wu <tokestermw@gmail.com> wrote:

> Hi,
>
> I have the word alignments (e.g. 0-0, 0-1, 1-2...) from a monolingual
> corpus using another program.
>
> I'd like to only use the phrase align part of the Moses pipeline directly.
>
> Is it possible to do so?
>
> Thanks
>
> - Motoki
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>



--
-Regards,
Rajen Chatterjee.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160603/fd9f36da/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 116, Issue 3
*********************************************

Tweet