Moses-support Digest, Vol 109, Issue 15

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: use placeholder with mosesserver (Vito Mandorino)
2. Re: SRI in mosesdecoder (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Fri, 6 Nov 2015 18:08:12 +0100
From: Vito Mandorino <vito.mandorino@linguacustodia.com>
Subject: Re: [Moses-support] use placeholder with mosesserver
To: moses-support <moses-support@mit.edu>
Message-ID:
<CA+8mSmHGjPZEEN+GqZxk08zs4TVbqxxT9f221eQ8+-PF4G1EDA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Just to give an example: the sentence

nota <ne translation="@num@" entity="2">@num@</ne> : les informations
sp?cifiques aux filiales

gives this output when translated with the decoder with options
-placeholder-factor 1 -xml-input inclusive in the moses.ini:

note 2 : the information specific to subsidiaries

and this output when translated with mosesserver called with the option
-xml-input inclusive :

note @num@ : the information specific to subsidiaries

Thanks

Vito



2015-11-06 16:22 GMT+01:00 Vito Mandorino <vito.mandorino@linguacustodia.com
>:

> Dear all,
>
> I have been unsuccessful so far in using the placeholder approach with
> mosesserver. The translated segments contain the placeholder token @num@
> instead of numbers.
> Do you know how to get the numbers in the output?
>
> Many thanks,
>
> Vito Mandorino
>
>
> --
> *M**. Vito MANDORINO -- Chief Scientist*
>
>
> [image: Description : Description : lingua_custodia_final full logo]
>
> *The Translation Trustee*
>
> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>
> *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89
> <%2B33%206%2084%2065%2068%2089>*
>
> *Email :* *vito.mandorino@linguacustodia.com
> <massinissa.ahmim@linguacustodia.com>*
>
> *Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
> www.thetranslationtrustee.com <http://www.thetranslationtrustee.com/>*
>



--
*M**. Vito MANDORINO -- Chief Scientist*


[image: Description : Description : lingua_custodia_final full logo]

*The Translation Trustee*

*1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89
<%2B33%206%2084%2065%2068%2089>*

*Email :* *vito.mandorino@linguacustodia.com
<massinissa.ahmim@linguacustodia.com>*

*Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
www.thetranslationtrustee.com <http://www.thetranslationtrustee.com/>*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151106/c6bb3d01/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20151106/c6bb3d01/attachment-0001.jpg

------------------------------

Message: 2
Date: Sat, 7 Nov 2015 11:33:34 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] SRI in mosesdecoder
To: koormoosh <koormoosh@gmail.com>, moses-support@mit.edu
Message-ID: <563DE18E.7020600@gmail.com>
Content-Type: text/plain; charset="windows-1252"

it's been a while since anyone looked at the SRILM code. It should still
work but I can't remember exactly whats going on

On 05/11/2015 14:04, koormoosh wrote:
> I am integrating my LM in mosesdecoder. I started by looking into the
> Skeleton files, and the SRI code. Things are clear except for these
> lines in SRI.cpp which I cannot wrap my head around them:
>
> ngram[count] = Vocab_None;
> ....
> if (finalState) {
> ngram[0] = lmId;
> unsigned int dummy;
> *finalState = m_srilmModel-
>
> assuming that lmId is the id of the last word of the sequence, I don't
> understand the functionality of finalState (probably because I lack
> the MT background). I wonder if you could kindly clarify these things
> if you are familiar with LM integration, or SRI integration in specific:
>
> *1) why are we adding ngram[count] = Vocab_None*
*i guess this is initialising the array element. eg. if your LM is a
trigram but you only want to calculate the score for a unigram, then set
the 1st element in the array to the word, and the other elements to
Vocab_None.

This is how SRILM does it, you don't have to follow the same design in
your LM
*
> *2) what is being checked in the if-condition if(finalState),
> *
*Don't know*
> *3) what is happenning in:
> *finalState = m_srilmModel->contextID(ngram, dummy);*
*This is state information required by the decoder to decide whether to
recombine the hypothesis with another hypothesis. For the language
model, if the trigram is
a b c
The state information is a unique id for the BIGRAM 'b c'. This could be
the hash of the bigram, the memory address of the node where is bigram
is stored, or the string itself. As long as it is different from 'b d,
'd e' etc.

This is the basic description - there are some optimization you can do,
but its important you understand this 1st.

I recommend looking at Philipp Koehn's book. This paper describe a
similar thing, but for syntactic MT
https://kheafield.com/professional/edinburgh/left_paper.pdf

*
>
> Thank you!
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

--
Hieu Hoang
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151107/2db207c3/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 109, Issue 15
**********************************************

Tweet