Moses-support Digest, Vol 102, Issue 7

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: question about the transliteration from arabic to english
using moses yes or no??? (Nadir Durrani)
2. Re: Need help for build issue (Hieu Hoang)
3. Re: How to train a MT model with NPLM in Moses? (Hieu Hoang)
4. Re: How to train a MT model with NPLM in Moses? (Tom Hoar)


----------------------------------------------------------------------

Message: 1
Date: Mon, 6 Apr 2015 20:37:22 +0300
From: Nadir Durrani <nadir.durrani@nu.edu.pk>
Subject: Re: [Moses-support] question about the transliteration from
arabic to english using moses yes or no???
To: moses-support@mit.edu
Cc: emna.hkiri@gmail.com
Message-ID:
<CAFDj2Q3CNZaYNQd4cHuaoa6kgQVGry=6BvfpLDZqGdSH2+brRg@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

Hi Emna,

Moses can mine transliteration pairs from a word-aligned parallel
data, and build transliteration model from it. You can then use the
transliteration model to translate OOV words either in the
post-decoding step or on the fly.

Here's some information on how to enable transliteration module in Moses

http://www.statmt.org/moses/?n=Advanced.OOVs#ntoc2

and here's the related paper

http://aclweb.org/anthology//E/E14/E14-4029.pdf

Cheers,
Nadir



On Mon, Apr 6, 2015 at 7:24 PM, <moses-support-request@mit.edu> wrote:
> Send Moses-support mailing list submissions to
> moses-support@mit.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.mit.edu/mailman/listinfo/moses-support
> or, via email, send a message with subject or body 'help' to
> moses-support-request@mit.edu
>
> You can reach the person managing the list at
> moses-support-owner@mit.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Moses-support digest..."
>
>
> Today's Topics:
>
> 1. question about the transliteration from arabic to english
> using moses yes or no??? (emna hkiri)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 6 Apr 2015 12:04:27 +0100
> From: emna hkiri <emna.hkiri@gmail.com>
> Subject: [Moses-support] question about the transliteration from
> arabic to english using moses yes or no???
> To: moses-support@mit.edu
> Message-ID:
> <CAAp-nZ1Q8u6tgw5X-mJ2w-ru9K8pShKd5qF=Ei4xcKfddx-YZg@mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Dear Freinds
> i have a question about the transliteration from arabic to english using
> moses
> the quetion is if moses do automatically/ by default the transliteration
> of arabic text in the ( arabic corpus pretraitement) before he does the
> translation process or no ????
> thank you
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150406/e0bacedb/attachment-0001.htm
>
> ------------------------------
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> End of Moses-support Digest, Vol 102, Issue 6
> *********************************************


------------------------------

Message: 2
Date: Mon, 06 Apr 2015 22:12:56 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Need help for build issue
To: "siyuan-jing@hotmail.com" <siyuan-jing@hotmail.com>, moses-support
<moses-support@mit.edu>
Message-ID: <5522CCA8.1070804@gmail.com>
Content-Type: text/plain; charset="utf-8"

i think you're having a similar problem to this earlier post:
https://www.mail-archive.com/moses-support%40mit.edu/msg10815.html
If the executables have been successfully created, i would ignore the
errors.

also, please use RELEASE-3.0, or even the latest version directly from
github

On 06/04/2015 12:25, siyuan-jing@hotmail.com wrote:
>
> Dear Moses-support team,
>
> I am a new bird in SMT and I am very interested in Moses.
>
> However, I met some problems when I built the platform. I need your help.
>
> My OS is CentOS 6.4 and g++ version is 4.4.7
>
> Commands are listed below:
>
> mkdir/root/workspace/github
>
> cpmosesdecoder-RELEASE-2.1.1.zip/root/workspace/github
>
> cd/root/workspace/github
>
> unzip mosesdecoder-RELEASE-2.1.1.zip
>
> wget
> http://downloads.sourceforge.net/project/boost/boost/1.55.0/boost_1_55_0.tar.gz?r=http%3A%2F%2Fsourceforge.net%2Fprojects%2Fboost%2Ffiles%2Fboost%2F1.55.0%2F&ts=1389613041&use_mirror=kent
>
> tar zxvf boost_1_55_0.tar.gz
>
> cd boost_1_55_0/
>
> ./bootstrap.sh
>
> ./b2 -j8 --prefix=$PWD --libdir=$PWD/lib64 --layout=system link=static
> install || echo FAILURE
>
> cd/root/workspace/github/mosesdecoder-RELEASE-2.1.1
>
> ./bjam --with-boost=/root/workspace/github/boost_1_55_0 -j8 > build.log
>
> The build.log has been attached in the email.
>
> Thank you for your help.
>
> Best regards.
>
> ------------------------------------------------------------------------
>
> Si-Yuan Jing
>
> Leshan Normal University, China
>
> Tel: +8618384646322 <tel:+8618384646322>
>
> Email: siyuan-jing@hotmail.com
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150406/25131e77/attachment-0001.htm

------------------------------

Message: 3
Date: Tue, 07 Apr 2015 10:08:32 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] How to train a MT model with NPLM in
Moses?
To: Tom Hoar <tahoar@precisiontranslationtools.com>, moses-support
<moses-support@mit.edu>
Message-ID: <55237460.1080707@gmail.com>
Content-Type: text/plain; charset="windows-1252"

The NPLM isn't just an implementation of a normal backoff language model
like SRILM, IRSTLM, KENLM etc.

It scores strings in a different way and requires it's own training.
It's a language model in the sense that it gives a score to a sentence
in that language

On 24/03/2015 04:17, Tom Hoar wrote:
>
> I haven't done it, but once you've updated the moses.ini file with the
> NPLM FF, shouldn't the existing train-model.perl & mert-moses.pl
> <http://mert-moses.pl> scripts run unchanged?
>
>
>
> ---- liling tan wrote ----
>
> Dear Moses devs/users,
>
> Is there any working script for training a moses model with NPLM?
>
> Is there any working train-model script for training a MT model with
> bilingual LM?
> http://www.statmt.org/moses/?n=FactoredTraining.BuildingLanguageModel#ntoc35
>
> Is there a tutorial on Vector/Neural MT for moses on like
> http://www.statmt.org/moses/?n=Moses.SyntaxTutorial
>
> Are there any slides/script/hints on explanation on how the bilingual
> LM works with the moses decoder?
>
> Regards,
> Liling
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150407/8a9f8b18/attachment-0001.htm

------------------------------

Message: 4
Date: Tue, 07 Apr 2015 13:24:15 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] How to train a MT model with NPLM in
Moses?
To: moses-support <moses-support@mit.edu>
Message-ID: <5523780F.6040302@precisiontranslationtools.com>
Content-Type: text/plain; charset="utf-8"

Thanks, Hieu.

After I wrote the question, I realized I should re-phrase but then
forgot about it. In the standard processing, train-model.perl trains the
translation model and lmplz (or other tool) creates the language model.
When adding a neural network language mode, it looks like you're
confirming that the NPLM tools train the neural network language model.
Hence, my question's reference to train-model.perl was in error.

After separately training the three models: translation, language and
neural network language, you edit the moses.ini file to use them
together as one SMT model. Once the moses.ini file is configured, you
set it as the -config argument for mert-moses.perl. At this point, it
looks the existence of the additional model is irrelevant to mert-moses.pl.



On 4/7/2015 1:08 PM, Hieu Hoang wrote:
> The NPLM isn't just an implementation of a normal backoff language
> model like SRILM, IRSTLM, KENLM etc.
>
> It scores strings in a different way and requires it's own training.
> It's a language model in the sense that it gives a score to a sentence
> in that language
>
> On 24/03/2015 04:17, Tom Hoar wrote:
>>
>> I haven't done it, but once you've updated the moses.ini file with
>> the NPLM FF, shouldn't the existing train-model.perl & mert-moses.pl
>> <http://mert-moses.pl> scripts run unchanged?
>>
>>
>>
>> ---- liling tan wrote ----
>>
>> Dear Moses devs/users,
>>
>> Is there any working script for training a moses model with NPLM?
>>
>> Is there any working train-model script for training a MT model with
>> bilingual LM?
>> http://www.statmt.org/moses/?n=FactoredTraining.BuildingLanguageModel#ntoc35
>>
>> Is there a tutorial on Vector/Neural MT for moses on like
>> http://www.statmt.org/moses/?n=Moses.SyntaxTutorial
>>
>> Are there any slides/script/hints on explanation on how the bilingual
>> LM works with the moses decoder?
>>
>> Regards,
>> Liling
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150407/de3888c9/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 102, Issue 7
*********************************************

Tweet