Moses-support Digest, Vol 126, Issue 38

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: EMS with multiple language models (Hieu Hoang)
2. Re: Moses-support Digest, Vol 125, Issue 39 (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 27 Apr 2017 12:17:23 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] EMS with multiple language models
To: K Pavan <kosuru.pavan@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbg=hmfgqFhnKX-LV+69i9C=4-aOZG8fwGr1njU6=D6y1A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

The EMS experiment in here uses 2 LMs:
http://www.statmt.org/moses/RELEASE-3.0/models/fr-en/steps/4/
If you want to see how train-model.perl is called, you should look at this
file:

http://www.statmt.org/moses/RELEASE-3.0/models/fr-en/steps/4/TRAINING_create-config.4

I don't know what weights the command gives it. However, this is irrelevant
as the tuning will set the weight to the optimal numbers

* Looking for MT/NLP opportunities *
Hieu Hoang
http://moses-smt.org/


On 24 April 2017 at 11:22, K Pavan <kosuru.pavan@gmail.com> wrote:

> Hi ,
>
> I was experiment with EMS (experiment.perl). I have language model built
> on input corpus also language model with all english corpus (say europal
> corpora). So ideally I want my moes config should have LM0 and LM1 with
> equal weight. I tried to add this as part of config in EMS, failing to do
> so. Can somebody help me out here.
>
>
> My training command looks like below if I do it manually
>
> moses/scripts/training/train-model.perl -root-dir $WORKDIR \
> --sort-buffer-size=4G \
> -corpus $CORPUS \
> -mgiza root/usr/bin/mgiza -mgiza-cpus 8 \
> -f fr -e en -alignment grow-diag-final-and \
> -reordering msd-bidirectional-fe \
> * -lm 0:4:/lm/big-4gram.2012-02-02.en.lm.kenlm.trie.q8:8 *
> *-lm 0:4:moses-fr-en_europal/lm/fr_en_europal.lm.kenlm.trie.q8* \
> -score-options='--GoodTuring' \
> --dont-zip \
> --parallel"
>
>
> Thanks,
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170427/7ee86675/attachment-0001.html

------------------------------

Message: 2
Date: Thu, 27 Apr 2017 13:45:39 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Moses-support Digest, Vol 125, Issue 39
To: Tran Anh <anhuni1006@gmail.com>, moses-support@mit.edu
Message-ID: <76b1b09e-44a1-72d2-d3f2-cc9a5e1c78fd@gmail.com>
Content-Type: text/plain; charset="windows-1252"

It's usually BLEU-4. I'm not sure what you mean by Smoothed BLEU.

I don't think there's a standard BLEU score, even the original BLEU
scoring script is continuously updated:

https://github.com/moses-smt/mosesdecoder/blob/master/scripts/generic/mteval-v*.pl

Each version may give a slightly different answer. So when you quote a
BLEU score, you should say exactly what version you used


On 09/04/2017 04:26, Tran Anh wrote:
> Dear all,
>
> I want to ask about using BLEU to calculate the similarity between two
> sentences (the same language).
> I trained the translation model using MOSES. Then input two files with
> the same number of line, one sentence per line. I get the result that
> every pair of sentences has the corresponding BLEU score.
> So, I want to ask: BLEU in Moses that I used to calculate the
> similarity is common BLEU-4 or Smoothed BLEU?
>
> Thank you so much!
> Anh,
>
>
> On Sun, Mar 19, 2017 at 12:00 AM, <moses-support-request@mit.edu
> <mailto:moses-support-request@mit.edu>> wrote:
>
> Send Moses-support mailing list submissions to
> moses-support@mit.edu <mailto:moses-support@mit.edu>
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.mit.edu/mailman/listinfo/moses-support
> <http://mailman.mit.edu/mailman/listinfo/moses-support>
> or, via email, send a message with subject or body 'help' to
> moses-support-request@mit.edu <mailto:moses-support-request@mit.edu>
>
> You can reach the person managing the list at
> moses-support-owner@mit.edu <mailto:moses-support-owner@mit.edu>
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Moses-support digest..."
>
>
> Today's Topics:
>
> 1. Re: Moses compiling error with boost 1.55 (Gongbo Tang)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Fri, 17 Mar 2017 21:24:56 +0000
> From: Gongbo Tang <gongbo.tang@lingfil.uu.se
> <mailto:gongbo.tang@lingfil.uu.se>>
> Subject: Re: [Moses-support] Moses compiling error with boost 1.55
> To: Raj Dabre <prajdabre@gmail.com <mailto:prajdabre@gmail.com>>
> Cc: "moses-support@mit.edu <mailto:moses-support@mit.edu>"
> <moses-support@mit.edu <mailto:moses-support@mit.edu>>
> Message-ID:
>
> <FFCD26168C7C7445AAFD9DFF9868FFB6054D3C78@COLUMBA02.user.uu.se
> <mailto:FFCD26168C7C7445AAFD9DFF9868FFB6054D3C78@COLUMBA02.user.uu.se>>
> Content-Type: text/plain; charset="iso-8859-1"
>
> Yes, I also think that there is something wrong with the Boost
> version, or gcc version.
>
> There is still an error when I compile with absolute path.
>
> Thank you very much!
>
> Best,
> Gongbo
> ________________________________
> From: Raj Dabre [prajdabre@gmail.com <mailto:prajdabre@gmail.com>]
> Sent: Friday, March 17, 2017 4:02 PM
> To: Gongbo Tang
> Cc: Hieu Hoang; moses-support@mit.edu <mailto:moses-support@mit.edu>
> Subject: Re: [Moses-support] Moses compiling error with boost 1.55
>
> Use the latest boost (1.63 I think) and it should work. I had the
> same issue.
>
> On Fri, Mar 17, 2017 at 11:48 PM, Hieu Hoang <hieuhoang@gmail.com
> <mailto:hieuhoang@gmail.com><mailto:hieuhoang@gmail.com
> <mailto:hieuhoang@gmail.com>>> wrote:
> there's a lot of errors due to unit tests not compiling properly.
> I'm not sure why this happens, but you can ignore it.
>
> However, there's failure due to not linking with irstlm correctly.
> This may be because the path to irstlm is incorrect, it must also
> be absolute path, not relative
>
> * Looking for MT/NLP opportunities *
> Hieu Hoang
> http://moses-smt.org/
>
>
> On 17 March 2017 at 14:13, Gongbo Tang <gongbo.tang@lingfil.uu.se
> <mailto:gongbo.tang@lingfil.uu.se><mailto:gongbo.tang@lingfil.uu.se
> <mailto:gongbo.tang@lingfil.uu.se>>> wrote:
> Hi,
>
> I encountered an error when I was running the command:
>
> bjam -j4 --with-giza=/the-dir-of-giza-pp
> --with-irstlm=opt/irstlm-5.80.08/ >& bjam.log
>
> The log is attached.
>
> And, the gcc version is 4.8.2; the Boost version is 1.55. The
> server system is Red Hat 4.4.7-17.
>
> Best,
> Gongbo
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> <mailto:Moses-support@mit.edu><mailto:Moses-support@mit.edu
> <mailto:Moses-support@mit.edu>>
> http://mailman.mit.edu/mailman/listinfo/moses-support
> <http://mailman.mit.edu/mailman/listinfo/moses-support>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> <mailto:Moses-support@mit.edu><mailto:Moses-support@mit.edu
> <mailto:Moses-support@mit.edu>>
> http://mailman.mit.edu/mailman/listinfo/moses-support
> <http://mailman.mit.edu/mailman/listinfo/moses-support>
>
>
>
>
> --
> Raj Dabre.
> Doctoral Student,
> Graduate School of Informatics,
> Kyoto University.
> CSE MTech, IITB., 2011-2014
>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL:
> http://mailman.mit.edu/mailman/private/moses-support/attachments/20170317/62c08583/attachment-0001.html
> <http://mailman.mit.edu/mailman/private/moses-support/attachments/20170317/62c08583/attachment-0001.html>
>
> ------------------------------
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
> <http://mailman.mit.edu/mailman/listinfo/moses-support>
>
>
> End of Moses-support Digest, Vol 125, Issue 39
> **********************************************
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

--
Hieu Hoang
http://moses-smt.org/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170427/f05f81ba/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 126, Issue 38
**********************************************

Tweet