Moses-support Digest, Vol 113, Issue 2

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Moses Deadlocking? (Jake Ballinger)
2. Re: Moses Deadlocking? (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Tue, 1 Mar 2016 13:06:34 -0500
From: Jake Ballinger <ballingerj@allegheny.edu>
Subject: [Moses-support] Moses Deadlocking?
To: moses-support@mit.edu
Message-ID:
<CA+5d++gT7D+QFBVjgok2RQXZwdRYGtDxJM=hjRV=XUu8kSqN-w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi everyone,

I'm setting up my baseline system with Moses and I keep running into a
deadlock during the last phase of the tuning.

The last command I used was:
nohup nice ${HOME}/mosesdecoder/scripts/training/mert-moses.pl
${HOME}/corpus/news-test2008.true.${L1}
${HOME}/corpus/news-test2008.true.${L2} ${HOME}/mosesdecoder/bin/moses
${HOME}/working/train/model/moses.ini --decoder-flags="-threads 2"
--no-filter-phrase-table --mertdir ${HOME}/mosesdecoder/bin/ &>
${HOME}/working/experiments/mert.out

When $HOME refers to the root of my repository, $L1 is fr, and $L2 is en.

I've also attached my mert.out log.

Thank you!

--
Jake Ballinger
Major: Computer Science
Minors: Chinese, French, Spanish, & Math
443-974-6184
ballingerj@allegheny.edu
Box 582
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160301/3a868385/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: mert.out
Type: application/octet-stream
Size: 6103 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20160301/3a868385/attachment-0001.obj

------------------------------

Message: 2
Date: Tue, 1 Mar 2016 19:41:02 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Moses Deadlocking?
To: Jake Ballinger <ballingerj@allegheny.edu>, moses-support@mit.edu
Message-ID: <56D5F04E.9080605@gmail.com>
Content-Type: text/plain; charset="windows-1252"

you've given it this flag
--no-filter-phrase-table
this means that the phrase-table won't be cut down to get rid of rules
that is known not to be be used, given the input set.

However, if won't binarize the phrase-table either. it will load the
entire phrase-table into memory. This will probably exhaust your
computer memory.

Therefore, don't use the flag
--no-filter-phrase-table
unless you have a reason to

On 01/03/16 18:06, Jake Ballinger wrote:
> Hi everyone,
>
> I'm setting up my baseline system with Moses and I keep running into a
> deadlock during the last phase of the tuning.
>
> The last command I used was:
> nohup nice ${HOME}/mosesdecoder/scripts/training/mert-moses.pl
> <http://mert-moses.pl> ${HOME}/corpus/news-test2008.true.${L1}
> ${HOME}/corpus/news-test2008.true.${L2} ${HOME}/mosesdecoder/bin/moses
> ${HOME}/working/train/model/moses.ini --decoder-flags="-threads 2"
> --no-filter-phrase-table --mertdir ${HOME}/mosesdecoder/bin/ &>
> ${HOME}/working/experiments/mert.out
>
> When $HOME refers to the root of my repository, $L1 is fr, and $L2 is en.
>
> I've also attached my mert.out log.
>
> Thank you!
>
> --
> Jake Ballinger
> Major: Computer Science
> Minors: Chinese, French, Spanish, & Math
> 443-974-6184
> ballingerj@allegheny.edu <mailto:ballingerj@allegheny.edu>
> Box 582
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

--
Hieu Hoang
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160301/fe628fb1/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 2
*********************************************

Tweet