Moses-support Digest, Vol 89, Issue 8

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Moses Error (Rohit More)
2. Incorrectly formated moses.ini with feature-overwrite?
(Kenneth Heafield)
3. Re: Language Model Training failed (Seth Jarrett)
4. Re: giza-training-error-EMS (nadeem khan)


----------------------------------------------------------------------

Message: 1
Date: Tue, 4 Mar 2014 23:11:32 +0530
From: Rohit More <rohit4690@gmail.com>
Subject: [Moses-support] Moses Error
To: moses-support@mit.edu
Message-ID:
<CAHwdTDLG2KWKTdumdS6ZwmrCgZCvHcA31pytzDnJr_Be6eB3WQ@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Command used:

./bjam --with-srilm=/home/rohit/Study/moses/tools/srilm/
--with-giza=/home/rohit/Study/moses/tools/bin/ >build.log

--
Rohit More.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140304/21ae7f81/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.tar.gz
Type: application/x-gzip
Size: 1922 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140304/21ae7f81/attachment-0001.bin

------------------------------

Message: 2
Date: Tue, 04 Mar 2014 15:28:26 -0800
From: Kenneth Heafield <moses@kheafield.com>
Subject: [Moses-support] Incorrectly formated moses.ini with
feature-overwrite?
To: Moses <moses-support@mit.edu>
Message-ID: <5316619A.2030709@kheafield.com>
Content-Type: text/plain; charset=ISO-8859-1

Dear Moses,

As is the custom of Philipp's people, I ran

$moses/scripts/training/mert-moses.pl $data/tuning/input.tc.*
$data/tuning/reference.tc.* $moses/bin/moses $data/moses.ini --nbest 100
--working-dir $mert --decoder-flags "-threads 32 -mp -search-algorithm
1 -cube-pruning-pop-limit 1000 -s 1000 -feature-overwrite
'TranslationModel0 table-limit=100' -max-trans-opt-per-coverage 100 -v 0
" --rootdir $moses/scripts -mertdir $moses/bin --batch-mira
--return-best-dev -maximum-iterations 25 --threads 32
--no-filter-phrase-table --continue

That failed part way through (it completed 12 iterations) and I got
desperate enough to pick the best iteration by BLEU e.g.
mert/run09.moses.ini . This file contains, in part, the following:

[feature-overwrite]
'TranslationModel0
table-limit=100'

After editing the file to use test-set filtered evaluation set, I ran
Moses and got this error:

Exception: moses/StaticData.cpp:1153 in void
Moses::StaticData::OverrideFeatures() threw util::Exception because
`toks.size() <= 1'.
Incorrect format for feature override: table-limit=100'

It seems mert-moses.pl is generating moses.ini files that the decoder is
unwilling to accept.

Kenneth


------------------------------

Message: 3
Date: Wed, 5 Mar 2014 00:36:19 +0000 (UTC)
From: Seth Jarrett <seth@idanet.co.jp>
Subject: Re: [Moses-support] Language Model Training failed
To: moses-support@mit.edu
Message-ID: <loom.20140305T013316-291@post.gmane.org>
Content-Type: text/plain; charset=us-ascii

> First four commands were executed successfuly. The last one failed. Here
is the result after entering the following command line:zzz <at>
zzz-laptop:~/lm$ ~/moses/irstlm/bin/compile-lm --text
news-commentary-v8.fr-en.lm.en.gz news-commentary-v8.fr-en.arpa.en
>
> inpfile: news-commentary-v8.fr-en.arpa.enloading up to the LM level 1000
(if any)
> dub: 10000000Failed to open news-commentary-v8.fr-en.arpa.en!zzz <at>
zzz-laptop:~/lm$ ----------------Where we made a mistake? I see the
xxx.arpa.en listed as input file. Shouldn't be the xxx.arpa.en file an
output file?Best regards!
>

I was having the same problem when following the steps in the baseline
instructions but I was able to get it to work by adding "yes" after --text.

Try this:

~/moses/irstlm/bin/compile-lm --text yes news-commentary-v8.fr-en.lm.en.gz
news-commentary-v8.fr-en.arpa.en




------------------------------

Message: 4
Date: Tue, 4 Mar 2014 23:31:24 -0800 (PST)
From: nadeem khan <nad_star06@yahoo.com>
Subject: Re: [Moses-support] giza-training-error-EMS
To: moses-support <moses-support@mit.edu>, Hieu Hoang
<hieuhoang@gmail.com>
Message-ID:
<1394004684.5012.YahooMailNeo@web162402.mail.bf1.yahoo.com>
Content-Type: text/plain; charset="iso-8859-1"

HI All;
I am getting the giza and giza In-versed failed error on EMS moses toy data default that is given in example of EMS and ?same error ?with my own given data.
using ubuntu 12.04
Error given at the end of STDERR is :


ERROR: Giza did not produce the output file /home/legends/work/ems-toy/training/giza.1/en-fr.A3.final. Is your corpus clean (reasonably-sized sentences)? at /home/legends/tools/mosesdecoder-RELEASE-2.1/scripts/training/train-model.perl line 1178.

Corpus is already cleaned by the initial steps of EMS. Please help me out in solving this issue..

THANK YOU




On Monday, March 3, 2014 4:02 PM, nadeem khan <nad_star06@yahoo.com> wrote:

HI All;
I am getting the giza failed error on EMS moses toy data default that is given in example of EMS.
using ubuntu 12.04
please check out the attached screen shot and? EMS step files attached..

Error is :

ERROR: Giza did not produce the output file /home/legends/work/ems-toy/training/giza.1/en-fr.A3.final. Is your corpus clean (reasonably-sized sentences)? at
/home/legends/tools/mosesdecoder-RELEASE-2.1/scripts/training/train-model.perl line 1178.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140304/be6fdd40/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 89, Issue 8
********************************************

Tweet