Moses-support Digest, Vol 143, Issue 6

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: mert error (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 6 Sep 2018 13:01:03 +0200
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] mert error
To: claudia.matosveliz@ugent.be
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbj2tU7SHXn82gBOE+yS5LMi9QFumRqiSK0E1HoHCHnYpQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

in your moses.ini, replace the word SRILM with KENLM

what was the exact command you use to create moses.ini? That should be
changed so that KENLM is used instead of SRILM

Hieu Hoang
Sent while bumping into things

On Thu, 6 Sep 2018, 11:28 am Claudia Matos Veliz, <
claudia.matosveliz@ugent.be> wrote:

> Hello,
> I have trained a SMT model using Moses, everything was right whit the
> training but when I tried to tunned the model I got the following error
> with SRILM
>
> Using SCRIPTS_ROOTDIR:
> /dependencies/normalisation_demo/moses_kenlm10/scripts
> Assuming --mertdir=/dependencies/normalisation_demo/moses_kenlm10/bin
> Assuming the tables are already filtered, reusing filtered/moses.ini
> Asking moses for feature names and values from filtered/moses.ini
> Executing: /opt/mosesdecoder/bin/moses -config
> filtered/moses.ini -inputtype 0 -show-weights > ./features.list
> Defined parameters (per moses.ini or switch):
> config: filtered/moses.ini
> distortion-limit: 6
> feature: UnknownWordPenalty WordPenalty PhraseDictionaryMemory
> name=TranslationModel0 table-limit=20 num-features=5
> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/phrase-table.0-0.1.1.gz
> input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0
> num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0
> output-factor=0
> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/reordering-table.wbe-msd-bidirectional-fe
> Distortion SRILM name=LM0 factor=0
> path=/home/claudia/NeuralMoses/lm/model.5 order=5
> input-factors: 0
> inputtype: 0
> mapping: 0 T 0
> show-weights:
> weight: UnknownWordPenalty0= 1 WordPenalty0= -1 TranslationModel0= 0.2 0.2
> 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3 Distortion0= 0.3
> LM0= 0.5
> /opt/mosesdecoder/bin
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 0 end: 1
> WEIGHT UnknownWordPenalty0=1.000,
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 2
> WEIGHT WordPenalty0=-1.000,
> line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20
> num-features=5
> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/phrase-table.0-0.1.1.gz
> input-factor=0 output-factor=0
> FeatureFunction: TranslationModel0 start: 2 end: 7
> WEIGHT TranslationModel0=0.200,0.200,0.200,0.200,0.200,
> line=LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/reordering-table.wbe-msd-bidirectional-fe
> FeatureFunction: LexicalReordering0 start: 7 end: 13
> Initializing LexicalReordering..
> Loading table into memory...done.
> WEIGHT LexicalReordering0=0.300,0.300,0.300,0.300,0.300,0.300,
> line=Distortion
> FeatureFunction: Distortion0 start: 13 end: 14
> WEIGHT Distortion0=0.300,
> line=SRILM name=LM0 factor=0 path=/home/claudia/NeuralMoses/lm/model.5
> order=5
> ERROR:Unknown feature function:SRILM
> Exit code: 1
> Failed to run moses with the config filtered/moses.ini at
> /dependencies/normalisation_demo/moses_kenlm10/scripts/training/
> mert-moses.pl line 1271.
>
> The command I used was this:
>
> nice /dependencies/normalisation_demo/moses_kenlm10/scripts/training/
> mert-moses.pl dev/twe_tok.dev.ori dev/twe_tok.dev.tgt
> /opt/mosesdecoder/bin/moses model/moses.ini
>
> Any help???
> Thanks!!
> Claudia
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180906/3f7f9ee7/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 143, Issue 6
*********************************************

Tweet