Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: mert error (Ergun Bicici)
2. Re: mert error (Ergun Bicici)
----------------------------------------------------------------------
Message: 1
Date: Thu, 6 Sep 2018 12:32:03 +0300
From: Ergun Bicici <bicici@gmail.com>
Subject: Re: [Moses-support] mert error
To: claudia.matosveliz@ugent.be
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAB59qTOT28vBXKv0UbdF5G+kYOgkU0aO6ffcEQpiXesDmGx-XA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Aside from the error, I recommend using PRO for tuning.
On Thu, Sep 6, 2018 at 12:28 PM Claudia Matos Veliz <
claudia.matosveliz@ugent.be> wrote:
> Hello,
> I have trained a SMT model using Moses, everything was right whit the
> training but when I tried to tunned the model I got the following error
> with SRILM
>
> Using SCRIPTS_ROOTDIR:
> /dependencies/normalisation_demo/moses_kenlm10/scripts
> Assuming --mertdir=/dependencies/normalisation_demo/moses_kenlm10/bin
> Assuming the tables are already filtered, reusing filtered/moses.ini
> Asking moses for feature names and values from filtered/moses.ini
> Executing: /opt/mosesdecoder/bin/moses -config
> filtered/moses.ini -inputtype 0 -show-weights > ./features.list
> Defined parameters (per moses.ini or switch):
> config: filtered/moses.ini
> distortion-limit: 6
> feature: UnknownWordPenalty WordPenalty PhraseDictionaryMemory
> name=TranslationModel0 table-limit=20 num-features=5
> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/phrase-table.0-0.1.1.gz
> input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0
> num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0
> output-factor=0
> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/reordering-table.wbe-msd-bidirectional-fe
> Distortion SRILM name=LM0 factor=0
> path=/home/claudia/NeuralMoses/lm/model.5 order=5
> input-factors: 0
> inputtype: 0
> mapping: 0 T 0
> show-weights:
> weight: UnknownWordPenalty0= 1 WordPenalty0= -1 TranslationModel0= 0.2 0.2
> 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3 Distortion0= 0.3
> LM0= 0.5
> /opt/mosesdecoder/bin
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 0 end: 1
> WEIGHT UnknownWordPenalty0=1.000,
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 2
> WEIGHT WordPenalty0=-1.000,
> line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20
> num-features=5
> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/phrase-table.0-0.1.1.gz
> input-factor=0 output-factor=0
> FeatureFunction: TranslationModel0 start: 2 end: 7
> WEIGHT TranslationModel0=0.200,0.200,0.200,0.200,0.200,
> line=LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/reordering-table.wbe-msd-bidirectional-fe
> FeatureFunction: LexicalReordering0 start: 7 end: 13
> Initializing LexicalReordering..
> Loading table into memory...done.
> WEIGHT LexicalReordering0=0.300,0.300,0.300,0.300,0.300,0.300,
> line=Distortion
> FeatureFunction: Distortion0 start: 13 end: 14
> WEIGHT Distortion0=0.300,
> line=SRILM name=LM0 factor=0 path=/home/claudia/NeuralMoses/lm/model.5
> order=5
> ERROR:Unknown feature function:SRILM
> Exit code: 1
> Failed to run moses with the config filtered/moses.ini at
> /dependencies/normalisation_demo/moses_kenlm10/scripts/training/
> mert-moses.pl line 1271.
>
> The command I used was this:
>
> nice /dependencies/normalisation_demo/moses_kenlm10/scripts/training/
> mert-moses.pl dev/twe_tok.dev.ori dev/twe_tok.dev.tgt
> /opt/mosesdecoder/bin/moses model/moses.ini
>
> Any help???
> Thanks!!
> Claudia
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
--
Regards,
Ergun
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180906/396a757e/attachment-0001.html
------------------------------
Message: 2
Date: Thu, 6 Sep 2018 12:33:28 +0300
From: Ergun Bicici <bicici@gmail.com>
Subject: Re: [Moses-support] mert error
To: claudia.matosveliz@ugent.be
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAB59qTML4utp93NNEL5rrcg+Z+nwzMbQYn-1gp9=+bzK7Pw1_Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
since PRO outputs more robust results.
On Thu, Sep 6, 2018 at 12:32 PM Ergun Bicici <bicici@gmail.com> wrote:
>
> Aside from the error, I recommend using PRO for tuning.
>
> On Thu, Sep 6, 2018 at 12:28 PM Claudia Matos Veliz <
> claudia.matosveliz@ugent.be> wrote:
>
>> Hello,
>> I have trained a SMT model using Moses, everything was right whit the
>> training but when I tried to tunned the model I got the following error
>> with SRILM
>>
>> Using SCRIPTS_ROOTDIR:
>> /dependencies/normalisation_demo/moses_kenlm10/scripts
>> Assuming --mertdir=/dependencies/normalisation_demo/moses_kenlm10/bin
>> Assuming the tables are already filtered, reusing filtered/moses.ini
>> Asking moses for feature names and values from filtered/moses.ini
>> Executing: /opt/mosesdecoder/bin/moses -config
>> filtered/moses.ini -inputtype 0 -show-weights > ./features.list
>> Defined parameters (per moses.ini or switch):
>> config: filtered/moses.ini
>> distortion-limit: 6
>> feature: UnknownWordPenalty WordPenalty PhraseDictionaryMemory
>> name=TranslationModel0 table-limit=20 num-features=5
>> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/phrase-table.0-0.1.1.gz
>> input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0
>> num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0
>> output-factor=0
>> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/reordering-table.wbe-msd-bidirectional-fe
>> Distortion SRILM name=LM0 factor=0
>> path=/home/claudia/NeuralMoses/lm/model.5 order=5
>> input-factors: 0
>> inputtype: 0
>> mapping: 0 T 0
>> show-weights:
>> weight: UnknownWordPenalty0= 1 WordPenalty0= -1 TranslationModel0= 0.2
>> 0.2 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3 Distortion0=
>> 0.3 LM0= 0.5
>> /opt/mosesdecoder/bin
>> line=UnknownWordPenalty
>> FeatureFunction: UnknownWordPenalty0 start: 0 end: 1
>> WEIGHT UnknownWordPenalty0=1.000,
>> line=WordPenalty
>> FeatureFunction: WordPenalty0 start: 1 end: 2
>> WEIGHT WordPenalty0=-1.000,
>> line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20
>> num-features=5
>> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/phrase-table.0-0.1.1.gz
>> input-factor=0 output-factor=0
>> FeatureFunction: TranslationModel0 start: 2 end: 7
>> WEIGHT TranslationModel0=0.200,0.200,0.200,0.200,0.200,
>> line=LexicalReordering name=LexicalReordering0 num-features=6
>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>> path=/home/claudia/NeuralMoses/twe_token_test/mert-work/filtered/reordering-table.wbe-msd-bidirectional-fe
>> FeatureFunction: LexicalReordering0 start: 7 end: 13
>> Initializing LexicalReordering..
>> Loading table into memory...done.
>> WEIGHT LexicalReordering0=0.300,0.300,0.300,0.300,0.300,0.300,
>> line=Distortion
>> FeatureFunction: Distortion0 start: 13 end: 14
>> WEIGHT Distortion0=0.300,
>> line=SRILM name=LM0 factor=0 path=/home/claudia/NeuralMoses/lm/model.5
>> order=5
>> ERROR:Unknown feature function:SRILM
>> Exit code: 1
>> Failed to run moses with the config filtered/moses.ini at
>> /dependencies/normalisation_demo/moses_kenlm10/scripts/training/
>> mert-moses.pl line 1271.
>>
>> The command I used was this:
>>
>> nice /dependencies/normalisation_demo/moses_kenlm10/scripts/training/
>> mert-moses.pl dev/twe_tok.dev.ori dev/twe_tok.dev.tgt
>> /opt/mosesdecoder/bin/moses model/moses.ini
>>
>> Any help???
>> Thanks!!
>> Claudia
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
> --
>
> Regards,
> Ergun
>
>
>
--
Regards,
Ergun
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180906/0a1348cd/attachment.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 143, Issue 5
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 143, Issue 5"
Post a Comment