Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Decoderdied in tunning step (Arezoo Arjomand)
2. Re: Decoder died in tunning step! (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Thu, 23 Aug 2018 08:12:24 +0000 (UTC)
From: Arezoo Arjomand <arezooarjomand@yahoo.com>
Subject: [Moses-support] Decoderdied in tunning step
To: "moses-support-request@mit.edu" <moses-support-request@mit.edu>,
"moses-support-owner@mit.edu" <moses-support-owner@mit.edu>,
"moses-support-bounces@mit.edu" <moses-support-bounces@mit.edu>,
"moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <1553868067.1373599.1535011944467@mail.yahoo.com>
Content-Type: text/plain; charset="utf-8"
Hi,
I installed successfully moses decoder on server. I runsyntax grammer extraction as follow :
/home/vps/mosesdecoder/scripts/training/train-model.perl? \
-root-dir train? \
-corpus /home/vps/emlla//ttt/news-commentary-v8.fr-en.clean? \
-f fr -e en -alignmentgrow-diag-final-and? -hierarchical ???-glue-grammar ??????\?-lm 0:3:/home/vps/emlla//ttt/news-commentary-v8.fr-en.blm.en? \
-mgiza -mgiza-cpus 4? \
-external-bin-dir ?/homevps/mosesdecoder/tools>&training2.out
the file which created is :
train ? corpus , giza.en-fr, giza.fr-en, model
model ? aligned.grow-diag-final-and, extract.sorted.gz,lex.e2f,? moses.ini,extract.inv.sorted.gz,???????glue-grammar, lex.f2e? rule-table.gz
to tune the model the following command is run:
/home/vps/mosesdecoder/scripts/training/mert-moses.pl? /home/vps/emlla/nc-dev2007.en.true.fr? /home/vps/emlla/nc-dev2007.en.true.en? /home/vps/mosesdecoder/bin/moses2/home/vps/emlla/train/model/moses.ini --rootdir?/home/vps/mosesdecoder/scripts --decoder-flags "-v 0"--no-filter-phrase-table --inputtype 3????--batch-mira --return-best-dev?--filtercmd'/home/vps/mosesdecoder/scripts/training/filter-model-given-input.pl -Binarizer"CreateOnDiskPt 1 1 5 100 2" ' --batch-mira-args '-J 300'--decoder-flags '-threads 8 -v 0' 1>&mert.out
but it dies in following step:? Finishedloading LM0
LoadingUnknownWordPenalty0
Finishedloading UnknownWordPenalty0
LoadingTranslationModel0
Finishedloading TranslationModel0
LoadingTranslationModel1
Finishedloading TranslationModel1
STARTLoadMappings()
ENDLoadMappings()
END LoadDecodeGraphBackoff()
Loaded :[0.0490292] seconds
RUN BATCH
terminatecalled after throwing an instance of 'util::Exception'
? what():?moses2/SCFG/nbest/KBestExtractor.cpp:42 in void Moses2::SCFG::KBestE$
Only supposeto be 1 hypo coll in last stack
Aborted (coredumped)
Exit code:134
The decoderdied. CONFIG WAS -weight-overwrite 'TranslationModel1= 0.285714 Phr$
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180823/2c04f7b3/attachment-0001.html
------------------------------
Message: 2
Date: Thu, 23 Aug 2018 11:21:58 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Decoder died in tunning step!
To: Arezoo Arjomand <arezooarjomand@yahoo.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbj5PbSedAn9-C9V=VW0ndc096HPw+o+DodXQmEZWJce5Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
you need to binarize with CreateProbingPT if you use moses2
if you use CreateOnDiskPt then you must use the moses decoder
Hieu Hoang
http://statmt.org/hieu
On Thu, 23 Aug 2018 at 09:02, Arezoo Arjomand <arezooarjomand@yahoo.com>
wrote:
> Hi,
>
> I installed successfully moses decoder on server. I run syntax grammer
> extraction as follow :
>
>
>
> /home/vps/mosesdecoder/scripts/training/train-model.perl \
>
> -root-dir train \
>
> -corpus /home/vps/emlla//ttt/news-commentary-v8.fr-en.clean \
>
> -f fr -e en -alignment grow-diag-final-and -hierarchical -glue-grammar
> \ -lm 0:3:/home/vps/emlla//ttt/news-commentary-v8.fr-en.blm.en \
>
> -mgiza -mgiza-cpus 4 \
>
> *-external-bin-dir * /*home*vps/mosesdecoder/tools >&training2.out
>
>
>
> the file which created is :
>
>
>
> train ? corpus , giza.en-fr, giza.fr-en, model
>
> model ? aligned.grow-diag-final-and, extract.sorted.gz, lex.e2f, moses.ini,
> extract.inv.sorted.gz, glue-grammar, lex.f2e rule-table.gz
>
>
>
> to tune the model the following command is run:
>
>
>
> /home/vps/mosesdecoder/scripts/training/mert-moses.pl /home/vps/emlla/
> nc-dev2007.en.true.fr /home/vps/emlla/nc-dev2007.en.true.en /home/vps/mosesdecoder/bin/moses2
> /home/vps/emlla/train/model/moses.ini --rootdir /home/vps/mosesdecoder/scripts
> --decoder-flags "-v 0" --no-filter-phrase-table --inputtype 3 --batch-mira
> --return-best-dev --filtercmd '/home/vps/mosesdecoder/scripts/training/
> filter-model-given-input.pl -Binarizer "CreateOnDiskPt 1 1 5 100 2" '
> --batch-mira-args '-J 300' --decoder-flags '-threads 8 -v 0' 1>&mert.out
>
>
> but it dies in following step:
>
>
> Finished loading LM0
>
> Loading UnknownWordPenalty0
>
> Finished loading UnknownWordPenalty0
>
> Loading TranslationModel0
>
> Finished loading TranslationModel0
>
> Loading TranslationModel1
>
> Finished loading TranslationModel1
>
> START LoadMappings()
>
> END LoadMappings()
>
> END LoadDecodeGraphBackoff()
>
> Loaded : [0.0490292] seconds
>
> RUN BATCH
>
> terminate called after throwing an instance of 'util::Exception'
>
> what(): moses2/SCFG/nbest/KBestExtractor.cpp:42 in void
> Moses2::SCFG::KBestE$
>
> Only suppose to be 1 hypo coll in last stack
>
> Aborted (core dumped)
>
> Exit code: 134
> The decoder died. CONFIG WAS -weight-overwrite 'TranslationModel1=
> 0.285714 Phr$
>
> how can I fix it?
> Thank you for your attention
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180823/1c930079/attachment.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 142, Issue 8
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 142, Issue 8"
Post a Comment