Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Factored Model / moses.exe.srackdump (Marwa Refaie)
2. Re: Factored Model / moses.exe.srackdump (Marcin Junczys-Dowmunt)
----------------------------------------------------------------------
Message: 1
Date: Tue, 7 Oct 2014 20:41:03 +0000
From: Marwa Refaie <basmallah@hotmail.com>
Subject: [Moses-support] Factored Model / moses.exe.srackdump
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <DUB118-W27624CF047AC37D7A0420FBAA20@phx.gbl>
Content-Type: text/plain; charset="windows-1256"
Marwa N. Refaie
From: basmallah@hotmail.com
To: basmallah@hotmail.com
Subject: Factored Model / moses.exe.srackdump
Date: Tue, 7 Oct 2014 20:40:07 +0000
I build the two language model by SRILM, one for surface and one for pos tags, I used pos in both language sides.. train ::
c:/mosesdecoder-master/scripts/training/train-model.perl
-external-bin-dir c:/mosesdecoder-master/tools/bin -root-dir work -corpus
c:/mosesdecoder-master/try/ai/sep/fsmt/data/UNpos.lo -f en -e ar
-Translation-factors 0,1-0,1 -lm
0:5:/cygdrive/c:/mosesdecoder-master/try/ai/sep/fsmt/model/surface.lm:0 -lm
1:5:/cygdrive/c:/mosesdecoder-master/try/ai/sep/fsmt/model/pos.lm:0 -generation-factors
0-1 -decoding-steps t0,g0 >&
training.out&
it's done & moses.ini found, but I got this error when try to translate (test),,,, Any help please !!!!
############################ MOSES CONFIG FILE ############################
# input factors[input-factors]01
# mapping steps[mapping]0 T 00 G 0
[distortion-limit]6
# feature functions[feature]UnknownWordPenaltyWordPenaltyPhrasePenaltyPhraseDictionaryMemory name=TranslationModel0 table-limit=20 num-features=4 path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/phrase-table.0,1-0,1.gz input-factor=0,1 output-factor=0,1Generation name=GenerationModel0 num-features=2 path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/generation.0-1.gz input-factor=0 output-factor=1DistortionSRILM name=LM0 factor=0 path=/cygdrive/c order=5SRILM name=LM1 factor=1 path=/cygdrive/c order=5
# dense weights for feature functions[weight]UnknownWordPenalty0= 1WordPenalty0= -1PhrasePenalty0= 0.2TranslationModel0= 0.2 0.2 0.2 0.2GenerationModel0= 0.3 0Distortion0= 0.3LM0= 0.5LM1= 0.5.....................................................................................
OUTPUT
config: C:/mosesdecoder-master/try/ai/sep/fsmt/work/model/moses.ini distortion-limit: 6 feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryMemory name=TranslationModel0 table-limit=20 num-features=4 path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/phrase-table.0,1-0,1.gz input-factor=0,1 output-factor=0,1 Generation name=GenerationModel0 num-features=2 path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/generation.0-1.gz input-factor=0 output-factor=1 Distortion SRILM name=LM0 factor=0 path=/cygdrive/c order=5 SRILM name=LM1 factor=1 path=/cygdrive/c order=5 input-factors: 0 1 mapping: 0 T 0 0 G 0 weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2 TranslationModel0= 0.2 0.2 0.2 0.2 GenerationModel0= 0.3 0 Distortion0= 0.3 LM0= 0.5 LM1= 0.5c:/mosesdecoder-master/binline=UnknownWordPenaltyFeatureFunction: UnknownWordPenalty0 start: 0 end: 0line=WordPenaltyFeatureFunction: WordPen!
alty0 start: 1 end: 1line=PhrasePenaltyFeatureFunction: PhrasePenalty0 start: 2 end: 2line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20 num-features=4 path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/phrase-table.0,1-0,1.gz input-factor=0,1 output-factor=0,1FeatureFunction: TranslationModel0 start: 3 end: 6line=Generation name=GenerationModel0 num-features=2 path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/generation.0-1.gz input-factor=0 output-factor=1FeatureFunction: GenerationModel0 start: 7 end: 8line=DistortionFeatureFunction: Distortion0 start: 9 end: 9line=SRILM name=LM0 factor=0 path=/cygdrive/c order=5FeatureFunction: LM0 start: 10 end: 10line=SRILM name=LM1 factor=1 path=/cygdrive/c order=5FeatureFunction: LM1 start: 11 end: 11terminate called after throwing an instance of 'std::string'Aborted (core dumped)
Marwa N. Refaie
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141007/05381ca7/attachment-0001.htm
------------------------------
Message: 2
Date: Tue, 07 Oct 2014 22:49:46 +0200
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Factored Model / moses.exe.srackdump
To: moses-support@mit.edu
Message-ID: <543451EA.5030606@amu.edu.pl>
Content-Type: text/plain; charset="iso-8859-1"
Hi,
check the paths of your language models, you are giving just the name of
your C partition, this is clearly wrong.
Also, your decoding path settings seem a little bit suspicious to me.
You already have two output factors in your phrase-table, is the
generation table actually doing anything useful?
Best,
Marcin
W dniu 07.10.2014 22:41, Marwa Refaie pisze:
>
>
>
>
>
> /*Marwa N. Refaie*/
>
>
>
> ------------------------------------------------------------------------
> From: basmallah@hotmail.com
> To: basmallah@hotmail.com
> Subject: Factored Model / moses.exe.srackdump
> Date: Tue, 7 Oct 2014 20:40:07 +0000
>
> I build the two language model by SRILM, one for surface and one for
> pos tags, I used pos in both language sides.. train ::
>
> c:/mosesdecoder-master/scripts/training/train-model.perl
> -external-bin-dir c:/mosesdecoder-master/tools/bin -root-dir work
> -corpus c:/mosesdecoder-master/try/ai/sep/fsmt/data/UNpos.lo -f en -e
> ar -Translation-factors 0,1-0,1 -lm
> 0:5:/cygdrive/c:/mosesdecoder-master/try/ai/sep/fsmt/model/surface.lm:0 -lm
> 1:5:/cygdrive/c:/mosesdecoder-master/try/ai/sep/fsmt/model/pos.lm:0
> -generation-factors 0-1 -decoding-steps t0,g0 >& training.out&
>
>
> it's done & moses.ini found, but I got this error when try to
> translate (test),,,,
> Any help please !!!!
>
> #########################
> ### MOSES CONFIG FILE ###
> #########################
>
> # input factors
> [input-factors]
> 0
> 1
>
> # mapping steps
> [mapping]
> 0 T 0
> 0 G 0
>
> [distortion-limit]
> 6
>
> # feature functions
> [feature]
> UnknownWordPenalty
> WordPenalty
> PhrasePenalty
> PhraseDictionaryMemory name=TranslationModel0 table-limit=20
> num-features=4
> path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/phrase-table.0,1-0,1.gz
> input-factor=0,1 output-factor=0,1
> Generation name=GenerationModel0 num-features=2
> path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/generation.0-1.gz
> input-factor=0 output-factor=1
> Distortion
> SRILM name=LM0 factor=0 path=/cygdrive/c order=5
> SRILM name=LM1 factor=1 path=/cygdrive/c order=5
>
> # dense weights for feature functions
> [weight]
> UnknownWordPenalty0= 1
> WordPenalty0= -1
> PhrasePenalty0= 0.2
> TranslationModel0= 0.2 0.2 0.2 0.2
> GenerationModel0= 0.3 0
> Distortion0= 0.3
> LM0= 0.5
> LM1= 0.5
> .....................................................................................
>
> *_OUTPUT_*
>
>
> config: C:/mosesdecoder-master/try/ai/sep/fsmt/work/model/moses.ini
> distortion-limit: 6
> feature: UnknownWordPenalty WordPenalty PhrasePenalty
> PhraseDictionaryMemory name=TranslationModel0 table-limit=20
> num-features=4
> path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/phrase-table.0,1-0,1.gz
> input-factor=0,1 output-factor=0,1 Generation name=GenerationModel0
> num-features=2
> path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/generation.0-1.gz
> input-factor=0 output-factor=1 Distortion SRILM name=LM0 factor=0
> path=/cygdrive/c order=5 SRILM name=LM1 factor=1 path=/cygdrive/c order=5
> input-factors: 0 1
> mapping: 0 T 0 0 G 0
> weight: UnknownWordPenalty0= 1 WordPenalty0= -1
> PhrasePenalty0= 0.2 TranslationModel0= 0.2 0.2 0.2 0.2
> GenerationModel0= 0.3 0 Distortion0= 0.3 LM0= 0.5 LM1= 0.5
> c:/mosesdecoder-master/bin
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 1
> line=PhrasePenalty
> FeatureFunction: PhrasePenalty0 start: 2 end: 2
> line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20
> num-features=4
> path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/phrase-table.0,1-0,1.gz
> input-factor=0,1 output-factor=0,1
> FeatureFunction: TranslationModel0 start: 3 end: 6
> line=Generation name=GenerationModel0 num-features=2
> path=/cygdrive/c/mosesdecoder-master/try/ai/sep/fsmt/work/model/generation.0-1.gz
> input-factor=0 output-factor=1
> FeatureFunction: GenerationModel0 start: 7 end: 8
> line=Distortion
> FeatureFunction: Distortion0 start: 9 end: 9
> line=SRILM name=LM0 factor=0 path=/cygdrive/c order=5
> FeatureFunction: LM0 start: 10 end: 10
> line=SRILM name=LM1 factor=1 path=/cygdrive/c order=5
> FeatureFunction: LM1 start: 11 end: 11
> terminate called after throwing an instance of 'std::string'
> Aborted (core dumped)
>
>
>
> /*Marwa N. Refaie*/
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141007/fff9d52c/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 96, Issue 8
********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 96, Issue 8"
Post a Comment