Home » Uncategories » Moses-support Digest, Vol 104, Issue 7

Moses-support Digest, Vol 104, Issue 7

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Can't read reordering table (Marcin Junczys-Dowmunt)
2. Re: Can't read reordering table (Hamed Soleimani)


----------------------------------------------------------------------

Message: 1
Date: Wed, 03 Jun 2015 16:27:42 +0200
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Can't read reordering table
To: Hamed Soleimani <hamed1soleimani@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <f7c29e207670512e31454eb65253da1c@amu.edu.pl>
Content-Type: text/plain; charset="utf-8"



Hi,

two things to try:

recompile with the -a option, so everything get rebuilt properly.

If that does not work, post the contents of your model folder with

ls -lah /home/hamed1soleimani/working/v1.2/binarised-model/

Best,

Marcin

W dniu 2015-06-03 16:21, Hamed Soleimani napisa?(a):

> Hi all,
>
> My baseline translation systems was working great, but yesterday as i updated and compiled mosesdecoder source code again and switched from giza to mgiza I couldn't translate any sentence anymore. I lookup recent commits in github but i didn't find anything related to my problem.
>
> This is result of decoder:
>
> [hamed1soleimani@hamed1soleimani ~]$ mosesdecoder/bin/moses -f working/v1.2/binarised-model/moses.ini
> Defined parameters (per moses.ini or switch):
> config: working/v1.2/binarised-model/moses.ini
> distortion-limit: 6
> feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryCompact name=TranslationModel0 num-features=4 path=/home/hamed1soleimani/working/v1.2/binarised-model/phrase-table input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/home/hamed1soleimani/working/v1.2/binarised-model/reordering-table Distortion KENLM lazyken=0 name=LM0 factor=0 path=/home/hamed1soleimani/lm/v1.2/mizan.final.blm.en order=3
> input-factors: 0
> mapping: 0 T 0
> threads: 4
> weight: LexicalReordering0= 0.0605259 0.0381224 0.183614 0.0646507 0.0559396 0.0463035 Distortion0= 0.0353544 LM0= 0.0781512 WordPenalty0= -0.17106 PhrasePenalty0= 0.0882376 TranslationModel0= 0.0128144 0.0528043 0.0662476 0.0461745 UnknownWordPenalty0= 1
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 1
> line=PhrasePenalty
> FeatureFunction: PhrasePenalty0 start: 2 end: 2
> line=PhraseDictionaryCompact name=TranslationModel0 num-features=4 path=/home/hamed1soleimani/working/v1.2/binarised-model/phrase-table input-factor=0 output-factor=0
> FeatureFunction: TranslationModel0 start: 3 end: 6
> line=LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/home/hamed1soleimani/working/v1.2/binarised-model/reordering-table
> FeatureFunction: LexicalReordering0 start: 7 end: 12
> Initializing Lexical Reordering Feature..
> line=Distortion
> FeatureFunction: Distortion0 start: 13 end: 13
> line=KENLM lazyken=0 name=LM0 factor=0 path=/home/hamed1soleimani/lm/v1.2/mizan.final.blm.en order=3
> FeatureFunction: LM0 start: 14 end: 14
> Loading UnknownWordPenalty0
> Loading WordPenalty0
> Loading PhrasePenalty0
> Loading LexicalReordering0
> Can't read /home/hamed1soleimani/working/v1.2/binarised-model/reordering-table
>
> my moses.ini file is:
>
> # MERT optimized configuration
> # decoder /home/hamed1soleimani/mosesdecoder/bin/moses
> # BLEU 0.0653349 on dev /home/hamed1soleimani/corpus/v1.2/mizan.sample.tun.true.fa
> # We were before running iteration 9
> # finished Wed Jun 3 16:08:23 IRDT 2015
> ### MOSES CONFIG FILE ###
> #########################
>
> # input factors
> [input-factors]
> 0
>
> # mapping steps
> [mapping]
> 0 T 0
>
> [distortion-limit]
> 6
>
> # feature functions
> [feature]
> UnknownWordPenalty
> WordPenalty
> PhrasePenalty
> PhraseDictionaryCompact name=TranslationModel0 num-features=4 path=/home/hamed1soleimani/working/v1.2/binarised-model/phrase-table input-factor=0 output-factor=0
> LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/home/hamed1soleimani/working/v1.2/binarised-model/reordering-table
> Distortion
> KENLM lazyken=0 name=LM0 factor=0 path=/home/hamed1soleimani/lm/v1.2/mizan.final.blm.en order=3
>
> # dense weights for feature functions
>
> [threads]
> 4
> [weight]
>
> LexicalReordering0= 0.0605259 0.0381224 0.183614 0.0646507 0.0559396 0.0463035
> Distortion0= 0.0353544
> LM0= 0.0781512
> WordPenalty0= -0.17106
> PhrasePenalty0= 0.0882376
> TranslationModel0= 0.0128144 0.0528043 0.0662476 0.0461745
> UnknownWordPenalty0= 1
>
> Best regards,
> Hamed
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support [1]



Links:
------
[1] http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150603/a8944cad/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 03 Jun 2015 14:54:54 +0000
From: Hamed Soleimani <hamed1soleimani@gmail.com>
Subject: Re: [Moses-support] Can't read reordering table
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: moses-support@mit.edu
Message-ID:
<CAMH7RonLB7+f-9jniFNMHY1uB1HJQF2mrseFKKjtasfcKeP2fw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

As i recompiled it with -a flag it works again.
Thanks a lot

On Wed, Jun 3, 2015 at 6:57 PM Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
wrote:

> Hi,
>
> two things to try:
>
> recompile with the -a option, so everything get rebuilt properly.
>
> If that does not work, post the contents of your model folder with
>
> ls -lah /home/hamed1soleimani/working/v1.2/binarised-model/
>
> Best,
>
> Marcin
>
> W dniu 2015-06-03 16:21, Hamed Soleimani napisa?(a):
>
>
> Hi all,
>
> My baseline translation systems was working great, but yesterday as i
> updated and compiled mosesdecoder source code again and switched from giza
> to mgiza I couldn't translate any sentence anymore. I lookup recent commits
> in github but i didn't find anything related to my problem.
>
> This is result of decoder:
>
> [hamed1soleimani@hamed1soleimani ~]$ mosesdecoder/bin/moses -f
> working/v1.2/binarised-model/moses.ini
> Defined parameters (per moses.ini or switch):
> config: working/v1.2/binarised-model/moses.ini
> distortion-limit: 6
> feature: UnknownWordPenalty WordPenalty PhrasePenalty
> PhraseDictionaryCompact name=TranslationModel0 num-features=4
> path=/home/hamed1soleimani/working/v1.2/binarised-model/phrase-table
> input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0
> num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0
> output-factor=0
> path=/home/hamed1soleimani/working/v1.2/binarised-model/reordering-table
> Distortion KENLM lazyken=0 name=LM0 factor=0
> path=/home/hamed1soleimani/lm/v1.2/mizan.final.blm.en order=3
> input-factors: 0
> mapping: 0 T 0
> threads: 4
> weight: LexicalReordering0= 0.0605259 0.0381224 0.183614 0.0646507
> 0.0559396 0.0463035 Distortion0= 0.0353544 LM0= 0.0781512 WordPenalty0=
> -0.17106 PhrasePenalty0= 0.0882376 TranslationModel0= 0.0128144 0.0528043
> 0.0662476 0.0461745 UnknownWordPenalty0= 1
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 1
> line=PhrasePenalty
> FeatureFunction: PhrasePenalty0 start: 2 end: 2
> line=PhraseDictionaryCompact name=TranslationModel0 num-features=4
> path=/home/hamed1soleimani/working/v1.2/binarised-model/phrase-table
> input-factor=0 output-factor=0
> FeatureFunction: TranslationModel0 start: 3 end: 6
> line=LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/hamed1soleimani/working/v1.2/binarised-model/reordering-table
> FeatureFunction: LexicalReordering0 start: 7 end: 12
> Initializing Lexical Reordering Feature..
> line=Distortion
> FeatureFunction: Distortion0 start: 13 end: 13
> line=KENLM lazyken=0 name=LM0 factor=0
> path=/home/hamed1soleimani/lm/v1.2/mizan.final.blm.en order=3
> FeatureFunction: LM0 start: 14 end: 14
> Loading UnknownWordPenalty0
> Loading WordPenalty0
> Loading PhrasePenalty0
> Loading LexicalReordering0
> Can't read
> /home/hamed1soleimani/working/v1.2/binarised-model/reordering-table
>
>
>
> my moses.ini file is:
>
> # MERT optimized configuration
> # decoder /home/hamed1soleimani/mosesdecoder/bin/moses
> # BLEU 0.0653349 on dev
> /home/hamed1soleimani/corpus/v1.2/mizan.sample.tun.true.fa
> # We were before running iteration 9
> # finished Wed Jun 3 16:08:23 IRDT 2015
> ### MOSES CONFIG FILE ###
> #########################
>
> # input factors
> [input-factors]
> 0
>
> # mapping steps
> [mapping]
> 0 T 0
>
> [distortion-limit]
> 6
>
> # feature functions
> [feature]
> UnknownWordPenalty
> WordPenalty
> PhrasePenalty
> PhraseDictionaryCompact name=TranslationModel0 num-features=4
> path=/home/hamed1soleimani/working/v1.2/binarised-model/phrase-table
> input-factor=0 output-factor=0
> LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/hamed1soleimani/working/v1.2/binarised-model/reordering-table
> Distortion
> KENLM lazyken=0 name=LM0 factor=0
> path=/home/hamed1soleimani/lm/v1.2/mizan.final.blm.en order=3
>
> # dense weights for feature functions
>
> [threads]
> 4
> [weight]
>
> LexicalReordering0= 0.0605259 0.0381224 0.183614 0.0646507 0.0559396
> 0.0463035
> Distortion0= 0.0353544
> LM0= 0.0781512
> WordPenalty0= -0.17106
> PhrasePenalty0= 0.0882376
> TranslationModel0= 0.0128144 0.0528043 0.0662476 0.0461745
> UnknownWordPenalty0= 1
>
> Best regards,
> Hamed
>
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150603/b9ab5b88/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 104, Issue 7
*********************************************

0 Response to "Moses-support Digest, Vol 104, Issue 7"

Post a Comment

Subscribe to: Post Comments (Atom)