Moses-support Digest, Vol 105, Issue 22

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Fwd: Problem Reading binarised model :: ttable does not exit
(ASHOK KUMAR YADAV)
2. Re: Fwd: Problem Reading binarised model :: ttable does not
exit (Arezki Sadoune)


----------------------------------------------------------------------

Message: 1
Date: Thu, 9 Jul 2015 18:17:35 +0530
From: ASHOK KUMAR YADAV <ashokkumariitm@gmail.com>
Subject: [Moses-support] Fwd: Problem Reading binarised model ::
ttable does not exit
To: moses-support@mit.edu
Message-ID:
<CABUoAMtMH2Q2bWAXk5uj84ncvz_WPo3r0DsmQkjwxfBRq=cn6w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi
i am facing problem while reading *Reading binarised model* please help me
out of this problem.

i will explain my step :

for Phrase model
Step 1 : ~/working$ ~/mosesdecoder-RELEASE-3.0/bin/processPhraseTableMin
-in train/model/phrase-table.gz -nscores 4 -out binarised-model/phrase-table

For Reordering model
Step 2: ~/mosesdecoder-RELEASE-3.0/bin/processLexicalTable -in
train/model/reordering-table.wbe-msd-bidirectional-fe.gz -out
binarised-model/reordering-table

Step 3 : Change in moses.ini file
Change PhraseDictionaryMemory to PhraseDictionaryBinary

Set the path of the PhraseDictionary feature to point to
/home/working/binarised-model/phrase-table

Set the path of the LexicalReordering feature to point to
/home/working/binarised-model/reordering-table

Step 4 Testing Translation

working$ echo "The house was built in 14th century" |
~/mosesdecoder-RELEASE-3.0/bin/moses -f
/home/working/binarised-model/moses.ini
Defined parameters (per moses.ini or switch):
config: /home/working/binarised-model/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryBinary name=TranslationModel0 num-features=4
path=/home/working/binarised-model/phrase-table.minphr input-factor=0
output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/working/binarised-model/reordering-table.* Distortion KENLM
lazyken=0 name=LM0 factor=0 path=/home/lm/test.en-hi.blm.hi order=3
input-factors: 0
mapping: 0 T 0
weight: LexicalReordering0= 0.0639361 0.0474959 0.0356438 0.0306086
0.0167372 0.0750312 Distortion0= 0.0116104 LM0= 0.0314945 WordPenalty0=
-0.109872 PhrasePenalty0= -0.22791 TranslationModel0= 0.0253477 0.00221282
0.311753 -0.0103464 UnknownWordPenalty0= 1
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryBinary name=TranslationModel0 num-features=4
path=/home/working/binarised-model/phrase-table.minphr input-factor=0
output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/working/binarised-model/reordering-table.*
FeatureFunction: LexicalReordering0 start: 7 end: 12
Initializing LexicalReordering..
line=Distortion
FeatureFunction: Distortion0 start: 13 end: 13
line=KENLM lazyken=0 name=LM0 factor=0 path=/home/lm/test.en-hi.blm.hi
order=3
FeatureFunction: LM0 start: 14 end: 14
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
binary file loaded, default OFF_T: -1
Loading Distortion0
Loading LM0
Loading TranslationModel0
Created input-output object : [0.011] seconds
Translating: The house was built in 14th century
terminate called after throwing an instance of 'util::Exception'
what(): moses/PDTAimp.cpp:173 in void Moses::PDTAimp::Create(const
std::vector<long unsigned int>&, const std::vector<long unsigned int>&,
const string&, const std::vector<float>&) threw util::Exception'.
bin ttable does not exist
Aborted (core dumped)


How to solve this problem


Thanks & Regards

Ashok Kumar Yadav
Mechanical engineering (Dual Degree)
4th year Undergraduate Student
Indian Institute Of Technology Madras
Chennai 600036
Mob:9043429762
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150709/fa0327b8/attachment-0001.htm

------------------------------

Message: 2
Date: Sat, 11 Jul 2015 10:45:01 +0000 (UTC)
From: Arezki Sadoune <arezkisadoune@yahoo.fr>
Subject: Re: [Moses-support] Fwd: Problem Reading binarised model ::
ttable does not exit
To: ASHOK KUMAR YADAV <ashokkumariitm@gmail.com>,
"moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<1047604380.293332.1436611501698.JavaMail.yahoo@mail.yahoo.com>
Content-Type: text/plain; charset="utf-8"

HiYou are using?processPhraseTableMinIn the step-3, You should rename by ?PhraseDictionaryCompact instead of?PhraseDictionaryMemoryI hope this helps

Arezki SADOUNE De?: ASHOK KUMAR YADAV <ashokkumariitm@gmail.com>
??: moses-support@mit.edu
Envoy? le : Jeudi 9 juillet 2015 14h47
Objet?: [Moses-support] Fwd: Problem Reading binarised model :: ttable does not exit

Hi
i am facing problem while reading Reading binarised model please help me out of this problem.

i will explain my step :

for Phrase model
Step 1 : ~/working$ ~/mosesdecoder-RELEASE-3.0/bin/processPhraseTableMin -in train/model/phrase-table.gz -nscores 4 -out binarised-model/phrase-table

For Reordering model
Step 2: ~/mosesdecoder-RELEASE-3.0/bin/processLexicalTable -in train/model/reordering-table.wbe-msd-bidirectional-fe.gz -out binarised-model/reordering-table

Step 3 : Change in moses.ini file
Change PhraseDictionaryMemory to PhraseDictionaryBinary

Set the path of the PhraseDictionary feature to point to /home/working/binarised-model/phrase-table

Set the path of the LexicalReordering feature to point to /home/working/binarised-model/reordering-table

Step 4 Testing Translation

working$ echo "The house was built in 14th century" | ~/mosesdecoder-RELEASE-3.0/bin/moses -f /home/working/binarised-model/moses.ini
Defined parameters (per moses.ini or switch):
??? config: /home/working/binarised-model/moses.ini
??? distortion-limit: 6
??? feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryBinary name=TranslationModel0 num-features=4 path=/home/working/binarised-model/phrase-table.minphr input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/home/working/binarised-model/reordering-table.* Distortion KENLM lazyken=0 name=LM0 factor=0 path=/home/lm/test.en-hi.blm.hi order=3
??? input-factors: 0
??? mapping: 0 T 0
??? weight: LexicalReordering0= 0.0639361 0.0474959 0.0356438 0.0306086 0.0167372 0.0750312 Distortion0= 0.0116104 LM0= 0.0314945 WordPenalty0= -0.109872 PhrasePenalty0= -0.22791 TranslationModel0= 0.0253477 0.00221282 0.311753 -0.0103464 UnknownWordPenalty0= 1
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryBinary name=TranslationModel0 num-features=4 path=/home/working/binarised-model/phrase-table.minphr input-factor=0 output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/home/working/binarised-model/reordering-table.*
FeatureFunction: LexicalReordering0 start: 7 end: 12
Initializing LexicalReordering..
line=Distortion
FeatureFunction: Distortion0 start: 13 end: 13
line=KENLM lazyken=0 name=LM0 factor=0 path=/home/lm/test.en-hi.blm.hi order=3
FeatureFunction: LM0 start: 14 end: 14
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
binary file loaded, default OFF_T: -1
Loading Distortion0
Loading LM0
Loading TranslationModel0
Created input-output object : [0.011] seconds
Translating: The house was built in 14th century
terminate called after throwing an instance of 'util::Exception'
? what():? moses/PDTAimp.cpp:173 in void Moses::PDTAimp::Create(const std::vector<long unsigned int>&, const std::vector<long unsigned int>&, const string&, const std::vector<float>&) threw util::Exception'.
bin ttable does not exist
Aborted (core dumped)
?

How to solve this problem


Thanks & Regards

Ashok Kumar YadavMechanical engineering (Dual Degree)4th year?Undergraduate Student??Indian Institute Of Technology MadrasChennai 600036Mob:9043429762

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support



-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150711/fc3298f2/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 105, Issue 22
**********************************************

Tweet