Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Can't read binarised reordering-table (Marcin Junczys-Dowmunt)
2. Re: Can't read binarised reordering-table (Hokage Sama)
----------------------------------------------------------------------
Message: 1
Date: Wed, 08 Apr 2015 09:54:17 +0200
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Can't read binarised reordering-table
To: Hokage Sama <nvncbol@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <5524DEA9.3050302@amu.edu.pl>
Content-Type: text/plain; charset="utf-8"
hm, weird, that should work. Can you do "ls -lah" in the directory that
holds the reordering-table and post the result? Also please post your
ini file.
W dniu 08.04.2015 o 09:48, Hokage Sama pisze:
> Thanks for the prompt reply. However I'm still having the problem.
> Getting this now:
> Can't read /home/hilton/working/binarised-model/reordering-table
>
> I tried adding the extension to make it "reordering-table.minlexr",
> and I get this:
> Loading LexicalReordering0
> Loading table into memory...Exception: vector::_M_range_check
>
> On 8 April 2015 at 02:31, Marcin Junczys-Dowmunt <junczys@amu.edu.pl
> <mailto:junczys@amu.edu.pl>> wrote:
>
> Hi,
> replace "$HOME" with a real, absolute path.
> Best,
> Marcin
>
> W dniu 08.04.2015 o 09:23, Hokage Sama pisze:
>> Hello I've been following the Moses manual to create a Baseline
>> System but I am now stuck at the Testing section. I get a message
>> saying it can't read the reordering-table as shown below.
>> Appreciate any help thanks.
>>
>> $ ~/mosesdecoder/bin/moses -f ~/working/binarised-model/moses.ini
>> Defined parameters (per moses.ini or switch):
>> config: /home/hilton/working/binarised-model/moses.ini
>> distortion-limit: 6
>> feature: UnknownWordPenalty WordPenalty PhrasePenalty
>> PhraseDictionaryBinary name=TranslationModel0 num-features=4
>> path=$HOME/working/binarised-model/phrase-table input-factor=0
>> output-factor=0 LexicalReordering name=LexicalReordering0
>> num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0
>> output-factor=0
>> path=$HOME/working/binarised-model/reordering-table Distortion
>> KENLM lazyken=0 name=LM0 factor=0
>> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
>> input-factors: 0
>> mapping: 0 T 0
>> weight: LexicalReordering0= 0.07048 0.00134696 0.0375093
>> 0.0623156 0.00105617 0.0594233 Distortion0= 0.0693777 LM0=
>> 0.0598649 WordPenalty0= -0.221146 PhrasePenalty0= 0.22473
>> TranslationModel0= 0.0301386 0.0472199 0.0481032 0.067288
>> UnknownWordPenalty0= 1
>> line=UnknownWordPenalty
>> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
>> line=WordPenalty
>> FeatureFunction: WordPenalty0 start: 1 end: 1
>> line=PhrasePenalty
>> FeatureFunction: PhrasePenalty0 start: 2 end: 2
>> line=PhraseDictionaryBinary name=TranslationModel0 num-features=4
>> path=$HOME/working/binarised-model/phrase-table input-factor=0
>> output-factor=0
>> FeatureFunction: TranslationModel0 start: 3 end: 6
>> line=LexicalReordering name=LexicalReordering0 num-features=6
>> type=wbe-msd-bidirectional-fe-allff input-factor=0
>> output-factor=0 path=$HOME/working/binarised-model/reordering-table
>> FeatureFunction: LexicalReordering0 start: 7 end: 12
>> Initializing Lexical Reordering Feature..
>> line=Distortion
>> FeatureFunction: Distortion0 start: 13 end: 13
>> line=KENLM lazyken=0 name=LM0 factor=0
>> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
>> FeatureFunction: LM0 start: 14 end: 14
>> Loading UnknownWordPenalty0
>> Loading WordPenalty0
>> Loading PhrasePenalty0
>> Loading LexicalReordering0
>> Can't read $HOME/working/binarised-model/reordering-table
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150408/50368038/attachment-0001.htm
------------------------------
Message: 2
Date: Wed, 8 Apr 2015 03:03:15 -0500
From: Hokage Sama <nvncbol@gmail.com>
Subject: Re: [Moses-support] Can't read binarised reordering-table
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: moses-support@mit.edu
Message-ID:
<CAD3ogMagXmZKeKUH44PoGzHvt1kuSKDS-a96S93VbSJ3p4C_3A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
hilton@hilton-VirtualBox:~/working/binarised-model$ ls -lah
total 144M
drwxrwxr-x 2 hilton hilton 4.0K Apr 8 01:05 .
drwxrwxr-x 5 hilton hilton 4.0K Apr 5 18:51 ..
-rw-rw-r-- 1 hilton hilton 1.2K Apr 8 02:58 moses.ini
-rw-rw-r-- 1 hilton hilton 104M Apr 6 10:11 phrase-table.minphr
-rw-rw-r-- 1 hilton hilton 41M Apr 8 01:11 reordering-table.minlexr
moses.ini
# MERT optimized configuration
# decoder /home/hilton/mosesdecoder/bin/moses
# BLEU 0.15756 on dev /home/hilton/corpus/news-test2008.true.fr
# We were before running iteration 8
# finished Thu Apr 2 11:12:01 EST 2015
### MOSES CONFIG FILE ###
#########################
# input factors
[input-factors]
0
# mapping steps
[mapping]
0 T 0
[distortion-limit]
6
# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryBinary name=TranslationModel0 num-features=4
path=$HOME/working/binarised-model/phrase-table input-factor=0
output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/hilton/working/binarised-model/reordering-table
Distortion
KENLM lazyken=0 name=LM0 factor=0
path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
# dense weights for feature functions
[weight]
LexicalReordering0= 0.07048 0.00134696 0.0375093 0.0623156 0.00105617
0.0594233
Distortion0= 0.0693777
LM0= 0.0598649
WordPenalty0= -0.221146
PhrasePenalty0= 0.22473
TranslationModel0= 0.0301386 0.0472199 0.0481032 0.067288
UnknownWordPenalty0= 1
On 8 April 2015 at 02:54, Marcin Junczys-Dowmunt <junczys@amu.edu.pl> wrote:
> hm, weird, that should work. Can you do "ls -lah" in the directory that
> holds the reordering-table and post the result? Also please post your ini
> file.
>
> W dniu 08.04.2015 o 09:48, Hokage Sama pisze:
>
> Thanks for the prompt reply. However I'm still having the problem. Getting
> this now:
> Can't read /home/hilton/working/binarised-model/reordering-table
>
> I tried adding the extension to make it "reordering-table.minlexr", and
> I get this:
> Loading LexicalReordering0
> Loading table into memory...Exception: vector::_M_range_check
>
> On 8 April 2015 at 02:31, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
> wrote:
>
>> Hi,
>> replace "$HOME" with a real, absolute path.
>> Best,
>> Marcin
>>
>> W dniu 08.04.2015 o 09:23, Hokage Sama pisze:
>>
>> Hello I've been following the Moses manual to create a Baseline System
>> but I am now stuck at the Testing section. I get a message saying it can't
>> read the reordering-table as shown below. Appreciate any help thanks.
>>
>> $ ~/mosesdecoder/bin/moses -f ~/working/binarised-model/moses.ini
>> Defined parameters (per moses.ini or switch):
>> config: /home/hilton/working/binarised-model/moses.ini
>> distortion-limit: 6
>> feature: UnknownWordPenalty WordPenalty PhrasePenalty
>> PhraseDictionaryBinary name=TranslationModel0 num-features=4
>> path=$HOME/working/binarised-model/phrase-table input-factor=0
>> output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6
>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>> path=$HOME/working/binarised-model/reordering-table Distortion KENLM
>> lazyken=0 name=LM0 factor=0
>> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
>> input-factors: 0
>> mapping: 0 T 0
>> weight: LexicalReordering0= 0.07048 0.00134696 0.0375093 0.0623156
>> 0.00105617 0.0594233 Distortion0= 0.0693777 LM0= 0.0598649 WordPenalty0=
>> -0.221146 PhrasePenalty0= 0.22473 TranslationModel0= 0.0301386 0.0472199
>> 0.0481032 0.067288 UnknownWordPenalty0= 1
>> line=UnknownWordPenalty
>> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
>> line=WordPenalty
>> FeatureFunction: WordPenalty0 start: 1 end: 1
>> line=PhrasePenalty
>> FeatureFunction: PhrasePenalty0 start: 2 end: 2
>> line=PhraseDictionaryBinary name=TranslationModel0 num-features=4
>> path=$HOME/working/binarised-model/phrase-table input-factor=0
>> output-factor=0
>> FeatureFunction: TranslationModel0 start: 3 end: 6
>> line=LexicalReordering name=LexicalReordering0 num-features=6
>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>> path=$HOME/working/binarised-model/reordering-table
>> FeatureFunction: LexicalReordering0 start: 7 end: 12
>> Initializing Lexical Reordering Feature..
>> line=Distortion
>> FeatureFunction: Distortion0 start: 13 end: 13
>> line=KENLM lazyken=0 name=LM0 factor=0
>> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
>> FeatureFunction: LM0 start: 14 end: 14
>> Loading UnknownWordPenalty0
>> Loading WordPenalty0
>> Loading PhrasePenalty0
>> Loading LexicalReordering0
>> Can't read $HOME/working/binarised-model/reordering-table
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150408/e46bb468/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 102, Issue 9
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 102, Issue 9"
Post a Comment