Moses-support Digest, Vol 102, Issue 8

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Can't read binarised reordering-table (Hokage Sama)
2. Re: Can't read binarised reordering-table (Marcin Junczys-Dowmunt)
3. Re: Can't read binarised reordering-table (Hokage Sama)


----------------------------------------------------------------------

Message: 1
Date: Wed, 8 Apr 2015 02:23:52 -0500
From: Hokage Sama <nvncbol@gmail.com>
Subject: [Moses-support] Can't read binarised reordering-table
To: moses-support@mit.edu
Message-ID:
<CAD3ogManKLc9ZUXRD7MQ4=V4K5Md1rjpBy9KYLLp+xdXTQBmsg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello I've been following the Moses manual to create a Baseline System but
I am now stuck at the Testing section. I get a message saying it can't read
the reordering-table as shown below. Appreciate any help thanks.

$ ~/mosesdecoder/bin/moses -f ~/working/binarised-model/moses.ini
Defined parameters (per moses.ini or switch):
config: /home/hilton/working/binarised-model/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryBinary name=TranslationModel0 num-features=4
path=$HOME/working/binarised-model/phrase-table input-factor=0
output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=$HOME/working/binarised-model/reordering-table Distortion KENLM
lazyken=0 name=LM0 factor=0
path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
input-factors: 0
mapping: 0 T 0
weight: LexicalReordering0= 0.07048 0.00134696 0.0375093 0.0623156
0.00105617 0.0594233 Distortion0= 0.0693777 LM0= 0.0598649 WordPenalty0=
-0.221146 PhrasePenalty0= 0.22473 TranslationModel0= 0.0301386 0.0472199
0.0481032 0.067288 UnknownWordPenalty0= 1
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryBinary name=TranslationModel0 num-features=4
path=$HOME/working/binarised-model/phrase-table input-factor=0
output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=$HOME/working/binarised-model/reordering-table
FeatureFunction: LexicalReordering0 start: 7 end: 12
Initializing Lexical Reordering Feature..
line=Distortion
FeatureFunction: Distortion0 start: 13 end: 13
line=KENLM lazyken=0 name=LM0 factor=0
path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
FeatureFunction: LM0 start: 14 end: 14
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Can't read $HOME/working/binarised-model/reordering-table
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150408/d3a5789d/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 08 Apr 2015 09:31:24 +0200
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Can't read binarised reordering-table
To: moses-support@mit.edu
Message-ID: <5524D94C.5080503@amu.edu.pl>
Content-Type: text/plain; charset="windows-1252"

Hi,
replace "$HOME" with a real, absolute path.
Best,
Marcin

W dniu 08.04.2015 o 09:23, Hokage Sama pisze:
> Hello I've been following the Moses manual to create a Baseline System
> but I am now stuck at the Testing section. I get a message saying it
> can't read the reordering-table as shown below. Appreciate any help
> thanks.
>
> $ ~/mosesdecoder/bin/moses -f ~/working/binarised-model/moses.ini
> Defined parameters (per moses.ini or switch):
> config: /home/hilton/working/binarised-model/moses.ini
> distortion-limit: 6
> feature: UnknownWordPenalty WordPenalty PhrasePenalty
> PhraseDictionaryBinary name=TranslationModel0 num-features=4
> path=$HOME/working/binarised-model/phrase-table input-factor=0
> output-factor=0 LexicalReordering name=LexicalReordering0
> num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0
> output-factor=0 path=$HOME/working/binarised-model/reordering-table
> Distortion KENLM lazyken=0 name=LM0 factor=0
> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
> input-factors: 0
> mapping: 0 T 0
> weight: LexicalReordering0= 0.07048 0.00134696 0.0375093 0.0623156
> 0.00105617 0.0594233 Distortion0= 0.0693777 LM0= 0.0598649
> WordPenalty0= -0.221146 PhrasePenalty0= 0.22473 TranslationModel0=
> 0.0301386 0.0472199 0.0481032 0.067288 UnknownWordPenalty0= 1
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 1
> line=PhrasePenalty
> FeatureFunction: PhrasePenalty0 start: 2 end: 2
> line=PhraseDictionaryBinary name=TranslationModel0 num-features=4
> path=$HOME/working/binarised-model/phrase-table input-factor=0
> output-factor=0
> FeatureFunction: TranslationModel0 start: 3 end: 6
> line=LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=$HOME/working/binarised-model/reordering-table
> FeatureFunction: LexicalReordering0 start: 7 end: 12
> Initializing Lexical Reordering Feature..
> line=Distortion
> FeatureFunction: Distortion0 start: 13 end: 13
> line=KENLM lazyken=0 name=LM0 factor=0
> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
> FeatureFunction: LM0 start: 14 end: 14
> Loading UnknownWordPenalty0
> Loading WordPenalty0
> Loading PhrasePenalty0
> Loading LexicalReordering0
> Can't read $HOME/working/binarised-model/reordering-table
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150408/788a88ff/attachment-0001.htm

------------------------------

Message: 3
Date: Wed, 8 Apr 2015 02:48:55 -0500
From: Hokage Sama <nvncbol@gmail.com>
Subject: Re: [Moses-support] Can't read binarised reordering-table
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: moses-support@mit.edu
Message-ID:
<CAD3ogMZU-LPpRoNVEM-P5=o2t-VyAiCWsq-ZYpuS80+7H1M2tQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thanks for the prompt reply. However I'm still having the problem. Getting
this now:
Can't read /home/hilton/working/binarised-model/reordering-table

I tried adding the extension to make it "reordering-table.minlexr", and I
get this:
Loading LexicalReordering0
Loading table into memory...Exception: vector::_M_range_check

On 8 April 2015 at 02:31, Marcin Junczys-Dowmunt <junczys@amu.edu.pl> wrote:

> Hi,
> replace "$HOME" with a real, absolute path.
> Best,
> Marcin
>
> W dniu 08.04.2015 o 09:23, Hokage Sama pisze:
>
> Hello I've been following the Moses manual to create a Baseline System
> but I am now stuck at the Testing section. I get a message saying it can't
> read the reordering-table as shown below. Appreciate any help thanks.
>
> $ ~/mosesdecoder/bin/moses -f ~/working/binarised-model/moses.ini
> Defined parameters (per moses.ini or switch):
> config: /home/hilton/working/binarised-model/moses.ini
> distortion-limit: 6
> feature: UnknownWordPenalty WordPenalty PhrasePenalty
> PhraseDictionaryBinary name=TranslationModel0 num-features=4
> path=$HOME/working/binarised-model/phrase-table input-factor=0
> output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=$HOME/working/binarised-model/reordering-table Distortion KENLM
> lazyken=0 name=LM0 factor=0
> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
> input-factors: 0
> mapping: 0 T 0
> weight: LexicalReordering0= 0.07048 0.00134696 0.0375093 0.0623156
> 0.00105617 0.0594233 Distortion0= 0.0693777 LM0= 0.0598649 WordPenalty0=
> -0.221146 PhrasePenalty0= 0.22473 TranslationModel0= 0.0301386 0.0472199
> 0.0481032 0.067288 UnknownWordPenalty0= 1
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 1
> line=PhrasePenalty
> FeatureFunction: PhrasePenalty0 start: 2 end: 2
> line=PhraseDictionaryBinary name=TranslationModel0 num-features=4
> path=$HOME/working/binarised-model/phrase-table input-factor=0
> output-factor=0
> FeatureFunction: TranslationModel0 start: 3 end: 6
> line=LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=$HOME/working/binarised-model/reordering-table
> FeatureFunction: LexicalReordering0 start: 7 end: 12
> Initializing Lexical Reordering Feature..
> line=Distortion
> FeatureFunction: Distortion0 start: 13 end: 13
> line=KENLM lazyken=0 name=LM0 factor=0
> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
> FeatureFunction: LM0 start: 14 end: 14
> Loading UnknownWordPenalty0
> Loading WordPenalty0
> Loading PhrasePenalty0
> Loading LexicalReordering0
> Can't read $HOME/working/binarised-model/reordering-table
>
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150408/4a1aaae4/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 102, Issue 8
*********************************************

Tweet