Home » Uncategories » Moses-support Digest, Vol 102, Issue 13

Moses-support Digest, Vol 102, Issue 13

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Can't read binarised reordering-table (Hokage Sama)
2. Re: Can't read binarised reordering-table (Hokage Sama)


----------------------------------------------------------------------

Message: 1
Date: Wed, 8 Apr 2015 03:36:53 -0500
From: Hokage Sama <nvncbol@gmail.com>
Subject: Re: [Moses-support] Can't read binarised reordering-table
To: Abdelfetah Boumerdas <aa_boumerdas@esi.dz>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAD3ogMbYUToem01StboomYf98fVZ0aTu-1bOZKZrig4zFg8oZQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Abdelfetah. Sorry but how do you sort the phrase table and reordering
table please?

On 8 April 2015 at 03:24, Abdelfetah Boumerdas <aa_boumerdas@esi.dz> wrote:

> Hello everyone
> Hokage Sama have you tried to sort your phrase table and reordering table
> before compacting them? I was having exactly the same problem as you, and
> when i sorted the two tables and comacted them i passed these errors and
> reached the step where you give the sentence you want to translate,
> although after that i got another error (segmentation fault which i don't
> know its cause yet).
>
> And also i'm using the moses V3.0 but when i change PhraseDictionaryBinary
> to PhraseDictionaryCompact (as it is recommeded to do in the most tutorials
> i found when googling the problem) i get an error that tels me
> "PhraseDictionaryCompact is not registred" so i left it
> PhraseDictionaryBinary instead.
>
> wish this helps you. Good luck.
> ?
>
> 2015-04-08 9:14 GMT+01:00 Hokage Sama <nvncbol@gmail.com>:
>
>> Appreciate the response. I get this now if I change it to
>> PhraseDictionaryCompact:
>>
>> line=PhraseDictionaryCompact name=TranslationModel0 num-features=4
>> path=/home/hilton/working/binarised-model/phrase-table input-factor=0
>> output-factor=0
>> Exception: moses/FF/Factory.cpp:331 in void
>> Moses::FeatureRegistry::Construct(const string&, const string&) threw
>> UnknownFeatureException because `i == registry_.end()'.
>> Feature name PhraseDictionaryCompact is not registered.
>>
>>
>> On 8 April 2015 at 03:07, Muhammad Danial Raza <
>> muhammad.danial.raza@gmail.com> wrote:
>>
>>> I faced the same issue earlier, when following Baseline System. I solved
>>> it by changing PhraseDictionaryBinary to PhraseDictionaryCompact. I
>>> remember reading somewhere that now moses.ini should contain
>>> PhraseDictionaryCompact instead of PhraseDictionaryBinary. The
>>> documentation has not been updated at Baseline System.
>>>
>>> P.S.: Sorry for not giving the actual link to the forum where I read it,
>>> it was a month ago when I faced this issue.
>>>
>>> Regards,
>>> Danial
>>>
>>> On Wed, Apr 8, 2015 at 12:54 PM, Marcin Junczys-Dowmunt <
>>> junczys@amu.edu.pl> wrote:
>>>
>>>> hm, weird, that should work. Can you do "ls -lah" in the directory
>>>> that holds the reordering-table and post the result? Also please post your
>>>> ini file.
>>>>
>>>> W dniu 08.04.2015 o 09:48, Hokage Sama pisze:
>>>>
>>>> Thanks for the prompt reply. However I'm still having the problem.
>>>> Getting this now:
>>>> Can't read /home/hilton/working/binarised-model/reordering-table
>>>>
>>>> I tried adding the extension to make it "reordering-table.minlexr",
>>>> and I get this:
>>>> Loading LexicalReordering0
>>>> Loading table into memory...Exception: vector::_M_range_check
>>>>
>>>> On 8 April 2015 at 02:31, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
>>>> wrote:
>>>>
>>>>> Hi,
>>>>> replace "$HOME" with a real, absolute path.
>>>>> Best,
>>>>> Marcin
>>>>>
>>>>> W dniu 08.04.2015 o 09:23, Hokage Sama pisze:
>>>>>
>>>>> Hello I've been following the Moses manual to create a Baseline
>>>>> System but I am now stuck at the Testing section. I get a message saying it
>>>>> can't read the reordering-table as shown below. Appreciate any help thanks.
>>>>>
>>>>> $ ~/mosesdecoder/bin/moses -f ~/working/binarised-model/moses.ini
>>>>> Defined parameters (per moses.ini or switch):
>>>>> config: /home/hilton/working/binarised-model/moses.ini
>>>>> distortion-limit: 6
>>>>> feature: UnknownWordPenalty WordPenalty PhrasePenalty
>>>>> PhraseDictionaryBinary name=TranslationModel0 num-features=4
>>>>> path=$HOME/working/binarised-model/phrase-table input-factor=0
>>>>> output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6
>>>>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>>>>> path=$HOME/working/binarised-model/reordering-table Distortion KENLM
>>>>> lazyken=0 name=LM0 factor=0
>>>>> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
>>>>> input-factors: 0
>>>>> mapping: 0 T 0
>>>>> weight: LexicalReordering0= 0.07048 0.00134696 0.0375093 0.0623156
>>>>> 0.00105617 0.0594233 Distortion0= 0.0693777 LM0= 0.0598649 WordPenalty0=
>>>>> -0.221146 PhrasePenalty0= 0.22473 TranslationModel0= 0.0301386 0.0472199
>>>>> 0.0481032 0.067288 UnknownWordPenalty0= 1
>>>>> line=UnknownWordPenalty
>>>>> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
>>>>> line=WordPenalty
>>>>> FeatureFunction: WordPenalty0 start: 1 end: 1
>>>>> line=PhrasePenalty
>>>>> FeatureFunction: PhrasePenalty0 start: 2 end: 2
>>>>> line=PhraseDictionaryBinary name=TranslationModel0 num-features=4
>>>>> path=$HOME/working/binarised-model/phrase-table input-factor=0
>>>>> output-factor=0
>>>>> FeatureFunction: TranslationModel0 start: 3 end: 6
>>>>> line=LexicalReordering name=LexicalReordering0 num-features=6
>>>>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>>>>> path=$HOME/working/binarised-model/reordering-table
>>>>> FeatureFunction: LexicalReordering0 start: 7 end: 12
>>>>> Initializing Lexical Reordering Feature..
>>>>> line=Distortion
>>>>> FeatureFunction: Distortion0 start: 13 end: 13
>>>>> line=KENLM lazyken=0 name=LM0 factor=0
>>>>> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
>>>>> FeatureFunction: LM0 start: 14 end: 14
>>>>> Loading UnknownWordPenalty0
>>>>> Loading WordPenalty0
>>>>> Loading PhrasePenalty0
>>>>> Loading LexicalReordering0
>>>>> Can't read $HOME/working/binarised-model/reordering-table
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> BOUMERDAS Abdelfetah
> 5?me Ann?e Option Syst?mes Informatiques (SIQ)
> Ecole nationale Sup?rieure d'Informatique ESI (ex INI)
> BP 68 M Oued Smar 16309 - ALGER
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150408/67fe6b9c/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 8 Apr 2015 03:39:41 -0500
From: Hokage Sama <nvncbol@gmail.com>
Subject: Re: [Moses-support] Can't read binarised reordering-table
To: Muhammad Danial Raza <muhammad.danial.raza@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAD3ogMY_Ec1oVoXOGH1xDqH+6D7XsVNLZ7Oikc=LNmmREL4QDw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thanks for your help.

Regards

On 8 April 2015 at 03:31, Muhammad Danial Raza <
muhammad.danial.raza@gmail.com> wrote:

> Then, I guess someone with more hands-on experience on moses might be able
> to help you.
>
> Regards,
> Danial
>
> On Wed, Apr 8, 2015 at 1:27 PM, Hokage Sama <nvncbol@gmail.com> wrote:
>
>> No they are in separate folders:
>> binarised: working/binarised-model/
>> non-binarised: working/train/model/
>>
>> On 8 April 2015 at 03:23, Muhammad Danial Raza <
>> muhammad.danial.raza@gmail.com> wrote:
>>
>>> Are the binarised models and non-binarised models in the same folder?
>>>
>>> On Wed, Apr 8, 2015 at 1:14 PM, Hokage Sama <nvncbol@gmail.com> wrote:
>>>
>>>> Appreciate the response. I get this now if I change it to
>>>> PhraseDictionaryCompact:
>>>>
>>>> line=PhraseDictionaryCompact name=TranslationModel0 num-features=4
>>>> path=/home/hilton/working/binarised-model/phrase-table input-factor=0
>>>> output-factor=0
>>>> Exception: moses/FF/Factory.cpp:331 in void
>>>> Moses::FeatureRegistry::Construct(const string&, const string&) threw
>>>> UnknownFeatureException because `i == registry_.end()'.
>>>> Feature name PhraseDictionaryCompact is not registered.
>>>>
>>>>
>>>> On 8 April 2015 at 03:07, Muhammad Danial Raza <
>>>> muhammad.danial.raza@gmail.com> wrote:
>>>>
>>>>> I faced the same issue earlier, when following Baseline System. I
>>>>> solved it by changing PhraseDictionaryBinary to PhraseDictionaryCompact. I
>>>>> remember reading somewhere that now moses.ini should contain
>>>>> PhraseDictionaryCompact instead of PhraseDictionaryBinary. The
>>>>> documentation has not been updated at Baseline System.
>>>>>
>>>>> P.S.: Sorry for not giving the actual link to the forum where I read
>>>>> it, it was a month ago when I faced this issue.
>>>>>
>>>>> Regards,
>>>>> Danial
>>>>>
>>>>> On Wed, Apr 8, 2015 at 12:54 PM, Marcin Junczys-Dowmunt <
>>>>> junczys@amu.edu.pl> wrote:
>>>>>
>>>>>> hm, weird, that should work. Can you do "ls -lah" in the directory
>>>>>> that holds the reordering-table and post the result? Also please post your
>>>>>> ini file.
>>>>>>
>>>>>> W dniu 08.04.2015 o 09:48, Hokage Sama pisze:
>>>>>>
>>>>>> Thanks for the prompt reply. However I'm still having the problem.
>>>>>> Getting this now:
>>>>>> Can't read /home/hilton/working/binarised-model/reordering-table
>>>>>>
>>>>>> I tried adding the extension to make it "reordering-table.minlexr",
>>>>>> and I get this:
>>>>>> Loading LexicalReordering0
>>>>>> Loading table into memory...Exception: vector::_M_range_check
>>>>>>
>>>>>> On 8 April 2015 at 02:31, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>> replace "$HOME" with a real, absolute path.
>>>>>>> Best,
>>>>>>> Marcin
>>>>>>>
>>>>>>> W dniu 08.04.2015 o 09:23, Hokage Sama pisze:
>>>>>>>
>>>>>>> Hello I've been following the Moses manual to create a Baseline
>>>>>>> System but I am now stuck at the Testing section. I get a message saying it
>>>>>>> can't read the reordering-table as shown below. Appreciate any help thanks.
>>>>>>>
>>>>>>> $ ~/mosesdecoder/bin/moses -f ~/working/binarised-model/moses.ini
>>>>>>> Defined parameters (per moses.ini or switch):
>>>>>>> config: /home/hilton/working/binarised-model/moses.ini
>>>>>>> distortion-limit: 6
>>>>>>> feature: UnknownWordPenalty WordPenalty PhrasePenalty
>>>>>>> PhraseDictionaryBinary name=TranslationModel0 num-features=4
>>>>>>> path=$HOME/working/binarised-model/phrase-table input-factor=0
>>>>>>> output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6
>>>>>>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>>>>>>> path=$HOME/working/binarised-model/reordering-table Distortion KENLM
>>>>>>> lazyken=0 name=LM0 factor=0
>>>>>>> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
>>>>>>> input-factors: 0
>>>>>>> mapping: 0 T 0
>>>>>>> weight: LexicalReordering0= 0.07048 0.00134696 0.0375093 0.0623156
>>>>>>> 0.00105617 0.0594233 Distortion0= 0.0693777 LM0= 0.0598649 WordPenalty0=
>>>>>>> -0.221146 PhrasePenalty0= 0.22473 TranslationModel0= 0.0301386 0.0472199
>>>>>>> 0.0481032 0.067288 UnknownWordPenalty0= 1
>>>>>>> line=UnknownWordPenalty
>>>>>>> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
>>>>>>> line=WordPenalty
>>>>>>> FeatureFunction: WordPenalty0 start: 1 end: 1
>>>>>>> line=PhrasePenalty
>>>>>>> FeatureFunction: PhrasePenalty0 start: 2 end: 2
>>>>>>> line=PhraseDictionaryBinary name=TranslationModel0 num-features=4
>>>>>>> path=$HOME/working/binarised-model/phrase-table input-factor=0
>>>>>>> output-factor=0
>>>>>>> FeatureFunction: TranslationModel0 start: 3 end: 6
>>>>>>> line=LexicalReordering name=LexicalReordering0 num-features=6
>>>>>>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>>>>>>> path=$HOME/working/binarised-model/reordering-table
>>>>>>> FeatureFunction: LexicalReordering0 start: 7 end: 12
>>>>>>> Initializing Lexical Reordering Feature..
>>>>>>> line=Distortion
>>>>>>> FeatureFunction: Distortion0 start: 13 end: 13
>>>>>>> line=KENLM lazyken=0 name=LM0 factor=0
>>>>>>> path=/home/hilton/lm/news-commentary-v8.fr-en.blm.en order=3
>>>>>>> FeatureFunction: LM0 start: 14 end: 14
>>>>>>> Loading UnknownWordPenalty0
>>>>>>> Loading WordPenalty0
>>>>>>> Loading PhrasePenalty0
>>>>>>> Loading LexicalReordering0
>>>>>>> Can't read $HOME/working/binarised-model/reordering-table
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Moses-support mailing list
>>>>>>> Moses-support@mit.edu
>>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Moses-support mailing list
>>>>>> Moses-support@mit.edu
>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150408/d41a527b/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 102, Issue 13
**********************************************

0 Response to "Moses-support Digest, Vol 102, Issue 13"

Post a Comment

Subscribe to: Post Comments (Atom)