Moses-support Digest, Vol 121, Issue 21

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Can not run with PhraseDictionaryCompact. Bus error
(TRAN, Chien Xuan)
2. Re: Can not run with PhraseDictionaryCompact. Bus error
(Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Sun, 6 Nov 2016 20:07:40 +0900
From: "TRAN, Chien Xuan" <chien-tran@jaist.ac.jp>
Subject: [Moses-support] Can not run with PhraseDictionaryCompact. Bus
error
To: moses-support@mit.edu
Message-ID: <BE0A71E8-1F6B-4B73-BF67-97A1DFA4B03A@jaist.ac.jp>
Content-Type: text/plain; charset="us-ascii"

Hi there,

I followed the tutorial to build binarised version of my phrase-table and run the command with new moses.ini to test the system, but I always get the following error message:

Defined parameters (per moses.ini or switch):
config: data/sent_alignment/working/binarised-model/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryCompact name=TranslationModel0 num-features=4 path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/working/binarised-model/phrase-table input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/working/binarised-model/reordering-table Distortion KENLM name=LM0 factor=0 path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/lm/train.blm.simple order=3
input-factors: 0
mapping: 0 T 0
weight: LexicalReordering0= 0.186288 0.0466292 0.0627905 0.253309 0.074133 0.14872 Distortion0= 0.00785225 LM0= 0.0219709 WordPenalty0= 0.023755 PhrasePenalty0= 0.0679254 TranslationModel0= 0.0285083 0.00680983 0.0661036 -0.0052047 UnknownWordPenalty0= 1
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryCompact name=TranslationModel0 num-features=4 path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/working/binarised-model/phrase-table input-factor=0 output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/working/binarised-model/reordering-table
Initializing Lexical Reordering Feature..
FeatureFunction: LexicalReordering0 start: 7 end: 12
line=Distortion
FeatureFunction: Distortion0 start: 13 end: 13
line=KENLM name=LM0 factor=0 path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/lm/train.blm.simple order=3
FeatureFunction: LM0 start: 14 end: 14
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Bus error: 10

Do you have any suggestion to solve this issue? I have been spending a whole day to debug but no success. I also tried recompiling moses with cmph-2.0 and boost 1.60 but does not work either.

Looking forward to seeing your response. Thank you in advance.

Best regards,
TRAN, Chien Xuan
Master Student - School of Information Science
Japan Advanced Institute of Science and Technology (JAIST)
Phone: 070-2677-1254

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161106/58fadf11/attachment-0001.html

------------------------------

Message: 2
Date: Sun, 6 Nov 2016 09:38:43 -0600
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Can not run with PhraseDictionaryCompact.
Bus error
To: "TRAN, Chien Xuan" <chien-tran@jaist.ac.jp>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbiq0un9f7kytViDYyAAt9x4wi-_Ddc5ZSK9THeHcUpxKw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

I think there's a bug in the compact phrase table or compact lexicalized
reordering model that causes a segfault on OSX. If you're running on OSX, I
would use another implementation, eg. the OnDisk or probing pt and the
binary lexicalised reordering model

Hieu Hoang
http://www.hoang.co.uk/hieu

On 6 November 2016 at 05:07, TRAN, Chien Xuan <chien-tran@jaist.ac.jp>
wrote:

> Hi there,
>
> I followed the tutorial to build binarised version of my phrase-table and
> run the command with new moses.ini to test the system, but I always get the
> following error message:
>
> *Defined parameters (per moses.ini or switch):*
> * config: data/sent_alignment/working/binarised-model/moses.ini*
> * distortion-limit: 6*
> * feature: UnknownWordPenalty WordPenalty PhrasePenalty
> PhraseDictionaryCompact name=TranslationModel0 num-features=4
> path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/working/binarised-model/phrase-table
> input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0
> num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0
> output-factor=0
> path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/working/binarised-model/reordering-table
> Distortion KENLM name=LM0 factor=0
> path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/lm/train.blm.simple
> order=3*
> * input-factors: 0*
> * mapping: 0 T 0*
> * weight: LexicalReordering0= 0.186288 0.0466292 0.0627905 0.253309
> 0.074133 0.14872 Distortion0= 0.00785225 LM0= 0.0219709 WordPenalty0=
> 0.023755 PhrasePenalty0= 0.0679254 TranslationModel0= 0.0285083 0.00680983
> 0.0661036 -0.0052047 UnknownWordPenalty0= 1*
> *line=UnknownWordPenalty*
> *FeatureFunction: UnknownWordPenalty0 start: 0 end: 0*
> *line=WordPenalty*
> *FeatureFunction: WordPenalty0 start: 1 end: 1*
> *line=PhrasePenalty*
> *FeatureFunction: PhrasePenalty0 start: 2 end: 2*
> *line=PhraseDictionaryCompact name=TranslationModel0 num-features=4
> path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/working/binarised-model/phrase-table
> input-factor=0 output-factor=0*
> *FeatureFunction: TranslationModel0 start: 3 end: 6*
> *line=LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/working/binarised-model/reordering-table*
> *Initializing Lexical Reordering Feature..*
> *FeatureFunction: LexicalReordering0 start: 7 end: 12*
> *line=Distortion*
> *FeatureFunction: Distortion0 start: 13 end: 13*
> *line=KENLM name=LM0 factor=0
> path=/Users/nguyenlab-imac/tools/mosesdecoder/data/sent_alignment/lm/train.blm.simple
> order=3*
> *FeatureFunction: LM0 start: 14 end: 14*
> *Loading UnknownWordPenalty0*
> *Loading WordPenalty0*
> *Loading PhrasePenalty0*
> *Loading LexicalReordering0*
> *Bus error: 10*
>
> Do you have any suggestion to solve this issue? I have been spending a
> whole day to debug but no success. I also tried recompiling moses with
> cmph-2.0 and boost 1.60 but does not work either.
>
> Looking forward to seeing your response. Thank you in advance.
>
> Best regards,
> *TRAN, Chien Xuan*
> Master Student - School of Information Science
> Japan Advanced Institute of Science and Technology (JAIST)
> Phone: 070-2677-1254
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161106/f7ff5d7e/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 121, Issue 21
**********************************************

Tweet