Moses-support Digest, Vol 113, Issue 33

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Installing/compiling Moses - the build failed (Anna Garbar)
2. Training backward LM? (Michael Denkowski)
3. Re: Training backward LM? (Michael Denkowski)
4. problem while testing moses (sofiane bouzaher)
5. Re: problem while testing moses (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 10 Mar 2016 20:35:48 +0100
From: Anna Garbar <anna.garbar@gmail.com>
Subject: [Moses-support] Installing/compiling Moses - the build failed
To: moses-support@mit.edu
Message-ID:
<CAHbd-+g74WaDHPD_=iREPV4oGmwQraih7Ggtc4kQQ36DSj_BBg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear Moses support team,

I tried to install Moses on Windows via cygwin following the instructions
in http://www.statmt.org/moses/?n=Development.GetStarted but have problems
compiling Moses:

The build.log.gz is attached, the exact command I executed when I got the
error was ./bjam -j4

Thanks a lot for your help,
Anna
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160310/1d922ef4/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.gz
Type: application/x-gzip
Size: 220 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20160310/1d922ef4/attachment-0001.gz

------------------------------

Message: 2
Date: Thu, 10 Mar 2016 16:33:31 -0500
From: Michael Denkowski <michael.j.denkowski@gmail.com>
Subject: [Moses-support] Training backward LM?
To: Moses Support <moses-support@mit.edu>
Message-ID:
<CA+-GegLa=BbMPf5J7t2Cjacc8pf8MUFh-+7Tujm04cEop5dxjg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Moses LM enthusiasts,

This may be a silly question. If I want to use the BackwardLanguageModel
feature, what (if anything) should I do to let KenLM know that it's a
backward model?

If I just reverse the words in each sentence and run lmplz/build_binary,
will Moses do the right thing with the model? Do I need to do anything
special with <s> and </s>?

Best,
Michael
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160310/9762c67b/attachment-0001.html

------------------------------

Message: 3
Date: Thu, 10 Mar 2016 18:36:45 -0500
From: Michael Denkowski <michael.j.denkowski@gmail.com>
Subject: Re: [Moses-support] Training backward LM?
To: Moses Support <moses-support@mit.edu>
Message-ID:
<CA+-GegJhCzLSjuT1gs6dGc2L3BYj9sGoB=r_QpiGtc5+pTx0yg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

As a follow-up, how exactly does one activate the BackwardLanguageModel
feature? It doesn't seem to be registered anywhere although it's been in
Moses for awhile. Still work in progress?

Best,
Michael

On Thu, Mar 10, 2016 at 4:33 PM, Michael Denkowski <
michael.j.denkowski@gmail.com> wrote:

> Hi Moses LM enthusiasts,
>
> This may be a silly question. If I want to use the BackwardLanguageModel
> feature, what (if anything) should I do to let KenLM know that it's a
> backward model?
>
> If I just reverse the words in each sentence and run lmplz/build_binary,
> will Moses do the right thing with the model? Do I need to do anything
> special with <s> and </s>?
>
> Best,
> Michael
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160310/cf55c51e/attachment-0001.html

------------------------------

Message: 4
Date: Thu, 10 Mar 2016 22:33:48 +0100
From: sofiane bouzaher <bouzaher.sofiane@gmail.com>
Subject: [Moses-support] problem while testing moses
To: moses-support@mit.edu, hieuhoang@gmail.com,
mohammad.nasiruddin@gmail.com
Message-ID:
<CAOVxcXmHCWhqOvNHfAodV1xLshn6fKJKP7GF10ERAweCJbmqPQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,we are trying use the moses toolkit for a Rapid Construction of
Supervised Word Sense Disambiguation System for Lesser-resourced Languages
(arabic) we use the virtual machine (ubuntu 14.04 32-bit.ova 30-Jan-2015
16:41 7.2G), we we have compiled moses withs cmph2.0 and boost_ 1_57_0 as
recommanded alla steps passed succufully, but when we try to run Moses with
compact phrase table using
"/home/hieu/workspace/github/mosesdecoder/bin/moses -f
/home/hieu/working/binarised-model/moses.ini" we get this error

hieu@hieu-VirtualBox:~$ /home/hieu/workspace/github/mosesdecoder/bin/moses
-f /home/hieu/working/binarised-model/moses.ini
Defined parameters (per moses.ini or switch):
config: /home/hieu/working/binarised-model/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4
path=/home/hieu/working/binarised-model/phrase-table.minphr input-factor=0
output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/hieu/working/binarised-model/reordering-table.minlexr Distortion
KENLM lazyken=0 name=LM0 factor=0
path=/home/hieu/lm/news-commentary-v8.fr-en.blm.en order=3
input-factors: 0
mapping: 0 T 0
weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3 0.3
0.3 Distortion0= 0.3 LM0= 0.5
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryCompact name=TranslationModel0 num-features=4
path=/home/hieu/working/binarised-model/phrase-table.minphr input-factor=0
output-factor=0
Exception: moses/FF/Factory.cpp:321 in void
Moses::FeatureRegistry::Construct(const string&, const string&) threw
UnknownFeatureException because `i == registry_.end()'.
Feature name PhraseDictionaryCompact is not registered.


we need help please ,
and also an idea for the possibility to use of arabic language ?

the moses.ini file :
#########################
### MOSES CONFIG FILE ###
#########################

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0

[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 num-features=4
path=/home/hieu/working/binarised-model/phrase-table.minphr input-factor=0
output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/hieu/working/binarised-model/reordering-table.minlexr
Distortion
KENLM lazyken=0 name=LM0 factor=0
path=/home/hieu/lm/news-commentary-v8.fr-en.blm.en order=3

# dense weights for feature functions
[weight]
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160310/ecc5909a/attachment-0001.html

------------------------------

Message: 5
Date: Fri, 11 Mar 2016 02:02:43 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] problem while testing moses
To: sofiane bouzaher <bouzaher.sofiane@gmail.com>,
moses-support@mit.edu, mohammad.nasiruddin@gmail.com
Message-ID: <56E22743.5020704@gmail.com>
Content-Type: text/plain; charset=utf-8; format=flowed

What was the exact command you used to compile moses? ie. ./bjam ....

It doesn't look like the cmph library was linked to moses so the compact
phrase-table wasn't compiled.

On 10/03/2016 21:33, sofiane bouzaher wrote:
> Hi,we are trying use the moses toolkit for a Rapid Construction of
> Supervised Word Sense Disambiguation System for Lesser-resourced
> Languages (arabic) we use the virtual machine (ubuntu 14.04
> 32-bit.ova 30-Jan-2015 16:41 7.2G), we we have compiled moses withs
> cmph2.0 and boost_ 1_57_0 as recommanded alla steps passed
> succufully, but when we try to run Moses with compact phrase table
> using "/home/hieu/workspace/github/mosesdecoder/bin/moses -f
> /home/hieu/working/binarised-model/moses.ini" we get this error
>
> hieu@hieu-VirtualBox:~$
> /home/hieu/workspace/github/mosesdecoder/bin/moses -f
> /home/hieu/working/binarised-model/moses.ini
> Defined parameters (per moses.ini or switch):
> config: /home/hieu/working/binarised-model/moses.ini
> distortion-limit: 6
> feature: UnknownWordPenalty WordPenalty PhrasePenalty
> PhraseDictionaryCompact name=TranslationModel0 num-features=4
> path=/home/hieu/working/binarised-model/phrase-table.minphr
> input-factor=0 output-factor=0 LexicalReordering
> name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/hieu/working/binarised-model/reordering-table.minlexr
> Distortion KENLM lazyken=0 name=LM0 factor=0
> path=/home/hieu/lm/news-commentary-v8.fr-en.blm.en order=3
> input-factors: 0
> mapping: 0 T 0
> weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0=
> 0.2 TranslationModel0= 0.2 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3
> 0.3 0.3 0.3 Distortion0= 0.3 LM0= 0.5
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 1
> line=PhrasePenalty
> FeatureFunction: PhrasePenalty0 start: 2 end: 2
> line=PhraseDictionaryCompact name=TranslationModel0 num-features=4
> path=/home/hieu/working/binarised-model/phrase-table.minphr
> input-factor=0 output-factor=0
> Exception: moses/FF/Factory.cpp:321 in void
> Moses::FeatureRegistry::Construct(const string&, const string&) threw
> UnknownFeatureException because `i == registry_.end()'.
> Feature name PhraseDictionaryCompact is not registered.
>
>
> we need help please ,
> and also an idea for the possibility to use of arabic language ?
>
> the moses.ini file :
> #########################
> ### MOSES CONFIG FILE ###
> #########################
>
> # input factors
> [input-factors]
> 0
>
> # mapping steps
> [mapping]
> 0 T 0
>
> [distortion-limit]
> 6
>
> # feature functions
> [feature]
> UnknownWordPenalty
> WordPenalty
> PhrasePenalty
> PhraseDictionaryCompact name=TranslationModel0 num-features=4
> path=/home/hieu/working/binarised-model/phrase-table.minphr
> input-factor=0 output-factor=0
> LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/hieu/working/binarised-model/reordering-table.minlexr
> Distortion
> KENLM lazyken=0 name=LM0 factor=0
> path=/home/hieu/lm/news-commentary-v8.fr-en.blm.en order=3
>
> # dense weights for feature functions
> [weight]
> UnknownWordPenalty0= 1
> WordPenalty0= -1
> PhrasePenalty0= 0.2
> TranslationModel0= 0.2 0.2 0.2 0.2
> LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
> Distortion0= 0.3
> LM0= 0.5



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 33
**********************************************

Tweet