Moses-support Digest, Vol 106, Issue 54

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Cannot install moses with manual boost installation
(Shyam Upadhyay)
2. Re: Cannot install moses with manual boost installation
(Kenneth Heafield)
3. Re: Cannot install moses with manual boost installation
(Shyam Upadhyay)
4. Translation is mixed up when using multiple decoding paths
(Thanasis Naskos)
5. Decoding Speed perfomance - suggestion and question
(Vincent Nguyen)
6. Re: g++: error: unrecognized command line option
'-no-cpp-precomp' (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Sun, 30 Aug 2015 15:36:32 -0500
From: Shyam Upadhyay <shyamupa@gmail.com>
Subject: [Moses-support] Cannot install moses with manual boost
installation
To: moses-support@mit.edu
Message-ID:
<CAAet1GvFKxDSQKJw+Fyme4u8hUkyz0Cfjg_-hNrgGPjzH2h+_Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

I am attempting to install the latest version of moses using the
instructions at http://www.statmt.org/moses/?n=Development.GetStarted. I
followed the manual boost installation instructions as is, but when I run
bjam I get the following error,

"You have Boost 104100. This package requires Boost at least 104400 (and
preferably newer)."

It seems that bjam is not seeing the new installation. What should I do to
fix this? I saw there was a similar question in the archives, but there was
no solution.


Thanks
Shyam
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150830/94dbf3c2/attachment-0001.html

------------------------------

Message: 2
Date: Sun, 30 Aug 2015 22:16:26 +0100
From: Kenneth Heafield <moses@kheafield.com>
Subject: Re: [Moses-support] Cannot install moses with manual boost
installation
To: moses-support@mit.edu
Message-ID: <55E372AA.7020107@kheafield.com>
Content-Type: text/plain; charset=windows-1252

It sounds like you haven't set environment variables or used
--with-boost=/path/where/you/installed/boost

Here's directions on installing packages, including Boost, in home
directories etc:

https://kheafield.com/code/kenlm/dependencies

On 08/30/2015 09:36 PM, Shyam Upadhyay wrote:
> Hi,
>
> I am attempting to install the latest version of moses using the
> instructions at http://www.statmt.org/moses/?n=Development.GetStarted. I
> followed the manual boost installation instructions as is, but when I
> run bjam I get the following error,
>
> "You have Boost 104100. This package requires Boost at least 104400 (and
> preferably newer)."
>
> It seems that bjam is not seeing the new installation. What should I do
> to fix this? I saw there was a similar question in the archives, but
> there was no solution.
>
>
> Thanks
> Shyam
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

Message: 3
Date: Sun, 30 Aug 2015 17:02:49 -0500
From: Shyam Upadhyay <shyamupa@gmail.com>
Subject: Re: [Moses-support] Cannot install moses with manual boost
installation
To: Kenneth Heafield <moses@kheafield.com>
Cc: moses-support@mit.edu
Message-ID:
<CAAet1GsktwPokPjEwdEUFajL3Mvm7ZFNcFoQm4VHGAgUuM3LLw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

I followed the instructions exactly (including the with-boost directive). I
did not set any path variables though. I am installing without root
permissions, but I don't think that is the issue.

On Sun, Aug 30, 2015 at 4:16 PM, Kenneth Heafield <moses@kheafield.com>
wrote:

> It sounds like you haven't set environment variables or used
> --with-boost=/path/where/you/installed/boost
>
> Here's directions on installing packages, including Boost, in home
> directories etc:
>
> https://kheafield.com/code/kenlm/dependencies
>
> On 08/30/2015 09:36 PM, Shyam Upadhyay wrote:
> > Hi,
> >
> > I am attempting to install the latest version of moses using the
> > instructions at http://www.statmt.org/moses/?n=Development.GetStarted. I
> > followed the manual boost installation instructions as is, but when I
> > run bjam I get the following error,
> >
> > "You have Boost 104100. This package requires Boost at least 104400 (and
> > preferably newer)."
> >
> > It seems that bjam is not seeing the new installation. What should I do
> > to fix this? I saw there was a similar question in the archives, but
> > there was no solution.
> >
> >
> > Thanks
> > Shyam
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150830/27715d45/attachment-0001.html

------------------------------

Message: 4
Date: Mon, 31 Aug 2015 01:40:07 +0300
From: Thanasis Naskos <atnaskos@gmail.com>
Subject: [Moses-support] Translation is mixed up when using multiple
decoding paths
To: moses-support@mit.edu
Message-ID: <55E38647.7060904@gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi all,

I'd like to support both fr-el and el-fr translations, hence I have
trained two models and created a moses.ini file (attached) including both.
However the results are mixed up. I'm using mosesserver and for some
words I'm getting as translation words from the same language or mixed
words from both languages.

When I use two separate mosesserver instances (one for each dictionary),
with separate moses.ini files, the results are correct.

I've also tried to use plain moses instead of mosesserver with the
attached .ini file and the results for the same words are different from
mosesserver and totally wrong.

Is there something wrong with the .ini file that I use?

Thanks you!
Thanasis
-------------- next part --------------
#########################
### MOSES CONFIG FILE ###
#########################

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0
1 T 1

[distortion-limit]
6

# feature functions
[feature]
Distortion
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryCompact name=TranslationModel0 table-limit=20 num-features=4 path=/media/Storage/corpus_workbench/resources/fr-el/phrase-table input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/media/Storage/corpus_workbench/resources/fr-el/reordering
KENLM lazyken=0 name=LM0 factor=0 path=/media/Storage/corpus_workbench/resources/fr-el/corpus.fr-el.binlm order=3
PhraseDictionaryCompact name=TranslationModel1 table-limit=20 num-features=4 path=/media/Storage/corpus_workbench/resources/el-fr/phrase-table input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering1 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/media/Storage/corpus_workbench/resources/el-fr/reordering
KENLM lazyken=0 name=LM1 factor=0 path=/media/Storage/corpus_workbench/resources/el-fr/corpus.el-fr.binlm order=3


# core weights - not used
[weight]
Distortion0= 0
WordPenalty0= 0
TranslationModel0= 0 0 0 0
LexicalReordering0= 0 0 0 0 0 0
LM0= 0
TranslationModel1= 0 0 0 0
LexicalReordering1= 0 0 0 0 0 0
LM1= 0


# dense weights for feature functions
[alternate-weight-setting]
id=fr-el ignore-ff=LM1,TranslationModel1,LexicalReordering1 ignore-decoding-path=1
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5
id=el-fr ignore-ff=LM0,TranslationModel0,LexicalReordering0 ignore-decoding-path=0
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel1= 0.2 0.2 0.2 0.2
LexicalReordering1= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM1= 0.5

------------------------------

Message: 5
Date: Mon, 31 Aug 2015 09:03:38 +0200
From: Vincent Nguyen <vnguyen@neuf.fr>
Subject: [Moses-support] Decoding Speed perfomance - suggestion and
question
To: moses-support <moses-support@mit.edu>
Message-ID: <55E3FC4A.2070908@neuf.fr>
Content-Type: text/plain; charset=utf-8; format=flowed

Hi,

Here are some results with several values with cube pruning pop limit :

(pop limit / decoding time for 3000 sentences / BLEU score)

5000 - 15m45 - 29.59
1000 - 4m27 - 29.59
500 - 3m35 - 29.59
200 - 3m15 - 29.51
100 - 3m00 - 29.40

Therefore I took 400 - 3m19 - 29.58

If I am not mistaken the default value for Moses is 1000 [read in the
doc] but in the EMS
it is 5000 right now .... which makes the experience so long .....
I suggest to change the EMS default value.

Is there a way to also use a cube pruning limit in the decoder at Tuning
time ?

Now with this optimized setting I get a ration of 15 segments per second
in average.
What is the reason for online tools like Google / Bing to be much much
faster.
it's not a machine issue, is it ?


Cheers
Vincent



------------------------------

Message: 6
Date: Mon, 31 Aug 2015 16:19:40 +0300
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] g++: error: unrecognized command line
option '-no-cpp-precomp'
To: Jorg Tiedemann <tiedeman@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <55E4546C.5010004@gmail.com>
Content-Type: text/plain; charset="utf-8"

the errors for clang looks like it's coming from the stl library. Have
you fiddled with the PATH variable or otherwise tried to make gcc on OSX
work? You shouldn't do that, it will just mess up the compilation
environment on your machine

On 31/08/2015 10:28, Jorg Tiedemann wrote:
>
> Unfortunately, this didn?t work for me either. I attach both logiles -
> one for clang and one for gcc (which I installed via macports)
> What can I do? Thanks!
>
> J?rg
>
>
>
>
>
>
>
>
>> On 30 Aug 2015, at 11:33, Hieu Hoang <hieuhoang@gmail.com
>> <mailto:hieuhoang@gmail.com>> wrote:
>>
>> Add
>> toolset=clang
>> to the bjam compile command. Osx no longer has gcc
>>
>> Hieu Hoang
>> Sent while bumping into things
>>
>> On 29 Aug 2015 11:56 pm, "Jorg Tiedemann" <tiedeman@gmail.com
>> <mailto:tiedeman@gmail.com>> wrote:
>>
>> Hi,
>>
>> I tried to make a fresh install of Moses on my new Mac and I get
>> the following error
>> g++: error: unrecognized command line option '-no-cpp-precomp'
>>
>> What?s wrong? I have gcc5 and boost 1.59 on my machine via
>> macports ...
>>
>> Thanks for your help!
>> J?rg
>>
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>

--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150831/cefe1fb9/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 106, Issue 54
**********************************************

0 Response to "Moses-support Digest, Vol 106, Issue 54"

Post a Comment