Moses-support Digest, Vol 89, Issue 23

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. manual: 3.2.1 Train an unfactored model (Peter Kleiweg)
2. Re: Problems with moses compilation (Kenneth Heafield)
3. Re: manual: 3.2.1 Train an unfactored model (Massinissa Ahmim)
4. train-model log file? (Viktor Pless)


----------------------------------------------------------------------

Message: 1
Date: Tue, 11 Mar 2014 19:25:02 +0100 (CET)
From: Peter Kleiweg <p.c.j.kleiweg@rug.nl>
Subject: [Moses-support] manual: 3.2.1 Train an unfactored model
To: moses-support@mit.edu
Message-ID: <alpine.DEB.2.00.1403111905510.17849@pebbe>
Content-Type: TEXT/PLAIN; charset=US-ASCII


Hi,

>From the manual: http://www.statmt.org/moses/manual/manual.pdf

I have run the example from part 3.2.1, page 64, to create unfactored/model/moses.ini

At the bottom of page 67 is this example:

moses -f unfactored/model/moses.ini < in -d 0.2

The file 'in' contains:

menschen beschreibt putin .

(The -d 0.2 causes an error in all examples, so I leave that out)


I get an error:

Exception: moses/Word.cpp:112 in void Moses::Word::CreateFromString(Moses::FactorDirection, const std::vector<long unsigned int>&, const StringPiece&, bool) threw StrayFactorException because `fit'.
You have configured 1 factors but the word !|!|. contains factor delimiter | too many times.

What is wrong, and how do I fix this?

All other examples in section 3.2 work OK.


I have moses built with both IRSTLM and SRILM.


--
Peter Kleiweg
http://pkleiweg.home.xs4all.nl/


------------------------------

Message: 2
Date: Tue, 11 Mar 2014 11:33:38 -0700
From: Kenneth Heafield <moses@kheafield.com>
Subject: Re: [Moses-support] Problems with moses compilation
To: moses-support@mit.edu
Message-ID: <531F5702.6080504@kheafield.com>
Content-Type: text/plain; charset=ISO-8859-1

Hi,

Please pull and try again. I've set pcqueue_test so it won't be
compiled as part of the single-threaded build. Also fixed rt linkage.

Kenneth

On 03/11/14 01:25, Yun Chung wrote:
> Dear Moses supports,
>
> I am running into an error when compiling Moses
> (https://github.com/moses-smt/mosesdecoder/commit/23556697c4e6831bfd0574351717f5a7b79dff77)
> with the options "threading=single" and "--static". (x86_64-redhat-linux)
>
> The command I used is:
>
> ./bjam threading=single --static --prefix=$MOSES_INSTALLDIR
> --install-scripts=$MOSES_SCRIPTS --with-srilm=$SRILM
> --with-irstlm=$IRSTLMDIR --with-boost=$BOOSTDIR
> --with-xmlrpc-c=$XMLRPCDIR --with-cmph=$CMPHDIR
> --with-giza=$MOSES_INSTALLDIR/bin --max-kenlm-order=5 --with-tcmalloc
> --without-libsegfault -j8 -a -q
>
> It was a linking error with "pcqueue_test". The partial error message is
> attached. If I remove "threading=single", the compilation finishes
> without problems. It seems "-lpthread" could help with this step, but I
> don't know how to add such an option to the bjam command. (Adding
> "linkflags=-lpthread" alone seems to cause the compilation to freeze.)
> It would be great if someone could tell me how to deal with it.
>
> Thank you very much for the help in advance!
>
> Best regards,
> Yun
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

Message: 3
Date: Tue, 11 Mar 2014 19:37:17 +0100
From: Massinissa Ahmim <massinissa.ahmim@linguacustodia.com>
Subject: Re: [Moses-support] manual: 3.2.1 Train an unfactored model
To: Peter Kleiweg <p.c.j.kleiweg@rug.nl>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CANN0mWYE2Ztt7e3V33TS9vLKDj9WkrVcWSrqg04DsOzkvpry0w@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi Peter,

There is obviously an issue with your training data, have you used
the proj-syndicate corpora? if so please paste here your training command
I'd be interested to see that.

Regards

M


2014-03-11 19:25 GMT+01:00 Peter Kleiweg <p.c.j.kleiweg@rug.nl>:

>
> Hi,
>
> >From the manual: http://www.statmt.org/moses/manual/manual.pdf
>
> I have run the example from part 3.2.1, page 64, to create
> unfactored/model/moses.ini
>
> At the bottom of page 67 is this example:
>
> moses -f unfactored/model/moses.ini < in -d 0.2
>
> The file 'in' contains:
>
> menschen beschreibt putin .
>
> (The -d 0.2 causes an error in all examples, so I leave that out)
>
>
> I get an error:
>
> Exception: moses/Word.cpp:112 in void
> Moses::Word::CreateFromString(Moses::FactorDirection, const
> std::vector<long unsigned int>&, const StringPiece&, bool) threw
> StrayFactorException because `fit'.
> You have configured 1 factors but the word !|!|. contains factor
> delimiter | too many times.
>
> What is wrong, and how do I fix this?
>
> All other examples in section 3.2 work OK.
>
>
> I have moses built with both IRSTLM and SRILM.
>
>
> --
> Peter Kleiweg
> http://pkleiweg.home.xs4all.nl/
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>



--

[image: Description : Description : lingua_custodia_final full logo]

*The Translation Trustee*

*1, Place Charles de Gaulle*

*78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23 Mobile : +33 7 61 44 40 84*

*Email :* *massinissa.ahmim@linguacustodia.com
<massinissa.ahmim@linguacustodia.com>*

*Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
www.thetranslationtrustee.com <http://www.thetranslationtrustee.com>*

? Pensez ? l'environnement, n'imprimez ce courriel que si n?cessaire.

Please do not print this email unless it is absolutely necessary. Spread
environmental awareness.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140311/13f298e2/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140311/13f298e2/attachment-0001.jpg

------------------------------

Message: 4
Date: Tue, 11 Mar 2014 19:39:47 +0100
From: Viktor Pless <viktor.pless@gmail.com>
Subject: [Moses-support] train-model log file?
To: moses-support@mit.edu
Message-ID:
<CAD3iPeFf0=mxJuSxCFt0UjnK3zWR-cs7sYFMYi1njHSmys1txg@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi, does the train-model.perl script (or more specifically, mgiza) create a
log file?

thanks,
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140311/2fbdfb47/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 89, Issue 23
*********************************************

Tweet