Home » Uncategories » Moses-support Digest, Vol 89, Issue 53

Moses-support Digest, Vol 89, Issue 53

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: fail to build Moses (Hieu Hoang)
2. Re: Installation issues (Linux mint) (Hieu Hoang)
3. Re: tools for factored corpora (Massinissa Ahmim)
4. Re: Loading a binary rule table (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 20 Mar 2014 17:48:54 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] fail to build Moses
To: Tiansi Dong <tian1shi2@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbhuqOK7v3RK2B-6KQxXuyAvnjGnY0kn+sfhJ5f7-Cug1Q@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

where did you download your source code from, and when did you download it?

There 1 error I see and I think it was fixed a few weeks ago. If you
download the latest version of Moses from github, it should be ok:
git clone https://github.com/moses-smt/mosesdecoder.git


On 20 March 2014 14:06, Tiansi Dong <tian1shi2@gmail.com> wrote:

> the command I type is: ./bjam -j8
>
> many thanks for the support
>
> -tiansi dong
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140320/24ecee04/attachment-0001.htm

------------------------------

Message: 2
Date: Thu, 20 Mar 2014 17:50:16 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Installation issues (Linux mint)
To: mm689@st-andrews.ac.uk
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbh_SfapmoxfvV-N66g3i7Suo+i4QDkCG+DUjxW=niACNQ@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

it looks like boost hasn't been installed properly.

What is the exact command you used to compile Moses? How did you install
boost? What OS are you running on?


On 20 March 2014 17:40, Martin McCaffery <mm689@st-andrews.ac.uk> wrote:

> Hi all,
>
> I've been trying to get Moses up and running locally and been running into
> problems. At first I had issues with trying to get Boost working on my
> local machine, but after tweaking Boost the errors have got smaller.
>
> Now when running ./bjam I seem to simply be getting g++ compile and
> testing errors, but I can't tell much more than that. There are some
> Boost-related undefined references, though: are there any specific
> configuration details I need for Boost that I'm missing?
>
> Any thoughts would be welcome.
>
> Thanks!
> Martin
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140320/d572d2f9/attachment-0001.htm

------------------------------

Message: 3
Date: Thu, 20 Mar 2014 22:11:55 +0100
From: Massinissa Ahmim <massinissa.ahmim@linguacustodia.com>
Subject: Re: [Moses-support] tools for factored corpora
To: Viktor Pless <viktor.pless@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CANN0mWZ5gs85CD427pGyWrV5rX6LPUembzToQ_o46a0dFqE0BA@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi Viktor,

As far I know, you can use the wrapper scripts (treetagger or mxpost)
located at /mosesdecoder/scripts/training/wrappers for this purpose.

Regards

Massinissa


2014-03-20 17:37 GMT+01:00 Viktor Pless <viktor.pless@gmail.com>:

> Hi, what tools can be used to lemmatize/POS-tag/etc. a corpus in moses
> format (with the pipes)? I need them regarding Spanish, English, Hungarian.
> Thanks in advance.
> Viktor
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--

[image: Description : Description : lingua_custodia_final full logo]

*The Translation Trustee*

*1, Place Charles de Gaulle*

*78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23 Mobile : +33 7 61 44 40 84*

*Email :* *massinissa.ahmim@linguacustodia.com
<massinissa.ahmim@linguacustodia.com>*

*Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
www.thetranslationtrustee.com <http://www.thetranslationtrustee.com>*

? Pensez ? l'environnement, n'imprimez ce courriel que si n?cessaire.

Please do not print this email unless it is absolutely necessary. Spread
environmental awareness.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140320/01818bf6/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140320/01818bf6/attachment-0001.jpg

------------------------------

Message: 4
Date: Fri, 21 Mar 2014 10:18:33 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Loading a binary rule table
To: Massinissa Ahmim <massinissa.ahmim@linguacustodia.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAEKMkbieEZaD_TAdzOupHE909TTVY2Zm-V0fWagx31kAVpAXqg@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

everything seems to be ok. Are you sure the server you are running on has
access to the directory
/disque2/Preparation/syntactic/hierarchical_PSCT/rule-table

Also, you should consider updating your version of Moses to the current
github version, or version 2.1.1


On 20 March 2014 11:20, Massinissa Ahmim <
massinissa.ahmim@linguacustodia.com> wrote:

> Dear all,
>
> I've managed to train a hierarchical model using the following command :
>
> nohup /mosesdecoder/scripts/training/train-model.perl --hierarchical
> --glue-grammar --score-options="--GoodTuring" -root-dir
> /disque2/Preparation/syntactic/hierarchical_PSCT -corpus
> /disque2/Preparation/backoff/PSCT.tok.uni.low -f fr -e en -lm
> 0:5:/disque2/Preparation/syntactic/hierarchical/LM.sur.en.blm
> -external-bin-dir /root/external-bin-dir/ -mgiza -mgiza-cpus 30 >&
> training.out &
>
> The resulting model works great but it is very slow.
>
> So I used CreatOnDiskPt to binarise the rule table as follows :
>
> /home/Moses/mosesdecoder/bin/CreateOnDiskPt 1 1 5 20 2
> model/rule-table.gz rules-table
>
> This outputs the following files
>
> -rw-r--r-- 1 root root 85 20 mars 11:35 Misc.dat
> -rw-r--r-- 1 root root 781509322 20 mars 11:35 Source.dat
> -rw-r--r-- 1 root root 1758588137 20 mars 11:35 TargetColl.dat
> -rw-r--r-- 1 root root 1555353459 20 mars 11:35 TargetInd.dat
> -rw-r--r-- 1 root root 400714 20 mars 11:35 Vocab.dat
>
> and I've updated my moses.ini as follows :
>
> 6 0 0 1 /disque2/Preparation/syntactic/hierarchical_PSCT/rule-table
> 6 0 0 1 /disque2/Preparation/syntactic/hierarchical_PSCT/model/glue-grammar
>
> But as I try to use it, I'm getting this :
>
> Defined parameters (per moses.ini or switch):
> config: moses.ini
> cube-pruning-pop-limit: 1000
> input-factors: 0
> inputtype: 3
> lmodel-file: 0 0 5
> /disque2/Preparation/syntactic/hierarchical/LM.sur.en.blm
> mapping: 0 T 0 1 T 1
> max-chart-span: 20 1000
> non-terminals: X
> search-algorithm: 3
> ttable-file: 6 0 0 1
> /disque2/Preparation/syntactic/hierarchical_PSCT/rule-table 6 0 0 1
> /disque2/Preparation/syntactic/hierarchical_PSCT/model/glue-grammar
> ttable-limit: 20
> weight-l: 0.5000
> weight-t: 0.20 0.20 0.20 0.20 0.20 1.0
> weight-w: -1
> /mosesdecoder/bin
> ScoreProducer: WordPenalty start: 0 end: 1
> ScoreProducer: !UnknownWordPenalty start: 1 end: 2
> Loading lexical distortion models...have 0 models
> Start loading LanguageModel
> /disque2/Preparation/syntactic/hierarchical/LM.sur.en.blm : [0.000] seconds
> /disque2/Preparation/syntactic/hierarchical/LM.sur.en.blm: line 80492:
> reached EOF before \end\
> ScoreProducer: LM start: 2 end: 3
> Finished loading LanguageModels : [0.056] seconds
> Using uniform ttable-limit of 20 for all translation tables.
> Start loading PhraseTable
> /disque2/Preparation/syntactic/hierarchical_PSCT/rule-table : [0.056]
> seconds
> filePath: /disque2/Preparation/syntactic/hierarchical_PSCT/rule-table
> ScoreProducer: PhraseModel start: 3 end: 4
> Start loading PhraseTable
> /disque2/Preparation/syntactic/hierarchical_PSCT/model/glue-grammar :
> [0.056] seconds
> filePath:
> /disque2/Preparation/syntactic/hierarchical_PSCT/model/glue-grammar
> ScoreProducer: PhraseModel:2 start: 4 end: 5
> Finished loading phrase tables : [0.056] seconds
> max-chart-span: 20
> max-chart-span: 1000
> Start loading phrase table from
> /disque2/Preparation/syntactic/hierarchical_PSCT/rule-table : [0.056]
> seconds
> Can't read /disque2/Preparation/syntactic/hierarchical_PSCT/rule-table
>
> So I wondering if I did something wrong with my training
> command/binarisation or with the parameters in the moses.ini
>
>
> Many thanks
>
> Regads
>
> MA
>
>
>
>
> --
>
> [image: Description : Description : lingua_custodia_final full logo]
>
> *The Translation Trustee*
>
> *1, Place Charles de Gaulle*
>
> *78180 Montigny-le-Bretonneux*
>
> *Tel : +33 1 30 44 04 23 Mobile : +33 7 61 44 40 84*
>
> *Email :* *massinissa.ahmim@linguacustodia.com
> <massinissa.ahmim@linguacustodia.com>*
>
> *Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
> www.thetranslationtrustee.com <http://www.thetranslationtrustee.com>*
>
> ? Pensez ? l'environnement, n'imprimez ce courriel que si n?cessaire.
>
> Please do not print this email unless it is absolutely necessary. Spread
> environmental awareness.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140321/5dd2460f/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140321/5dd2460f/attachment.jpg

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 89, Issue 53
*********************************************

0 Response to "Moses-support Digest, Vol 89, Issue 53"

Post a Comment

Subscribe to: Post Comments (Atom)