Moses-support Digest, Vol 97, Issue 64

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: building moses failed in Mac system (Daniel Seita)
2. Re: nist-bleu evaluation with EMS (Hieu Hoang)
3. Re: nist-bleu evaluation with EMS (Barry Haddow)
4. Error in EMS for factor based SMT (Rajen Chatterjee)


----------------------------------------------------------------------

Message: 1
Date: Thu, 20 Nov 2014 18:30:21 -0800
From: Daniel Seita <takeshidanny@gmail.com>
Subject: Re: [Moses-support] building moses failed in Mac system
To: "Aaron L.-F. Han" <hanlifengaaron@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAKUmyF4SX-z+sB2YVz-VrJyZGzOB9-ePRP9BPx2MsjrqG1QzRA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Aaron,

You might want to upgrade boost to the latest version, currently 1.57.

Daniel

On Thu, Nov 20, 2014 at 1:29 AM, Aaron L.-F. Han <hanlifengaaron@gmail.com>
wrote:

> by the way, the exact command i used:
>
> wcw-staff-145-18-167-105:mosesdecoder illcburo$ ./bjam
> --with-boost=/Users/illcburo/Desktop/aaron/Moses-smt/boost_1_52_0
> --with-irslt=/Users/illcburo/Desktop/aaron/Moses-smt/irstlm-5.80.06 -j2
>
>
>
> On Thu, Nov 20, 2014 at 10:24 AM, Aaron L.-F. Han <
> hanlifengaaron@gmail.com> wrote:
>
>> Hi Hieu and all,
>>
>> I installed the Moses in mac system, and failed with some problems, as
>> attached.
>> Does any of you commit similar matters?
>>
>> ========
>>
>> The build failed. If you need support, run:
>> ./jam-files/bjam
>> --with-boost=/Users/illcburo/Desktop/aaron/Moses-smt/boost_1_52_0
>> --with-irslt=/Users/illcburo/Desktop/aaron/Moses-smt/irstlm-5.80.06 -j2
>> --debug-configuration -d2 |gzip >build.log.gz
>> then attach build.log.gz to your e-mail.
>> You MUST do 3 things before sending to the mailing list:
>> 1. Subscribe to the mailing list at
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>> 2. Attach build.log.gz to your e-mail
>> 3. Say what is the EXACT command you executed when you got the error
>> ERROR
>> wcw-staff-145-18-167-105:mosesdecoder illcburo$
>>
>> =================
>>
>>
>> thanks in advance,
>>
>> aaron
>>
>>
>> --
>>
>> PHD candidate, ILLC
>>
>> University of Amsterdam, Office: Link
>> <http://www.illc.uva.nl/People/show_person.php?Person_id=Han+L.-F.>
>>
>> Homepage: http://www.linkedin.com/in/aaronhan
>>
>>
>
>
> --
>
> PHD candidate, ILLC
>
> University of Amsterdam, Office: Link
> <http://www.illc.uva.nl/People/show_person.php?Person_id=Han+L.-F.>
>
> Homepage: http://www.linkedin.com/in/aaronhan
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141120/5b674950/attachment-0001.htm

------------------------------

Message: 2
Date: Fri, 21 Nov 2014 12:43:58 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] nist-bleu evaluation with EMS
To: Gary Daine <gdaine@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbg92txNd_V6eSr63Qk=P5aLwT=z1mm-UD6k1njO-3+AkA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

SGML/nist-bleu is a complete pain. When you find out how to do this, please
enlighten us!

You might want to look at a working config file
http://www.statmt.org/moses/RELEASE-2.1/models/cs-en/config.pb.recase

On 18 November 2014 10:10, Gary Daine <gdaine@gmail.com> wrote:

> Hi,
>
> I have Moses installed and running properly, but I can't work out how to
> set up the config file for NIST-BLEU.
>
> The error message I get is:
>
> executing /home/gary/working/steps/4/EVALUATION_testcorpus_wrap.4
> via sh (1 active)
> number of steps doable or running: 1 at mar nov 18 10:51:09 CET 2014
> doable: EVALUATION:testcorpus:nist-bleu
> ERROR: you need to define GENERAL:input-sgm
>
> I understand that NIST-BLEU requires sgm-formatted files. My corpus is
> in utf-8, and I've specified raw input for all the other steps, which
> seems to work fine. I've read and re-read all the documentation I can
> find, and I can't work out:
>
> (1) which file(s) need to be in sgm format, and
> (2) how to specify this in the config file
>
(obviously I need to specify 'input-sgm =', but what do I use as a
> parameter? Do I need to convert the tuning(?) file manually beforehand?)
>
No

>
> I would appreciate any pointers.
>
> Thanks,
> Gary
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>



--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141121/39c604b5/attachment-0001.htm

------------------------------

Message: 3
Date: Fri, 21 Nov 2014 13:01:31 +0000
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] nist-bleu evaluation with EMS
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>, Gary Daine <gdaine@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <546F37AB.6070202@staffmail.ed.ac.uk>
Content-Type: text/plain; charset=windows-1252; format=flowed

Hi

You could use multi-bleu.perl (in scripts/generic). It works on plain
tokenised text, not sgml,

cheers - Barry

On 21/11/14 12:43, Hieu Hoang wrote:
> SGML/nist-bleu is a complete pain. When you find out how to do this,
> please enlighten us!
>
> You might want to look at a working config file
> http://www.statmt.org/moses/RELEASE-2.1/models/cs-en/config.pb.recase
>
> On 18 November 2014 10:10, Gary Daine <gdaine@gmail.com
> <mailto:gdaine@gmail.com>> wrote:
>
> Hi,
>
> I have Moses installed and running properly, but I can't work out
> how to
> set up the config file for NIST-BLEU.
>
> The error message I get is:
>
> executing /home/gary/working/steps/4/EVALUATION_testcorpus_wrap.4
> via sh (1 active)
> number of steps doable or running: 1 at mar nov 18 10:51:09 CET 2014
> doable: EVALUATION:testcorpus:nist-bleu
> ERROR: you need to define GENERAL:input-sgm
>
> I understand that NIST-BLEU requires sgm-formatted files. My corpus is
> in utf-8, and I've specified raw input for all the other steps, which
> seems to work fine. I've read and re-read all the documentation I can
> find, and I can't work out:
>
> (1) which file(s) need to be in sgm format, and
> (2) how to specify this in the config file
>
> (obviously I need to specify 'input-sgm =', but what do I use as a
> parameter? Do I need to convert the tuning(?) file manually
> beforehand?)
>
> No
>
>
> I would appreciate any pointers.
>
> Thanks,
> Gary
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.


--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

Message: 4
Date: Fri, 21 Nov 2014 14:08:39 +0100
From: Rajen Chatterjee <rajen.k.chatterjee@gmail.com>
Subject: [Moses-support] Error in EMS for factor based SMT
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAC4-+Nwu_n7-mxKaoa0OvtzDsuLXPpOOX0G5aaPgD5unwQbLZw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Hieu Hoang,

I am using EMS for factored based SMT.
I already have a factored corpus and I have used
factorized-stem=/path/to/corpus, but still I am getting this error "ERROR:
you need to define INPUT-FACTOR:lemma:factor-script"

*Training Option:*
input-factors = word lemma pos
output-factors = word
alignment-factors = "lemma -> word"
translation-factors = "word -> word"
reordering-factors = "word -> word"
#generation-factors = "word -> pos"
decoding-steps = "t0"

*Factor Definition:*
[INPUT-FACTOR]
temp-dir = $working-dir/training/factor

#[OUTPUT-FACTOR]
#temp-dir = $working-dir/training/factor

As I am already using factorized-stem then why it is asking for a
factor-script ?


--
-Regards,
Rajen Chatterjee.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141121/007c1f34/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 97, Issue 64
*********************************************

Tweet