Moses-support Digest, Vol 88, Issue 41

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Problem with MERT (cyrine.nasri@univ-lorraine.fr)
2. Re: Using FastAlign (Per Tunedal)
3. why compile moses with irstlm? (Viktor Pless)
4. Looking for users of Moses packages/pre-built binaries/VMs
(Achim Ruopp)


----------------------------------------------------------------------

Message: 1
Date: Tue, 18 Feb 2014 18:49:19 +0100
From: "cyrine.nasri@univ-lorraine.fr" <cyrine.nasri@gmail.com>
Subject: Re: [Moses-support] Problem with MERT
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAPg_V0g6mD60ptEhx=AVzqC37PD9+A_hXyTAz561nSGBhfTHrA@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Thank you Hieu fir your reply

Bests

Cyrine


2014-02-17 15:01 GMT+01:00 Hieu Hoang <Hieu.Hoang@ed.ac.uk>:

> hi cyrine
>
> yes, the format of the ini file has changed in the last year. However, the
> decoder still works the same.
>
> You've specified using SRILM but this libray wasn't linked into the
> decoder. Either
> 1. Change SRILM --> KENLM in the ini file
> 2. Recompile with srilm
> ./bjam --with-srilm=[path/to/srilm] -a ....
>
>
> On 17 February 2014 13:37, cyrine.nasri@univ-lorraine.fr <
> cyrine.nasri@gmail.com> wrote:
>
>>
>> Hello,
>>
>> I try to install Moses but i see that there is changes
>> I have a problem when i try to do MERT: with this command :
>>
>>
>> ./moses_chart -f /home/cyrine/mosesdecoder/working/model/moses.ini
>>
>>
>>
>> the ini config file is like this :
>>
>>
>> #########################
>> ### MOSES CONFIG FILE ###
>> #########################
>>
>> # input factors
>> [input-factors]
>> 0
>>
>> # mapping steps
>> [mapping]
>> 0 T 0
>>
>> [distortion-limit]
>> 6
>>
>> # feature functions
>> [feature]
>>
>>
>> PhrasePenalty
>>
>> PhraseDictionaryMemory name=TranslationModel0 table-limit=20
>> num-features=4 path=/home/cyrine/mosesdecoder/tools/model/phrase-table.gz
>> input-factor=0 output-factor=0
>>
>> Distortion
>>
>> SRILM name=LM0 factor=0 path=/home/cyrine/srilm/bin/i686-gcc4/ANG.lm
>> order=3
>>
>> # dense weights for feature functions
>> [weight]
>> UnknownWordPenalty0= 1
>> WordPenalty0= -1
>> PhrasePenalty0= 0.2
>> TranslationModel0= 0.2 0.2 0.2 0.2
>> Distortion0= 0.3
>> LM0= 0.5
>>
>>
>> But i get this error :
>> moses_chart -f /home/mosesdecoder/working/model/moses.ini
>> Defined parameters (per moses.ini or switch):
>> config: /home/cyrine/mosesdecoder/working/model/moses.ini
>> distortion-limit: 6
>> feature: PhrasePenalty PhraseDictionaryMemory name=TranslationModel0
>> table-limit=20 num-features=4
>> path=/home/cyrine/mosesdecoder/tools/model/phrase-table.gz input-factor=0
>> output-factor=0 Distortion SRILM name=LM0 factor=0
>> path=/home/cyrine/srilm/bin/i686-gcc4/ANG.lm order=3
>> input-factors: 0
>> mapping: 0 T 0
>> weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2
>> TranslationModel0= 0.2 0.2 0.2 0.2 Distortion0= 0.3 LM0= 0.5
>> .
>> line=PhrasePenalty
>> FeatureFunction: PhrasePenalty0 start: 0 end: 0
>> line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20
>> num-features=4 path=/home/cyrine/mosesdecoder/tools/model/phrase-table.gz
>> input-factor=0 output-factor=0
>> FeatureFunction: TranslationModel0 start: 1 end: 4
>> line=Distortion
>> FeatureFunction: Distortion0 start: 5 end: 5
>> line=SRILM name=LM0 factor=0 path=/home/cyrine/srilm/bin/i686-gcc4/ANG.lm
>> order=3
>> Exception: moses/FF/Factory.cpp:235 in void
>> Moses::FeatureRegistry::Construct(const string&, const string&) threw
>> UnknownFeatureException because `i == registry_.end()'.
>> Feature name SRILM is not registered.
>> Erreur de segmentation (core dumped)
>>
>> --
>>
>> Any idea please
>>
>> Thnk you in advance
>>
>>
>> *Cyrine*
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>


--

*Cyrine NASRIPh.D. Student in Computer Science*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140218/784adc5e/attachment-0001.htm

------------------------------

Message: 2
Date: Tue, 18 Feb 2014 20:32:11 +0100
From: Per Tunedal <per.tunedal@operamail.com>
Subject: Re: [Moses-support] Using FastAlign
To: Amin Farajian <ma.farajian@gmail.com>, moses-support@mit.edu
Message-ID:
<1392751931.11674.84936921.55058EAB@webmail.messagingengine.com>
Content-Type: text/plain; charset="us-ascii"

Dear Amin,
thank you very much. Now I've got what I need to get started.
Yours,
Per Tunedal

On Mon, Feb 17, 2014, at 22:14, Amin Farajian wrote:

Dear Per,
Seems that you have lots of questions that you've put question mark
even after your name. ;-)
The output that you got seems fine. All you need is to run the fast
aligner in two directions (forward and reverse; without and with -r
option) and get the symmetrized alignment using the perl script that
you can find it here:
mosesdecoder / scripts / ems / support / symmetrize-fast-align.perl

So, basically you just need to store the outputs of fast_align and
symmetrize them. Moses just needs this symmetrize word alignment to
extract the phrase table and other stuff.
I am pretty sure that in EMS there is the option for using fast_align
instead of (m)giza++, but since I don't use EMS, I don't know how you
can do it. You can take a look at the following page:
[1]http://www.statmt.org/moses/?n=FactoredTraining.EMS#ntoc13
It might help you in figuring out how to use it.

Enjoy your experiments,
Amin
On 02/17/2014 07:45 PM, Per Tunedal wrote:

Hi,
I've run Fast Align and got the output:

0-0 2-1
0-0 2-1 3-2 5-3
0-0 1-1 2-2 2-3
0-0 1-1 3-2 2-3 4-4 5-5 7-6 7-7
0-0 1-1 2-2
0-0 2-1
0-0 2-1 4-2 5-3
0-0 1-1 2-2 2-3
0-0 1-1 3-2 2-3 4-4 5-5 7-6 7-7
0-0 1-1 2-2

Fine, but there must be some other files somewhere, mustn't it? What
word is encoded as 4 etc? Where are the files saved? What are they? How
does Moses find them?

Yours,
Per Tunedal?
_______________________________________________
Moses-support mailing list
[2]Moses-support@mit.edu
[3]http://mailman.mit.edu/mailman/listinfo/moses-support

_______________________________________________

Moses-support mailing list

[4]Moses-support@mit.edu

[5]http://mailman.mit.edu/mailman/listinfo/moses-support

References

1. http://www.statmt.org/moses/?n=FactoredTraining.EMS#ntoc13
2. mailto:Moses-support@mit.edu
3. http://mailman.mit.edu/mailman/listinfo/moses-support
4. mailto:Moses-support@mit.edu
5. http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140218/60ffa508/attachment-0001.htm

------------------------------

Message: 3
Date: Wed, 19 Feb 2014 14:44:12 +0100
From: Viktor Pless <viktor.pless@gmail.com>
Subject: [Moses-support] why compile moses with irstlm?
To: moses-support@mit.edu
Message-ID:
<CAD3iPeHdhQXG9=vC_SEC0ianP99=eYzTZXegH-vELLyE9yLDxw@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi, what is the significance of the option of installing moses with IRSTLM?
I did not give the option "--with-irstlm=..." but it still seems to be
working.
with Thanks,
V
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140219/81627cee/attachment-0001.htm

------------------------------

Message: 4
Date: Wed, 19 Feb 2014 10:27:57 -0500
From: "Achim Ruopp" <achimru@gmail.com>
Subject: [Moses-support] Looking for users of Moses packages/pre-built
binaries/VMs
To: <moses-support@mit.edu>
Message-ID: <010a01cf2d87$2d879990$8896ccb0$@com>
Content-Type: text/plain; charset="us-ascii"

Hi,

For the MosesCore project we are looking for users of the available Moses
v1.0 and v2.1 packages: http://www.statmt.org/moses/?n=Moses.Packages

We are also interested in users of the pre-built binaries or VMs (v2.1) from
here: http://www.statmt.org/moses/?n=Moses.Releases



If you are willing to share your experience with using any of these, please
small 'r' to achim(at)taus.net indicating the package you are using.



Thanks in advance!

Achim Ruopp

TAUS



-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140219/5ec969b7/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 88, Issue 41
*********************************************

0 Response to "Moses-support Digest, Vol 88, Issue 41"

Post a Comment