Moses-support Digest, Vol 98, Issue 2

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. arabic -english parallel corpus UN (emna hkiri)
2. Running Moses with a compact lexical reordering (Massinissa Ahmim)
3. Re: Running Moses with a compact lexical reordering
(Marcin Junczys-Dowmunt)


----------------------------------------------------------------------

Message: 1
Date: Mon, 1 Dec 2014 13:44:45 +0100
From: emna hkiri <emna.hkiri@gmail.com>
Subject: [Moses-support] arabic -english parallel corpus UN
To: moses-support@mit.edu
Message-ID:
<CAAp-nZ2DKbhyMeaAS15jBzwY_5QdGYRqbm0GSmed9GPiA8nLog@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear Friends thank you a lot for your help before and i hope that you will
help me
again
i try to by?il an arabic-english smt with moses
but in the training Giza do not do the alignment it is because the corpus
UN ar-en is not cleaned ; they are not parallel ;they have not the same
number of lines. i'm working with 2000 directory (2000ar and 2000en). does
anyone worked with UN ar-en corpus???
i want to ask how to make the same number of lines for ar-en in 2000

thank you in advance i hope you will answer my question
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141201/ae5e3002/attachment-0001.htm

------------------------------

Message: 2
Date: Mon, 1 Dec 2014 16:14:50 +0100
From: Massinissa Ahmim <massinissa.ahmim@linguacustodia.com>
Subject: [Moses-support] Running Moses with a compact lexical
reordering
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CANN0mWYkMuENS2mWUoanBojcfh9sjUHBBGATTVBi_KkvdFFopA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear all,

I'm having troubles running moses with a compact lexical reordering table.

After sorting the initial table, I ran the following command :

/home/Moses/mosesdecoder/bin/processLexicalTableMin -in
reordering-table.sort -out reordering-table -threads 32

the process has been successfully completed so I've updated my moses.ini
file :

LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/train-deg
aulle-fren/training/model/reordering-table.minlexr


and ran moses like this :

/home/Moses/mosesdecoder/bin/moses -f moses2.ini -minlexr-memory

and I'm getting the following error :

....
line=LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
FeatureFunction: LexicalReordering0 start: 15 end: 20
Initializing LexicalReordering..
line=Distortion
FeatureFunction: Distortion0 start: 21 end: 21
line=KENLM lazyken=0 name=LM0 factor=0 path=/home/DATA/LM/Corps-lm.blm.en.mm
order=5
FeatureFunction: LM0 start: 22 end: 22
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading table into memory...Exception: vector::_M_range_check


Many thanks

Massinissa

--

[image: Description : Description : lingua_custodia_final full logo]

*The Translation Trustee*

*1, Place Charles de Gaulle*

*78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23 Mobile : +33 7 61 44 40 84*

*Email :* *massinissa.ahmim@linguacustodia.com
<massinissa.ahmim@linguacustodia.com>*

*Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
www.thetranslationtrustee.com <http://www.thetranslationtrustee.com>*

A Young Innovative Company recognised by the French Research Ministry and
Paris Finance Innovation cluster

[image: Logo labellis? FI small]
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141201/574793dd/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141201/574793dd/attachment-0002.jpg
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.jpg
Type: image/jpeg
Size: 2720 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141201/574793dd/attachment-0003.jpg

------------------------------

Message: 3
Date: Mon, 01 Dec 2014 16:17:54 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Running Moses with a compact lexical
reordering
To: moses-support@mit.edu
Message-ID: <547C86A2.3010003@amu.edu.pl>
Content-Type: text/plain; charset="windows-1252"

Hi,
try removing the ".minlexr" suffix from the ini file. Does it work after
that?

W dniu 01.12.2014 o 16:14, Massinissa Ahmim pisze:
> Dear all,
>
> I'm having troubles running moses with a compact lexical reordering
> table.
>
> After sorting the initial table, I ran the following command :
>
> /home/Moses/mosesdecoder/bin/processLexicalTableMin -in
> reordering-table.sort -out reordering-table -threads 32
>
> the process has been successfully completed so I've updated my
> moses.ini file :
>
> LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/train-deg
> aulle-fren/training/model/reordering-table.minlexr
>
>
> and ran moses like this :
>
> /home/Moses/mosesdecoder/bin/moses -f moses2.ini -minlexr-memory
>
> and I'm getting the following error :
>
> ....
> line=LexicalReordering name=LexicalReordering0 num-features=6
> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/train-degaulle-fren/training/model/reordering-table.minlexr
> FeatureFunction: LexicalReordering0 start: 15 end: 20
> Initializing LexicalReordering..
> line=Distortion
> FeatureFunction: Distortion0 start: 21 end: 21
> line=KENLM lazyken=0 name=LM0 factor=0
> path=/home/DATA/LM/Corps-lm.blm.en.mm <http://Corps-lm.blm.en.mm> order=5
> FeatureFunction: LM0 start: 22 end: 22
> Loading UnknownWordPenalty0
> Loading WordPenalty0
> Loading PhrasePenalty0
> Loading LexicalReordering0
> Loading table into memory...Exception: vector::_M_range_check
>
>
> Many thanks
>
> Massinissa
>
> --
>
> Description : Description : lingua_custodia_final full logo
>
> */The Translation Trustee/*
>
> *1, Place Charles de Gaulle*
>
> *78180 Montigny-le-Bretonneux*
>
> *Tel : +33 1 30 44 04 23 Mobile : +33 7 61 44 40 84*
>
> *Email :****massinissa.ahmim@linguacustodia.com
> <mailto:massinissa.ahmim@linguacustodia.com>***
>
> *Website :****www.linguacustodia.com
> <http://www.linguacustodia.com/> - www.thetranslationtrustee.com
> <http://www.thetranslationtrustee.com>*
>
> A Young Innovative Company recognised by the French Research Ministry
> and Paris Finance Innovation cluster
>
> Logo labellis? FI small
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141201/939a120e/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141201/939a120e/attachment.jpg
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 2720 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141201/939a120e/attachment-0001.jpg

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 98, Issue 2
********************************************

Tweet