Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Problem in Translation (fatma elzahraa Eltaher)
2. Errors while running phrase based tutorial from Moses manual
(Sudip Mahajan)
3. Re: EMS help (Barry Haddow)
4. Re: EMS help (Vincent Nguyen)
----------------------------------------------------------------------
Message: 1
Date: Mon, 27 Jul 2015 22:40:12 +0200
From: fatma elzahraa Eltaher <fatmaeltaher@gmail.com>
Subject: [Moses-support] Problem in Translation
To: moses-support@mit.edu
Message-ID:
<CAOW1BbSj8iGcSd-2OB0QOE62TSAh63rYaasYZjbf7oi+zDb5LA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Dear All,
I found the attached error files in working folder after trying to build
model . is that means that the model is not build or it is there error in
it.
thank you,
Fatma El-Zahraa El -Taher
Teaching Assistant at Computer & System department
Faculty of Engineering, Azhar University
Email : fatmaeltaher@gmail.com
mobile: +201141600434
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150727/88a38371/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: extract.err
Type: application/octet-stream
Size: 476 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150727/88a38371/attachment-0005.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: filterphrases.err
Type: application/octet-stream
Size: 1257 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150727/88a38371/attachment-0006.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run1.extract.err
Type: application/octet-stream
Size: 475 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150727/88a38371/attachment-0007.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run2.extract.err
Type: application/octet-stream
Size: 476 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150727/88a38371/attachment-0008.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run3.extract.err
Type: application/octet-stream
Size: 476 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150727/88a38371/attachment-0009.obj
------------------------------
Message: 2
Date: Tue, 28 Jul 2015 13:36:14 +0530
From: Sudip Mahajan <sudipcmahajan@gmail.com>
Subject: [Moses-support] Errors while running phrase based tutorial
from Moses manual
To: Moses-support@mit.edu
Message-ID:
<CAEth75ug75SrN6S3jdz5ehBrhyDscL=iZDFjNnGp_-3wQVyqEQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hello I want to run the following command with moses
%train-model.perl \
--root-dir unfactored \
--corpus factored-corpus/proj-syndicate \
--f de --e en \
--lm 0:3:factored-corpus/surface.lm:0 \
--external-bin-dir .../tools \
--input-factor-max 4
This creates a moses.ini file but the POS table created in
"unfactored/phrase-table.o-o.gz" come sout to be empty.
Also
After running the following script for mert tuning:
#!/bin/bash
myPATH="/media/sudip/linuxdata1"
###Tuning moses.ini, cd to working directory
nohup nice $myPATH/mosesdecoder/scripts/training/mert-moses.pl \
$myPATH/working/tuningcorpus/prepared-corpus/news-test2008.clean.fr \
$myPATH/working/tuningcorpus/prepared-corpus/news-test2008.clean.en \
$myPATH/mosesdecoder/bin/moses \
$myPATH/working/train/model/moses.ini \
--mertdir $myPATH/working/train/model/mert \
--decoder-flags='-threads 3' >& mert.out &
My mert.out shows the following error:
sudip@sudip-pc:/media/sudip/linuxdata1/working$ cat mert.out
tune.sh: line 9: /media/sudip/linuxdata1/working/train/model/moses.ini:
Permission denied
Why is this happening?/
Thanks..
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150728/e0fc7b81/attachment-0001.htm
------------------------------
Message: 3
Date: Tue, 28 Jul 2015 09:25:07 +0100
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] EMS help
To: Vincent Nguyen <vnguyen@neuf.fr>, moses-support
<moses-support@mit.edu>
Message-ID: <55B73C63.4090206@staffmail.ed.ac.uk>
Content-Type: text/plain; charset=windows-1252; format=flowed
Hi Vincent
> 2 bugs report :
> in the LM Corpus definition for Europarl : the $pair-extension is
> missing before .$output-extension
> in the step 5 (maybe for others too) generation of the moses.tuned.ini.5
> file there is a missing ".gz" at the end of phrase-table.5
> in the PhraseDictionaryMemory definition.
These seem OK to me. For europarl, it points to the monolingual corpus,
and for the phrase table the .gz is implicitly added. Did they not work
for you?
> in my working directory I have 2 subdir,
> "tuning" with inside moses.filtered.ini.5 moses.ini.5 moses.tuned.ini.5
> and
> "model" with inside moses.ini.5 (apparently this one does not have the
> tuned weights)
>
> those in the tuning subdir : the "tuned" one moses.tuned.ini.5 generated
> after the moses.ini.5 seems to point on phrase-table.5.gz not binarized
> and the moses.5.ini seem to point on the binarized within
> tuning/filtered.5/...
> unclear to me on which one I should use.
If you run EMS, there will be a filtered ini file inside the evaluation
directory which can be used to translate the test set using the tuned
weights. However this model is filtered for the test set, so you cannot
use it on other sentences.
If you want the full model binarised, then you should add:
binarize-all = $moses-script-dir/training/binarize-model.perl
to the [GENERAL] section of the EMS config and rerun EMS. In this case
the moses.tuned.ini in tuning can be used to translate any sentences.
> I tried to remove the "IGNORE" for the Interpolated-LM section
> I am still using KenLM.
> BUT I get a message saying I need to define srilm-dir
> is SRILM mandatory to turn on the interpolated-lm with KenLM only ?
That's right, the interpolated LM uses some code from SRILM. You can
still use KenLM to create the individual language models, and use KenLM
during decoding,
cheers - Barry
On 26/07/15 08:36, Vincent Nguyen wrote:
> Hi,
>
> I worked with the config.basic file
>
> 2 bugs report :
> in the LM Corpus definition for Europarl : the $pair-extension is
> missing before .$output-extension
> in the step 5 (maybe for others too) generation of the moses.tuned.ini.5
> file there is a missing ".gz" at the end of phrase-table.5
> in the PhraseDictionaryMemory definition.
>
> Then questions :
>
> in my working directory I have 2 subdir,
> "tuning" with inside moses.filtered.ini.5 moses.ini.5 moses.tuned.ini.5
> and
> "model" with inside moses.ini.5 (apparently this one does not have the
> tuned weights)
>
> those in the tuning subdir : the "tuned" one moses.tuned.ini.5 generated
> after the moses.ini.5 seems to point on phrase-table.5.gz not binarized
> and the moses.5.ini seem to point on the binarized within
> tuning/filtered.5/...
>
> unclear to me on which one I should use.
>
>
> Last question :
> I tried to remove the "IGNORE" for the Interpolated-LM section
> I am still using KenLM.
> BUT I get a message saying I need to define srilm-dir
> is SRILM mandatory to turn on the interpolated-lm with KenLM only ?
>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
------------------------------
Message: 4
Date: Tue, 28 Jul 2015 11:18:34 +0200
From: Vincent Nguyen <vnguyen@neuf.fr>
Subject: Re: [Moses-support] EMS help
To: Barry Haddow <bhaddow@staffmail.ed.ac.uk>, moses-support
<moses-support@mit.edu>
Message-ID: <55B748EA.1070009@neuf.fr>
Content-Type: text/plain; charset=windows-1252; format=flowed
Thanks Barry. Answers and other questions below.
Le 28/07/2015 10:25, Barry Haddow a ?crit :
> Hi Vincent
>
>> 2 bugs report :
>> in the LM Corpus definition for Europarl : the $pair-extension is
>> missing before .$output-extension
>> in the step 5 (maybe for others too) generation of the moses.tuned.ini.5
>> file there is a missing ".gz" at the end of phrase-table.5
>> in the PhraseDictionaryMemory definition.
> These seem OK to me. For europarl, it points to the monolingual
> corpus, and for the phrase table the .gz is implicitly added. Did they
> not work for you?
I am NOT talking about the [CORPUS:europarl] section but
the [LM:europarl] I think in this section you need the $pair-extension
same as [LM:nc] where it was fine
Anyway :yes I had an error
Also : when.gz is missing yes it stops and give an error message.
>
>> in my working directory I have 2 subdir,
>> "tuning" with inside moses.filtered.ini.5 moses.ini.5 moses.tuned.ini.5
>> and
>> "model" with inside moses.ini.5 (apparently this one does not have the
>> tuned weights)
>>
>> those in the tuning subdir : the "tuned" one moses.tuned.ini.5 generated
>> after the moses.ini.5 seems to point on phrase-table.5.gz not binarized
>> and the moses.5.ini seem to point on the binarized within
>> tuning/filtered.5/...
>> unclear to me on which one I should use.
> If you run EMS, there will be a filtered ini file inside the
> evaluation directory which can be used to translate the test set using
> the tuned weights. However this model is filtered for the test set, so
> you cannot use it on other sentences.
>
> If you want the full model binarised, then you should add:
>
> binarize-all = $moses-script-dir/training/binarize-model.perl
>
> to the [GENERAL] section of the EMS config and rerun EMS. In this case
> the moses.tuned.ini in tuning can be used to translate any sentences.
ok will do.
>
>> I tried to remove the "IGNORE" for the Interpolated-LM section
>> I am still using KenLM.
>> BUT I get a message saying I need to define srilm-dir
>> is SRILM mandatory to turn on the interpolated-lm with KenLM only ?
> That's right, the interpolated LM uses some code from SRILM. You can
> still use KenLM to create the individual language models, and use
> KenLM during decoding,
OK. But related question :
If I do not interpolate, and if I keep the 2 (or more) LM in the
moses.ini file
does the decoder work similarly as if I had interpolated 2 LMs ?
>
> cheers - Barry
>
> On 26/07/15 08:36, Vincent Nguyen wrote:
>> Hi,
>>
>> I worked with the config.basic file
>>
>> 2 bugs report :
>> in the LM Corpus definition for Europarl : the $pair-extension is
>> missing before .$output-extension
>> in the step 5 (maybe for others too) generation of the moses.tuned.ini.5
>> file there is a missing ".gz" at the end of phrase-table.5
>> in the PhraseDictionaryMemory definition.
>>
>> Then questions :
>>
>> in my working directory I have 2 subdir,
>> "tuning" with inside moses.filtered.ini.5 moses.ini.5 moses.tuned.ini.5
>> and
>> "model" with inside moses.ini.5 (apparently this one does not have the
>> tuned weights)
>>
>> those in the tuning subdir : the "tuned" one moses.tuned.ini.5 generated
>> after the moses.ini.5 seems to point on phrase-table.5.gz not binarized
>> and the moses.5.ini seem to point on the binarized within
>> tuning/filtered.5/...
>>
>> unclear to me on which one I should use.
>>
>>
>> Last question :
>> I tried to remove the "IGNORE" for the Interpolated-LM section
>> I am still using KenLM.
>> BUT I get a message saying I need to define srilm-dir
>> is SRILM mandatory to turn on the interpolated-lm with KenLM only ?
>>
>>
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 105, Issue 59
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 105, Issue 59"
Post a Comment