Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: EMS: add additional steps to a finished run (Nicholas Ruiz)
2. EMS: add additional steps to a finished run (Vincent Nguyen)
3. Re: EMS: add additional steps to a finished run (Matthias Huck)
4. Re: Baseline: Problem with tuned weights (Marwa Refaie)
----------------------------------------------------------------------
Message: 1
Date: Fri, 8 Jan 2016 12:16:43 -0500
From: Nicholas Ruiz <nicruiz@fbk.eu>
Subject: Re: [Moses-support] EMS: add additional steps to a finished
run
To: Tomasz Dwojak <t.dwojak@amu.edu.pl>, moses-support@mit.edu
Message-ID:
<CAKa+0YMJbgnGpJPx5BTff9UDhbeg9NDTCUibE_ns5QJjZOudjQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Thanks, Tomasz. Unfortunately modifying the config file in the steps
directory didn't work for me. My block looks something like this:
[EVALUATION:test4]
tokenized-input = /path/to/test4.tok.$input-extension
tokenized-output = /path/to/test4.tok.$output-extension
wrapping-frame = $tokenized-input
z?n? ???u
On Fri, Jan 8, 2016 at 12:11 PM, Tomasz Dwojak <t.dwojak@amu.edu.pl> wrote:
> Hi Nick,
>
> there is a way to do that.
>
> In your working directory is a "steps" directory, where the EMS writes
> outputs, etc... There is also the copy of the config file (e.g.
> steps/1/config.1). You have to edit this file and then run EMS once again.
>
> Shortly:
> 1. Edit steps/1/config.1
> 2. run experiment.perl -continue 1
>
> Best,
> Tomasz
>
> On 08.01.2016 17:45, Nicholas Ruiz wrote:
>
> Hi all,
>
> I have a few different experiments that have finished training. Let's say
> I have versions 0 1 2 3. I'd like to translate/evaluate an additional test
> set. I added another [EVALUATION:...] block to specify the paths of the
> eval data and now I'd like to run it with
>
> experiment.perl -config config.1 -continue 1
>
> However, the steps for evaluating the new test set aren't in the list of
> steps. What's the best way to run this test without having to create
> another experiment folder?
>
> Thanks,
> Nick
>
> z?n? ???u
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160108/e12a9ea1/attachment-0001.html
------------------------------
Message: 2
Date: Fri, 8 Jan 2016 18:41:27 +0100
From: Vincent Nguyen <vnguyen@neuf.fr>
Subject: [Moses-support] EMS: add additional steps to a finished run
To: Nicholas Ruiz <nicruiz@fbk.eu>, Tomasz Dwojak
<t.dwojak@amu.edu.pl>, moses-support@mit.edu
Message-ID: <568FF4C7.60700@neuf.fr>
Content-Type: text/plain; charset="utf-8"
did you add -exec at the end (behind -continue 1) ?
Le 08/01/2016 18:16, Nicholas Ruiz a ?crit :
> Thanks, Tomasz. Unfortunately modifying the config file in the steps
> directory didn't work for me. My block looks something like this:
>
> [EVALUATION:test4]
>
> tokenized-input = /path/to/test4.tok.$input-extension
> tokenized-output = /path/to/test4.tok.$output-extension
> wrapping-frame = $tokenized-input
>
> z?n? ???u
>
> On Fri, Jan 8, 2016 at 12:11 PM, Tomasz Dwojak <t.dwojak@amu.edu.pl
> <mailto:t.dwojak@amu.edu.pl>> wrote:
>
> Hi Nick,
>
> there is a way to do that.
>
> In your working directory is a "steps" directory, where the EMS
> writes outputs, etc... There is also the copy of the config file
> (e.g. steps/1/config.1). You have to edit this file and then run
> EMS once again.
>
> Shortly:
> 1. Edit steps/1/config.1
> 2. run experiment.perl -continue 1
>
> Best,
> Tomasz
>
> On 08.01.2016 17:45, Nicholas Ruiz wrote:
>> Hi all,
>>
>> I have a few different experiments that have finished training.
>> Let's say I have versions 0 1 2 3. I'd like to translate/evaluate
>> an additional test set. I added another [EVALUATION:...] block to
>> specify the paths of the eval data and now I'd like to run it with
>>
>> experiment.perl -config config.1 -continue 1
>>
>> However, the steps for evaluating the new test set aren't in the
>> list of steps. What's the best way to run this test without
>> having to create another experiment folder?
>>
>> Thanks,
>> Nick
>>
>> z?n? ???u
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160108/c4282457/attachment-0001.html
------------------------------
Message: 3
Date: Fri, 08 Jan 2016 17:47:56 +0000
From: Matthias Huck <mhuck@inf.ed.ac.uk>
Subject: Re: [Moses-support] EMS: add additional steps to a finished
run
To: Nicholas Ruiz <nicruiz@fbk.eu>
Cc: moses-support@mit.edu
Message-ID: <1452275276.2708.37.camel@portedgar>
Content-Type: text/plain; charset="UTF-8"
Hi Nick,
What you're attempting to do should generally be no problem. There's
most likely some issue with your EMS configuration file. Doesn't it tell
you something like:
BUGGY CONFIG LINE (474): wrapping-frame = $tokenized-input
I get this when I put two spaces between "wrapping-frame" and "=".
Also, is /path/to/test4.tok.$output-extension some pre-translated
hypothesis? If it's the reference, you might have to specify it as
"tokenized-reference" rather than as "tokenized-output".
Cheers,
Matthias
On Fri, 2016-01-08 at 12:16 -0500, Nicholas Ruiz wrote:
> Thanks, Tomasz. Unfortunately modifying the config file in the steps
> directory didn't work for me. My block looks something like this:
>
> [EVALUATION:test4]
>
> tokenized-input = /path/to/test4.tok.$input-extension
> tokenized-output = /path/to/test4.tok.$output-extension
> wrapping-frame = $tokenized-input
>
> z?n? ???u
>
> On Fri, Jan 8, 2016 at 12:11 PM, Tomasz Dwojak <t.dwojak@amu.edu.pl> wrote:
>
> > Hi Nick,
> >
> > there is a way to do that.
> >
> > In your working directory is a "steps" directory, where the EMS writes
> > outputs, etc... There is also the copy of the config file (e.g.
> > steps/1/config.1). You have to edit this file and then run EMS once again.
> >
> > Shortly:
> > 1. Edit steps/1/config.1
> > 2. run experiment.perl -continue 1
> >
> > Best,
> > Tomasz
> >
> > On 08.01.2016 17:45, Nicholas Ruiz wrote:
> >
> > Hi all,
> >
> > I have a few different experiments that have finished training. Let's say
> > I have versions 0 1 2 3. I'd like to translate/evaluate an additional test
> > set. I added another [EVALUATION:...] block to specify the paths of the
> > eval data and now I'd like to run it with
> >
> > experiment.perl -config config.1 -continue 1
> >
> > However, the steps for evaluating the new test set aren't in the list of
> > steps. What's the best way to run this test without having to create
> > another experiment folder?
> >
> > Thanks,
> > Nick
> >
> > z?n? ???u
> >
> >
> > _______________________________________________
> > Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
> >
> >
> >
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
------------------------------
Message: 4
Date: Fri, 8 Jan 2016 17:55:21 +0000
From: Marwa Refaie <basmallah@hotmail.com>
Subject: Re: [Moses-support] Baseline: Problem with tuned weights
To: Hieu Hoang <hieuhoang@gmail.com>, Raphael H?ps
<raphael.hoeps@gmx.net>, Moses <moses-support@mit.edu>
Message-ID: <DUB112-W185062B776DD3D8EFE9A5FBAF60@phx.gbl>
Content-Type: text/plain; charset="iso-8859-1"
Tuning was always gave better BLEU score by~8 points or more , suddenly now tune step (MERT) gives degradded BLEU score starting from iterration 1 till the last one !!!!
Marwa N. Refaie
To: raphael.hoeps@gmx.net; moses-support@mit.edu
From: hieuhoang@gmail.com
Date: Wed, 6 Jan 2016 17:33:22 +0000
Subject: Re: [Moses-support] Baseline: Problem with tuned weights
are you sure you got the source and target side of the tuning set
the right way round?
And the tuning set must be tokenized and lowercase/truecased EXACTLY
the same way that you tokenized & lowercaseed/truecased the
training data
On 04/01/16 17:16, Raphael H?ps wrote:
Hello,
I did the moses-baseline tutorial to train and tune and
translation model for English to German. After finishing the
system it seemed to work quite well at first but then I noticed
that the tuning step seemed to actually having made my system
worse! I really don't know what I did wrong. I sticked very close
to the tutorial. Here is what I did in detail:
1. Training the TM to working/train/model.
2. Tuning with a corpus that is a cut-down version of
news-test2008. The main result of this process are the weights of
the new file mert-work/moses.ini, right?
3. Filtering of mert-work/moses.ini to a testing corpus (cut-down
version of newstest2011).
4. Translating the testing corpus and calculating BLEU-score. I
got a score of 7.42.
5. In a second test I used the default moses.ini file instead of
the tuned one (and the same filtered and binarized model) and got
a score of 8.22 on the same testing corpus!
Something is probably wrong with the tuned moses.ini file. To find
out, I translated the corpus that was used for tuning with both
ini-files and calculated the scores:
Untuned: 7.01
Tuned: 6.70 (!)
Now this is really odd! Furthermore in the tuned moses.ini file
there is the line:
# BLEU 0.0755253 on dev
/home/rh/Studium/aktuell/LSS/moses/mosesdecoder/corpus/dev-small.en
Why do I get a score of 6.7 instead? The files dev-small.en and
dev-small.de where my tuning corpora.
Do you have any idea, what I might have done wrong?
For the tuning step, I used:
cd ~/working
nohup nice ~/mosesdecoder/scripts/training/mert-moses.pl \
~/corpus/dev-small.en ~/corpus/dev-small.de \
~/mosesdecoder/bin/moses train/model/moses.ini --mertdir
~/mosesdecoder/bin/ \ &> mert.out &
I appended mert.log and the tune moses.ini file. Did anyone ever
build a system for English to German and can say something about
the trained weights in moses.ini? Do they seem okay?
Thank you very much for your help!
Greetings,
Raphi
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
--
Hieu Hoang
http://www.hoang.co.uk/hieu
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160108/306ad130/attachment.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 111, Issue 10
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 111, Issue 10"
Post a Comment