Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. EMS error: you need to define GENERAL:input-sgm (Peter Kleiweg)
2. Re: EMS error: you need to define GENERAL:input-sgm
(Philipp Koehn)
3. Re: Restrict WordTranslationFeature to certain pairs
(Philipp Koehn)
----------------------------------------------------------------------
Message: 1
Date: Thu, 27 Feb 2014 15:51:33 +0100 (CET)
From: Peter Kleiweg <p.c.j.kleiweg@rug.nl>
Subject: [Moses-support] EMS error: you need to define
GENERAL:input-sgm
To: moses-support@mit.edu
Message-ID: <alpine.DEB.2.00.1402271544170.3190@pebbe>
Content-Type: TEXT/PLAIN; charset=US-ASCII
Hi,
I installed Moses, run through the steps in part 2 of the
manual, and got me a working translator.
Now I try to do the same using the Experiment Management System.
I copied the configuration file config.toy, fixed some settings,
and run script/ems/experiment.perl -config config.data
I get:
STEP SUMMARY:
64 CORPUS:toy:clean -> run
60 CORPUS:toy:truecase -> run
55 TRUECASER:consolidate -> run
54 TRUECASER:train -> run
52 LM:toy:truecase -> run
50 LM:toy:train -> run
47 LM:toy:binarize -> run
46 TRAINING:consolidate -> run
45 TRAINING:prepare-data -> run
44 TRAINING:run-giza -> run
43 TRAINING:run-giza-inverse -> run
42 TRAINING:symmetrize-giza -> run
41 TRAINING:build-lex-trans -> run
38 TRAINING:extract-phrases -> run
37 TRAINING:build-reordering -> run
36 TRAINING:build-ttable -> run
33 TRAINING:create-config -> run
27 TUNING:truecase-input -> run
25 TUNING:truecase-reference -> run
23 TUNING:filter -> run
22 TUNING:apply-filter -> run
21 TUNING:tune -> run
20 TUNING:apply-weights -> run
15 EVALUATION:test:truecase-input -> run
13 EVALUATION:test:filter -> run
12 EVALUATION:test:apply-filter -> run
11 EVALUATION:test:decode -> run
10 EVALUATION:test:remove-markup -> run
8 EVALUATION:test:detruecase-output -> run
6 EVALUATION:test:wrap -> run
4 EVALUATION:test:nist-bleu -> run
3 EVALUATION:test:nist-bleu-c -> run
2 EVALUATION:test:analysis -> run
1 EVALUATION:test:analysis-coverage -> run
0 REPORTING:report -> run
DEFINE STEPS (run with -exec if everything ok)
ERROR: you need to define GENERAL:input-sgm
I can't find any documentation about a GENERAL:input-sgm.
What do I do now?
Here is my configuration file:
http://www.let.rug.nl/~kleiweg/tmp/moses.config
--
Peter
------------------------------
Message: 2
Date: Thu, 27 Feb 2014 10:26:17 -0500
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] EMS error: you need to define
GENERAL:input-sgm
To: Peter Kleiweg <p.c.j.kleiweg@rug.nl>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDDu8O99N_o9vqMFyoE3XTk9HCvgRmWmTKf0+p5SDcPW1w@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Hi,
since you are using the NIST BLEU scoring tool, you need to provide
the following two files
[EVALUATION:test]
input-sgm = $data/test.$input-extension.sgm
reference-sgm = $data/test.$output-extension.sgm
If this is too much hassle for you, you can use multi-bleu instead of
nist-bleu, just note that
it relies on the tokenization used by your system, so changes in
tokenization will lead
to BLEU scores that are not comparable.
-phi
On Thu, Feb 27, 2014 at 9:51 AM, Peter Kleiweg <p.c.j.kleiweg@rug.nl> wrote:
>
> Hi,
>
> I installed Moses, run through the steps in part 2 of the
> manual, and got me a working translator.
>
> Now I try to do the same using the Experiment Management System.
> I copied the configuration file config.toy, fixed some settings,
> and run script/ems/experiment.perl -config config.data
>
> I get:
>
> STEP SUMMARY:
> 64 CORPUS:toy:clean -> run
> 60 CORPUS:toy:truecase -> run
> 55 TRUECASER:consolidate -> run
> 54 TRUECASER:train -> run
> 52 LM:toy:truecase -> run
> 50 LM:toy:train -> run
> 47 LM:toy:binarize -> run
> 46 TRAINING:consolidate -> run
> 45 TRAINING:prepare-data -> run
> 44 TRAINING:run-giza -> run
> 43 TRAINING:run-giza-inverse -> run
> 42 TRAINING:symmetrize-giza -> run
> 41 TRAINING:build-lex-trans -> run
> 38 TRAINING:extract-phrases -> run
> 37 TRAINING:build-reordering -> run
> 36 TRAINING:build-ttable -> run
> 33 TRAINING:create-config -> run
> 27 TUNING:truecase-input -> run
> 25 TUNING:truecase-reference -> run
> 23 TUNING:filter -> run
> 22 TUNING:apply-filter -> run
> 21 TUNING:tune -> run
> 20 TUNING:apply-weights -> run
> 15 EVALUATION:test:truecase-input -> run
> 13 EVALUATION:test:filter -> run
> 12 EVALUATION:test:apply-filter -> run
> 11 EVALUATION:test:decode -> run
> 10 EVALUATION:test:remove-markup -> run
> 8 EVALUATION:test:detruecase-output -> run
> 6 EVALUATION:test:wrap -> run
> 4 EVALUATION:test:nist-bleu -> run
> 3 EVALUATION:test:nist-bleu-c -> run
> 2 EVALUATION:test:analysis -> run
> 1 EVALUATION:test:analysis-coverage -> run
> 0 REPORTING:report -> run
>
> DEFINE STEPS (run with -exec if everything ok)
> ERROR: you need to define GENERAL:input-sgm
>
>
> I can't find any documentation about a GENERAL:input-sgm.
> What do I do now?
>
>
> Here is my configuration file:
>
> http://www.let.rug.nl/~kleiweg/tmp/moses.config
>
>
>
> --
> Peter
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
------------------------------
Message: 3
Date: Thu, 27 Feb 2014 10:38:31 -0500
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] Restrict WordTranslationFeature to
certain pairs
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAAFADDAKAqwYUBu4wHcTuveWG2LHDRQQL974zj9WWhVaKDALhg@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Hi,
no, but it also should not be too hard to add that to the code.
If you look at the Load() function, you see how the vocabulary lists
are loaded and in lines 172+ of Evaluate(...) you see how the
vocabulary items are used to replace all other words with OTHER.
You probably want some code in the "if (m_simple) {" section
that checks against an additional list that you provide.
-phi
On Tue, Feb 25, 2014 at 2:54 PM, Marcin Junczys-Dowmunt
<junczys@amu.edu.pl> wrote:
> Hi,
> Is there a non-programming way to restrict WordTranslationFeature to
> specific pairs rather than the complete product of two separate source
> and target word lists?
> Best,
> Marcin
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 88, Issue 64
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 88, Issue 64"
Post a Comment