Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. (no subject) (Arpita Dutta)
2. Problem in Tuning (Arpita Dutta)
3. Re: Output files of mgiza (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Mon, 13 Feb 2017 11:38:13 +0530
From: Arpita Dutta <duttaarpi@gmail.com>
Subject: [Moses-support] (no subject)
To: moses-support@mit.edu
Message-ID:
<CAKKUE23o_tx=ZxY57W7fFu8DPnVbxudUOnCn+HSmzjgp3HaHMQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi
I installed Moses on Ubuntu 14.10 and run the training corpus part
successfully with
the English-bengali corpus but now when I am running tuning command
I am getting the following error,
nits@cse:~/Desktop/ad/demo$
/home/nits/Desktop/ad/mosesdecoder/scripts/training/mert-moses.pl
/home/nits/Desktop/ad/demo/data/tuning.en
/home/nits/Desktop/ad/demo/data/tuning.ben
/home/nits/Desktop/ad/mosesdecoder/bin/moses
/home/nits/Desktop/ad/demo/model/moses.ini --working-dir
/home/nits/Desktop/ad/demo/tuning --rootdir
/home/nits/Desktop/ad/mosesdecoder/scripts
Using SCRIPTS_ROOTDIR: /home/nits/Desktop/ad/mosesdecoder/scripts
Assuming --mertdir=/home/nits/Desktop/ad/mosesdecoder/bin
Assuming the tables are already filtered, reusing filtered/moses.ini
Asking moses for feature names and values from filtered/moses.ini
Executing: /home/nits/Desktop/ad/mosesdecoder/bin/moses -config
filtered/moses.ini -inputtype 0 -show-weights
exec: /home/nits/Desktop/ad/mosesdecoder/bin/moses -config
filtered/moses.ini -inputtype 0 -show-weights
Executing: /home/nits/Desktop/ad/mosesdecoder/bin/moses -config
filtered/moses.ini -inputtype 0 -show-weights > ./features.list 2>
/dev/null
Exit code: 1
ERROR: Failed to run '/home/nits/Desktop/ad/mosesdecoder/bin/moses
-config filtered/moses.ini -inputtype 0 -show-weights'. at
/home/nits/Desktop/ad/mosesdecoder/scripts/training/mert-moses.pl line
1748.
nits@cse:~/Desktop/ad/demo$
/home/nits/Desktop/ad/mosesdecoder/bin/moses -f
/home/nits/Desktop/ad/demo/tuning/filtered/moses.ini -i
/home/nits/Desktop/ad/demo/tuning/filtered/input.14464
Defined parameters (per moses.ini or switch):
config: /home/nits/Desktop/ad/demo/tuning/filtered/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryMemory name=TranslationModel0 num-features=4
path=/home/nits/Desktop/ad/demo/tuning/filtered/phrase-table.0-0.1.1.gz
input-factor=0 output-factor=0 LexicalReordering
name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/nits/Desktop/ad/demo/tuning/filtered/reordering-table.wbe-msd-bidirectional-fe.0-0.1
Distortion IRSTLM name=LM0 factor=0
path=/home/nits/Desktop/ad/demo/lm/train.ilm.gz order=3
input-factors: 0
input-file: /home/nits/Desktop/ad/demo/tuning/filtered/input.14464
mapping: 0 T 0
weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3
0.3 0.3 Distortion0= 0.3 LM0= 0.5
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryMemory name=TranslationModel0 num-features=4
path=/home/nits/Desktop/ad/demo/tuning/filtered/phrase-table.0-0.1.1.gz
input-factor=0 output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/nits/Desktop/ad/demo/tuning/filtered/reordering-table.wbe-msd-bidirectional-fe.0-0.1
Initializing Lexical Reordering Feature..
FeatureFunction: LexicalReordering0 start: 7 end: 12
line=Distortion
FeatureFunction: Distortion0 start: 13 end: 13
line=IRSTLM name=LM0 factor=0
path=/home/nits/Desktop/ad/demo/lm/train.ilm.gz order=3
Exception: moses/FF/Factory.cpp:388 in void
Moses::FeatureRegistry::Construct(const string&, const string&) threw
UnknownFeatureException because `i == registry_.end()'.
Feature name IRSTLM is not registered.
Please help me.
Arpita Dutta
PhD Scholar
Nit Silchar
Assam-788010
India
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170213/7bd3f10e/attachment-0001.html
------------------------------
Message: 2
Date: Mon, 13 Feb 2017 11:40:38 +0530
From: Arpita Dutta <duttaarpi@gmail.com>
Subject: [Moses-support] Problem in Tuning
To: moses-support@mit.edu
Message-ID:
<CAKKUE21O=mKCSdYhctK5wGxmrTR7P1urbNyC5QgYG3sHB9Bsxw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi
I installed Moses on Ubuntu 14.10 and run the training corpus part
successfully with
the English-bengali corpus but now when I am running tuning command
I am getting the following error,
nits@cse:~/Desktop/ad/demo$
/home/nits/Desktop/ad/mosesdecoder/scripts/training/mert-moses.pl
/home/nits/Desktop/ad/demo/data/tuning.en
/home/nits/Desktop/ad/demo/data/tuning.ben
/home/nits/Desktop/ad/mosesdecoder/bin/moses
/home/nits/Desktop/ad/demo/model/moses.ini --working-dir
/home/nits/Desktop/ad/demo/tuning --rootdir
/home/nits/Desktop/ad/mosesdecoder/scripts
Using SCRIPTS_ROOTDIR: /home/nits/Desktop/ad/mosesdecoder/scripts
Assuming --mertdir=/home/nits/Desktop/ad/mosesdecoder/bin
Assuming the tables are already filtered, reusing filtered/moses.ini
Asking moses for feature names and values from filtered/moses.ini
Executing: /home/nits/Desktop/ad/mosesdecoder/bin/moses -config
filtered/moses.ini -inputtype 0 -show-weights
exec: /home/nits/Desktop/ad/mosesdecoder/bin/moses -config
filtered/moses.ini -inputtype 0 -show-weights
Executing: /home/nits/Desktop/ad/mosesdecoder/bin/moses -config
filtered/moses.ini -inputtype 0 -show-weights > ./features.list 2>
/dev/null
Exit code: 1
ERROR: Failed to run '/home/nits/Desktop/ad/mosesdecoder/bin/moses
-config filtered/moses.ini -inputtype 0 -show-weights'. at
/home/nits/Desktop/ad/mosesdecoder/scripts/training/mert-moses.pl line
1748.
nits@cse:~/Desktop/ad/demo$
/home/nits/Desktop/ad/mosesdecoder/bin/moses -f
/home/nits/Desktop/ad/demo/tuning/filtered/moses.ini -i
/home/nits/Desktop/ad/demo/tuning/filtered/input.14464
Defined parameters (per moses.ini or switch):
config: /home/nits/Desktop/ad/demo/tuning/filtered/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryMemory name=TranslationModel0 num-features=4
path=/home/nits/Desktop/ad/demo/tuning/filtered/phrase-table.0-0.1.1.gz
input-factor=0 output-factor=0 LexicalReordering
name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/nits/Desktop/ad/demo/tuning/filtered/reordering-table.wbe-msd-bidirectional-fe.0-0.1
Distortion IRSTLM name=LM0 factor=0
path=/home/nits/Desktop/ad/demo/lm/train.ilm.gz order=3
input-factors: 0
input-file: /home/nits/Desktop/ad/demo/tuning/filtered/input.14464
mapping: 0 T 0
weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3
0.3 0.3 Distortion0= 0.3 LM0= 0.5
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryMemory name=TranslationModel0 num-features=4
path=/home/nits/Desktop/ad/demo/tuning/filtered/phrase-table.0-0.1.1.gz
input-factor=0 output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/nits/Desktop/ad/demo/tuning/filtered/reordering-table.wbe-msd-bidirectional-fe.0-0.1
Initializing Lexical Reordering Feature..
FeatureFunction: LexicalReordering0 start: 7 end: 12
line=Distortion
FeatureFunction: Distortion0 start: 13 end: 13
line=IRSTLM name=LM0 factor=0
path=/home/nits/Desktop/ad/demo/lm/train.ilm.gz order=3
Exception: moses/FF/Factory.cpp:388 in void
Moses::FeatureRegistry::Construct(const string&, const string&) threw
UnknownFeatureException because `i == registry_.end()'.
Feature name IRSTLM is not registered.
Please help me.
Arpita Dutta
PhD Scholar
Nit Silchar
Assam-788010
India
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170213/7812fed1/attachment-0001.html
------------------------------
Message: 3
Date: Mon, 13 Feb 2017 11:41:15 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Output files of mgiza
To: Tom McCoy <richard.mccoy@yale.edu>, Moses-support@mit.edu
Message-ID: <5ec8d58a-71b4-5b5a-2af4-82beb8aa6b64@gmail.com>
Content-Type: text/plain; charset="windows-1252"
I'm not sure if there's any such thing as 'final' or 'actual.final'.
Your output seems to match the output from a typical run
http://www.statmt.org/moses/RELEASE-3.0/models/fr-en/training/giza.1/
The file 'A3.final' is used by the subsequent symmetrization step
On 11/02/2017 19:42, Tom McCoy wrote:
> Hi,
>
> I am using mgiza on Mac OSX. It runs without errors and gives the
> following output files:
>
> * 117-02-11.134300.tommccoy.A3.final.part000
> * 117-02-11.134300.tommccoy.A3.final.part001
> * 117-02-11.134300.tommccoy.A3.final.part002
> * 117-02-11.134300.tommccoy.A3.final.part003
> * 117-02-11.134300.tommccoy.Decoder.config
> * 117-02-11.134300.tommccoy.a3.final
> * 117-02-11.134300.tommccoy.d3.final
> * 117-02-11.134300.tommccoy.d4.final
> * 117-02-11.134300.tommccoy.gizacfg
> * 117-02-11.134300.tommccoy.n3.final
> * 117-02-11.134300.tommccoy.p0_3.final
> * 117-02-11.134300.tommccoy.perpt3.final
>
> However, this is missing the *.ti.final and *.actual.ti.final output
> files, both of which I need. Any thoughts on how to get these files to
> be outputted?
>
> Thanks!
> Tom McCoy
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Hieu Hoang
http://moses-smt.org/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170213/a7319754/attachment.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 124, Issue 13
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 124, Issue 13"
Post a Comment