Moses-support Digest, Vol 124, Issue 14

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Problem in tuning:Feature name IRSTLM is not registered.
(Arpita Dutta)
2. CALL FOR PARTICIPATION : MMT17 (Lo?c BARRAULT)
3. Re: Output files of mgiza (Tom McCoy)


----------------------------------------------------------------------

Message: 1
Date: Mon, 13 Feb 2017 19:07:39 +0530
From: Arpita Dutta <duttaarpi@gmail.com>
Subject: [Moses-support] Problem in tuning:Feature name IRSTLM is not
registered.
To: moses-support@mit.edu
Message-ID:
<CAKKUE206cEder9T+h9xABPiC94yA6jTeUggAk-UtzYgzfypcgw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

I installed Moses on Ubuntu 14.10 and run the training corpus part
successfully with
the English-bengali corpus but now when I am running tuning command
I am getting the following error,


nits@cse:~/Desktop/ad/demo$
/home/nits/Desktop/ad/mosesdecoder/scripts/training/mert-moses.pl
/home/nits/Desktop/ad/demo/data/tuning.en
/home/nits/Desktop/ad/demo/data/tuning.ben
/home/nits/Desktop/ad/mosesdecoder/bin/moses
/home/nits/Desktop/ad/demo/model/moses.ini --working-dir
/home/nits/Desktop/ad/demo/tuning --rootdir
/home/nits/Desktop/ad/mosesdecoder/scripts
Using SCRIPTS_ROOTDIR: /home/nits/Desktop/ad/mosesdecoder/scripts
Assuming --mertdir=/home/nits/Desktop/ad/mosesdecoder/bin
Assuming the tables are already filtered, reusing filtered/moses.ini
Asking moses for feature names and values from filtered/moses.ini
Executing: /home/nits/Desktop/ad/mosesdecoder/bin/moses -config
filtered/moses.ini -inputtype 0 -show-weights
exec: /home/nits/Desktop/ad/mosesdecoder/bin/moses -config
filtered/moses.ini -inputtype 0 -show-weights
Executing: /home/nits/Desktop/ad/mosesdecoder/bin/moses -config
filtered/moses.ini -inputtype 0 -show-weights > ./features.list 2>
/dev/null
Exit code: 1
ERROR: Failed to run '/home/nits/Desktop/ad/mosesdecoder/bin/moses
-config filtered/moses.ini -inputtype 0 -show-weights'. at
/home/nits/Desktop/ad/mosesdecoder/scripts/training/mert-moses.pl line
1748.

nits@cse:~/Desktop/ad/demo$
/home/nits/Desktop/ad/mosesdecoder/bin/moses -f
/home/nits/Desktop/ad/demo/tuning/filtered/moses.ini -i
/home/nits/Desktop/ad/demo/tuning/filtered/input.14464
Defined parameters (per moses.ini or switch):
config: /home/nits/Desktop/ad/demo/tuning/filtered/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryMemory name=TranslationModel0 num-features=4
path=/home/nits/Desktop/ad/demo/tuning/filtered/phrase-table.0-0.1.1.gz
input-factor=0 output-factor=0 LexicalReordering
name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/nits/Desktop/ad/demo/tuning/filtered/reordering-table.wbe-msd-bidirectional-fe.0-0.1
Distortion IRSTLM name=LM0 factor=0
path=/home/nits/Desktop/ad/demo/lm/train.ilm.gz order=3
input-factors: 0
input-file: /home/nits/Desktop/ad/demo/tuning/filtered/input.14464
mapping: 0 T 0
weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2 LexicalReordering0= 0.3 0.3 0.3 0.3
0.3 0.3 Distortion0= 0.3 LM0= 0.5
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryMemory name=TranslationModel0 num-features=4
path=/home/nits/Desktop/ad/demo/tuning/filtered/phrase-table.0-0.1.1.gz
input-factor=0 output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/nits/Desktop/ad/demo/tuning/filtered/reordering-table.wbe-msd-bidirectional-fe.0-0.1
Initializing Lexical Reordering Feature..
FeatureFunction: LexicalReordering0 start: 7 end: 12
line=Distortion
FeatureFunction: Distortion0 start: 13 end: 13
line=IRSTLM name=LM0 factor=0
path=/home/nits/Desktop/ad/demo/lm/train.ilm.gz order=3
Exception: moses/FF/Factory.cpp:388 in void
Moses::FeatureRegistry::Construct(const string&, const string&) threw
UnknownFeatureException because `i == registry_.end()'.
Feature name IRSTLM is not registered.


Please help me.

Arpita Dutta

PhD Scholar

Nit Silchar

Assam-788010

India
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170213/3a7b3409/attachment-0001.html

------------------------------

Message: 2
Date: Mon, 13 Feb 2017 09:51:58 -0500
From: Lo?c BARRAULT <loic.barrault@univ-lemans.fr>
Subject: [Moses-support] CALL FOR PARTICIPATION : MMT17
To: WMT_tasks <wmt-tasks@googlegroups.com>, MT_LIST
<mt-list@eamt.org>, MOSES <moses-support@mit.edu>, CORPORA
<corpora@uib.no>
Message-ID: <0F13AE08-B755-4D80-8E5A-98C1C1C8B16B@univ-lemans.fr>
Content-Type: text/plain; charset="utf-8"

CALL FOR PARTICIPATION

** WMT 2017 Second Shared Task on Multimodal Machine Translation **

We kindly invite researchers from Computer Vision and Natural Language Processing to participate in this challenge which is part the of Second Conference on Machine Translation WMT17 shared tasks.

This challenge comprises two tasks:
* Multimodal machine translation: participants are asked to translate an English source sentence into German or French with the help of the image described by the source sentence.
* Multilingual image description: participants are asked to generate a description of an image in German with the help of English descriptions.

A baseline system based on Nematus is available on the evaluation campaign website.

The Second Conference on Machine Translation will be colocated with EMNLP 2017 in Copenhagen, September 7-11.
Check the website for more details: http://www.statmt.org/wmt17/multimodal-task.html <http://www.statmt.org/wmt17/multimodal-task.html>

Important dates :

Release of training data ??. 8 February 2017 [done]
Release of test data ???... 10 April 2017
Translation submission ??.. 6 May 2017
Paper submission ????... 2 June 2017
Notification ???????... 30 June 2017
Camera-ready deadline ??. 14 July 2017
Workshop ????????. 7/8 September 2017

Lo?c Barrault on behalf of the organisation committee of MMT'17

--
Lo?c Barrault
LIUM - University of Le Mans, France
Team Language and Speech Technology
Avenue La?nnec, 72085 Le Mans Cedex 9
http://www-lium.univ-lemans.fr/~barrault

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170213/a2bebaf1/attachment-0001.html

------------------------------

Message: 3
Date: Mon, 13 Feb 2017 11:46:27 -0500
From: Tom McCoy <richard.mccoy@yale.edu>
Subject: Re: [Moses-support] Output files of mgiza
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAF=ri2+VO3zH+WuzbWOCnLrp5-Z89z_YrFzPUUkaKtr7gNGNCQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thanks for the quick reply! What I mostly want is the translation
probabilities that are learned for IBM Model 1--e.g., the probability
that *hello
*will be aligned with *bonjour, *i.e. t(*hello*|*bonjour*). In Giza++, at
least, these probabilities are given in output files called *ti.final or
*ti.actual.final. These files are discussed on slide 30 of this
presentation:
https://www.cse.iitb.ac.in/~anoopk/publications/presentations/moses_giza_intro.pdf
Is there any way to access these files in mgiza?

On Mon, Feb 13, 2017 at 6:41 AM, Hieu Hoang <hieuhoang@gmail.com> wrote:

> I'm not sure if there's any such thing as 'final' or 'actual.final'. Your
> output seems to match the output from a typical run
>
> http://www.statmt.org/moses/RELEASE-3.0/models/fr-en/training/giza.1/
>
> The file 'A3.final' is used by the subsequent symmetrization step
>
> On 11/02/2017 19:42, Tom McCoy wrote:
>
> Hi,
>
> I am using mgiza on Mac OSX. It runs without errors and gives the
> following output files:
>
> - 117-02-11.134300.tommccoy.A3.final.part000
> - 117-02-11.134300.tommccoy.A3.final.part001
> - 117-02-11.134300.tommccoy.A3.final.part002
> - 117-02-11.134300.tommccoy.A3.final.part003
> - 117-02-11.134300.tommccoy.Decoder.config
> - 117-02-11.134300.tommccoy.a3.final
> - 117-02-11.134300.tommccoy.d3.final
> - 117-02-11.134300.tommccoy.d4.final
> - 117-02-11.134300.tommccoy.gizacfg
> - 117-02-11.134300.tommccoy.n3.final
> - 117-02-11.134300.tommccoy.p0_3.final
> - 117-02-11.134300.tommccoy.perpt3.final
>
> However, this is missing the *.ti.final and *.actual.ti.final output
> files, both of which I need. Any thoughts on how to get these files to be
> outputted?
>
> Thanks!
> Tom McCoy
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> --
> Hieu Hoanghttp://moses-smt.org/
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170213/25d7a698/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 124, Issue 14
**********************************************

0 Response to "Moses-support Digest, Vol 124, Issue 14"

Post a Comment