Moses-support Digest, Vol 115, Issue 34

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. UN V1.0 corpus / Europarl - first shot... EN=>FR (Vincent Nguyen)
2. Re: "Feature name SRILM is not registered." (Anna Garbar)
3. EMS question - no recasing no truecasing (Vincent Nguyen)
4. Re: UN V1.0 corpus / Europarl - first shot... EN=>FR
(Marcin Junczys-Dowmunt)


----------------------------------------------------------------------

Message: 1
Date: Mon, 30 May 2016 15:03:05 +0200
From: Vincent Nguyen <vnguyen@neuf.fr>
Subject: [Moses-support] UN V1.0 corpus / Europarl - first shot...
EN=>FR
To: moses-support <moses-support@mit.edu>
Message-ID: <21da4964-9e37-4847-1e45-a2f85713ccdf@neuf.fr>
Content-Type: text/plain; charset=utf-8; format=flowed

First, many thanks for the huge work. open some new languages
possibilities not in the europarl.

I just made one test comparison :

Config 1:
Corpus UN v1.0
LM : UN V1.0 + News2014FR
DEV+TEST=Newsdiscuss2015
Nist=29.61

Config 2:
Corpus Europarl
LM : Europarl + News2014FR
DEV+TEST=Newsdiscuss2015
Nist=30.33

All other parameteres being the same.




------------------------------

Message: 2
Date: Mon, 30 May 2016 15:12:51 +0200
From: Anna Garbar <anna.garbar@gmail.com>
Subject: Re: [Moses-support] "Feature name SRILM is not registered."
To: Sa?o Kuntaric <saso.kuntaric@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAHbd-+hA39dkk+TBtYyRfYVEGpQeRRYoHUQ++mUttCxf7Ezbpw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Sa?o,

Thanks, the edited command solved the problem.
But while executing the next step (using the model on the string as
suggested in the tutorial ('putin beschreibt menschen .')), I got another
issue:

Exception: moses\Word.cpp:142 in void
Moses::Word::CreateFromString(Moses::FactorDirection, const std::ve
ctor<long unsigned int>&, const StringPiece&, bool, bool) threw
util::Exception because `!isNonTerminal & & i <
factorOrder.size()'.
Too few factors in string 'putin'.

If it's an unrelated topic, I will start a new thread.

Thanks for your help,
Anna

2016-05-30 10:52 GMT+02:00 Sa?o Kuntaric <saso.kuntaric@gmail.com>:

> Hi Anna,
>
> I wouldn't change it manually, especially since you have multiple lms in
> factored training and you can get the "old and new format don't mix" error.
> Just use the command that Kenneth now changed on the website and you'll be
> fine.
>
> p.s. No problem Kenneth, we don't mind giving you extra work :-).
>
> Best regards,
>
> Sa?o
>
> 2016-05-29 23:23 GMT+02:00 Kenneth Heafield <moses@kheafield.com>:
>
>> It's KENLM, not KenLM according to Hieu, who did name it after all.
>>
>> Kenneth
>>
>> On 05/29/2016 10:19 PM, Anna Garbar wrote:
>> > Hi Sa?o,
>> >
>> > Thanks for your reply. Before recompiling moses with srilm, I also tried
>> > to changed SRILM to KenLM im the moses.ini (under feature functions),
>> > but received "Feature name KenLM is not registered." Or did I have to
>> > make any other changes?
>> >
>> > Best,
>> > Anna
>> >
>> > 2016-05-29 23:10 GMT+02:00 Sa?o Kuntaric <saso.kuntaric@gmail.com
>> > <mailto:saso.kuntaric@gmail.com>>:
>> >
>> > Hi Anna,
>> >
>> > You are probably using KenLM as it's the default language model
>> > making tool. The factored tutorial however has the parameter for
>> > using SRILM. In the "lm 0:3:factored-corpus/surface.lm:0" part of
>> > the command, leave the last zero parameter ":0" out. Moses will then
>> > use the default KenLM tool.
>> >
>> > To the website authors: maybe it would be a good thing to mention
>> > this in the tutorial as I had the same issue.
>> >
>> > Best regards,
>> >
>> > Sa?o
>> >
>> > 2016-05-29 22:48 GMT+02:00 Rajen Chatterjee
>> > <rajen.k.chatterjee@gmail.com <mailto:rajen.k.chatterjee@gmail.com
>> >>:
>> >
>> > Hi,
>> >
>> > Since you are using SRILM have you compiled Moses with this flag
>> > "--with-srilm=/path/to/srilm" (look here for various compilation
>> > options http://www.statmt.org/moses/?n=Development.GetStarted).
>> >
>> > On Sun, May 29, 2016 at 9:48 PM, Anna Garbar
>> > <anna.garbar@gmail.com <mailto:anna.garbar@gmail.com>> wrote:
>> >
>> > Dear Moses Team,
>> >
>> > I am working through the factored tutorial
>> > (http://www.statmt.org/moses/?n=Moses.FactoredTutorial) and
>> > when trying out the pos model on a sample sentence ('putin
>> > beschreibt menschen .'), I receive
>> >
>> > Exception: moses\FF\Factory.cpp:321 in void
>> > Moses::FeatureRegistry::Construct(const string&, const
>> > string&) threw UnknownFeatureException because `i ==
>> > registry_.end()'.
>> > Feature name SRILM is not registered.
>> >
>> > The last command was:
>> >
>> > /home/AG/mosesdecoder/bin/moses -f pos/model/moses.ini < in
>> >
>> > Where should I look for mistake?
>> >
>> > Thanks in advance,
>> > Anna
>> >
>> > _______________________________________________
>> > Moses-support mailing list
>> > Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> > http://mailman.mit.edu/mailman/listinfo/moses-support
>> >
>> >
>> >
>> >
>> > --
>> > -Regards,
>> > Rajen Chatterjee.
>> >
>> > _______________________________________________
>> > Moses-support mailing list
>> > Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> > http://mailman.mit.edu/mailman/listinfo/moses-support
>> >
>> >
>> >
>> >
>> > --
>> > lp,
>> >
>> > Sa?o
>> >
>> >
>> >
>> >
>> > _______________________________________________
>> > Moses-support mailing list
>> > Moses-support@mit.edu
>> > http://mailman.mit.edu/mailman/listinfo/moses-support
>> >
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
>
> --
> lp,
>
> Sa?o
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160530/f4ced256/attachment-0001.html

------------------------------

Message: 3
Date: Mon, 30 May 2016 15:57:44 +0200
From: Vincent Nguyen <vnguyen@neuf.fr>
Subject: [Moses-support] EMS question - no recasing no truecasing
To: moses-support <moses-support@mit.edu>
Message-ID: <2f40ba89-cb0f-5635-7ede-44923039121d@neuf.fr>
Content-Type: text/plain; charset=utf-8; format=flowed

Hi,

I have a basic question on EMS.
If I want no recasing and no truecasing, I just put IGNORE next to the 2
sections.
However I have the feeling it does not eliminate this step for the
EVALUATION step, and there is no ignore within this one.

Is this the case ?

Thanks,

Vincent



------------------------------

Message: 4
Date: Mon, 30 May 2016 15:11:27 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] UN V1.0 corpus / Europarl - first shot...
EN=>FR
To: moses-support@mit.edu
Message-ID: <574C4A0F.8050401@amu.edu.pl>
Content-Type: text/plain; charset=windows-1252; format=flowed

Hi,
Considering the weirdness of the language of UN proceedings this is
actually encouraging results. What happens if you mix stuff?

W dniu 30.05.2016 o 14:03, Vincent Nguyen pisze:
> First, many thanks for the huge work. open some new languages
> possibilities not in the europarl.
>
> I just made one test comparison :
>
> Config 1:
> Corpus UN v1.0
> LM : UN V1.0 + News2014FR
> DEV+TEST=Newsdiscuss2015
> Nist=29.61
>
> Config 2:
> Corpus Europarl
> LM : Europarl + News2014FR
> DEV+TEST=Newsdiscuss2015
> Nist=30.33
>
> All other parameteres being the same.
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 115, Issue 34
**********************************************

Tweet