Moses-support Digest, Vol 108, Issue 71

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: OD: lmplz error (Ulrich Germann)
2. Fwd: moses using cpp help (Apurva Joshi)
3. Re: OD: lmplz error (Marcin Junczys-Dowmunt)
4. Re: OD: lmplz error (Marcin Junczys-Dowmunt)


----------------------------------------------------------------------

Message: 1
Date: Sun, 25 Oct 2015 22:56:27 +0000
From: Ulrich Germann <ulrich.germann@gmail.com>
Subject: Re: [Moses-support] OD: lmplz error
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAHQSRUrztG2UY+RB5HTk98008yLvxTCLGsag-oOSFUu4k-m8jg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

More specifically, it's a sign that your data might have to be
de-duplicated. The error occurs when there are no singleton n-grams of a
certain order.

- Uli

On Fri, Oct 23, 2015 at 7:22 AM, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
wrote:

> Hi,
> That's what --discount_fallback is for.
> Best,
> Marcin
>
> --
> Sent from my phone
>
>
> -------- Wiadomo?? oryginalna --------
> Temat: [Moses-support] lmplz error
> Od: Hieu Hoang
> Do: moses-support
> DW:
>
>
> hi all
>
> does anyone know how to fix this error from lmplz:
> terminate called after throwing an instance of
> 'lm::builder::BadDiscountException'
> what(): ERROR: 4-gram discount out of range for adjusted count 3:
> -0.446424
> The command I was running is
> .../lmplz --text .../Ubuntu.truecased.3 --order 5 --arpa
> .../Ubuntu.lm.3 --prune 0 0 1 -T .../lm -S 20%
> I guess there's not enough data to create a 5-gram
>
> --
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Ulrich Germann
Senior Researcher
School of Informatics
University of Edinburgh
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151025/9a38823d/attachment-0001.html

------------------------------

Message: 2
Date: Mon, 26 Oct 2015 12:41:54 +0530
From: Apurva Joshi <apurvajoshi1992@gmail.com>
Subject: [Moses-support] Fwd: moses using cpp help
To: moses-support@mit.edu
Message-ID:
<CAMfCXbWsY3901b5BZCWdUVGOqNm85BZNeff73YL_p-f0Yh8qzA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

---------- Forwarded message ----------
From: Apurva Joshi <apurvajoshi1992@gmail.com>
Date: Mon, Oct 26, 2015 at 12:40 PM
Subject: moses using cpp help
To: David Madl <david@madlnet.net>


hello,
plz help...m really confused...i want to access *bestHypo in Manager.cpp
to get best op translation...

i got that moses-cmd/src/Main.cpp..... <===uses phrase based decoding

where ..

LoadParam function in Moses::Parameter class loads moses.ini ....

LoadDataStatic function in Moses::StaticData intitialize global
variable...also loads LM

not getting job of IOwrapper

den create task of translating one sentense
// set up task of translating one sentence
TranslationTask* task = new TranslationTask(source, *ioWrapper);
task->run();

but what should be written in "TranslationTask" class ....so that run()
function in it will do translation and will print op in file using
outputcollector...

guyzz just want to write one pgm of giving ip, load moses.ini , do
translation , access *bestHypo and write it to file.....

plzz help ...tell me what should i write in run() ????

apurvajoshi1992@gmail.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151026/59c6d888/attachment-0001.html

------------------------------

Message: 3
Date: Mon, 26 Oct 2015 08:52:42 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] OD: lmplz error
To: ugermann@inf.ed.ac.uk
Cc: moses-support <moses-support@mit.edu>
Message-ID: <562DDBCA.1000104@amu.edu.pl>
Content-Type: text/plain; charset="utf-8"

This particular error does not indicate singletons, there is a different
error message for that.

Sometimes discounts are just weird. Kneser-Ney smoohting requires them
to be larger than 0, I do not really know though how negative discounts
come to be.

W dniu 25.10.2015 o 23:56, Ulrich Germann pisze:
> More specifically, it's a sign that your data might have to be
> de-duplicated. The error occurs when there are no singleton n-grams of
> a certain order.
>
> - Uli
>
> On Fri, Oct 23, 2015 at 7:22 AM, Marcin Junczys-Dowmunt
> <junczys@amu.edu.pl <mailto:junczys@amu.edu.pl>> wrote:
>
> Hi,
> That's what --discount_fallback is for.
> Best,
> Marcin
>
> --
> Sent from my phone
>
>
> -------- Wiadomo?? oryginalna --------
> Temat: [Moses-support] lmplz error
> Od: Hieu Hoang
> Do: moses-support
> DW:
>
>
> hi all
>
> does anyone know how to fix this error from lmplz:
> terminate called after throwing an instance of
> 'lm::builder::BadDiscountException'
> what(): ERROR: 4-gram discount out of range for adjusted count 3:
> -0.446424 <tel:0.446424>
> The command I was running is
> .../lmplz --text .../Ubuntu.truecased.3 --order 5 --arpa
> .../Ubuntu.lm.3 --prune 0 0 1 -T .../lm -S 20%
> I guess there's not enough data to create a 5-gram
>
> --
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
> Ulrich Germann
> Senior Researcher
> School of Informatics
> University of Edinburgh

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151026/07de9b4b/attachment-0001.html

------------------------------

Message: 4
Date: Mon, 26 Oct 2015 08:57:12 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] OD: lmplz error
To: moses-support@mit.edu
Message-ID: <562DDCD8.4050905@amu.edu.pl>
Content-Type: text/plain; charset="utf-8"

Actually, is there any good reason to have this option not enabled by
default?

W dniu 26.10.2015 o 08:52, Marcin Junczys-Dowmunt pisze:
> This particular error does not indicate singletons, there is a
> different error message for that.
>
> Sometimes discounts are just weird. Kneser-Ney smoohting requires them
> to be larger than 0, I do not really know though how negative
> discounts come to be.
>
> W dniu 25.10.2015 o 23:56, Ulrich Germann pisze:
>> More specifically, it's a sign that your data might have to be
>> de-duplicated. The error occurs when there are no singleton n-grams
>> of a certain order.
>>
>> - Uli
>>
>> On Fri, Oct 23, 2015 at 7:22 AM, Marcin Junczys-Dowmunt
>> <junczys@amu.edu.pl <mailto:junczys@amu.edu.pl>> wrote:
>>
>> Hi,
>> That's what --discount_fallback is for.
>> Best,
>> Marcin
>>
>> --
>> Sent from my phone
>>
>>
>> -------- Wiadomo?? oryginalna --------
>> Temat: [Moses-support] lmplz error
>> Od: Hieu Hoang
>> Do: moses-support
>> DW:
>>
>>
>> hi all
>>
>> does anyone know how to fix this error from lmplz:
>> terminate called after throwing an instance of
>> 'lm::builder::BadDiscountException'
>> what(): ERROR: 4-gram discount out of range for adjusted
>> count 3:
>> -0.446424 <tel:0.446424>
>> The command I was running is
>> .../lmplz --text .../Ubuntu.truecased.3 --order 5 --arpa
>> .../Ubuntu.lm.3 --prune 0 0 1 -T .../lm -S 20%
>> I guess there's not enough data to create a 5-gram
>>
>> --
>> Hieu Hoang
>> http://www.hoang.co.uk/hieu
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>>
>> --
>> Ulrich Germann
>> Senior Researcher
>> School of Informatics
>> University of Edinburgh
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151026/771c25c4/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 108, Issue 71
**********************************************

Tweet