Moses-support Digest, Vol 102, Issue 23

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. srilm way of computing n1, n2 for unmodified-Kneser-Ney
(koormoosh)
2. Re: Server development (Hieu Hoang)
3. Required Licenses (Ihab Ramadan)


----------------------------------------------------------------------

Message: 1
Date: Tue, 14 Apr 2015 14:30:05 +1000
From: koormoosh <koormoosh@gmail.com>
Subject: [Moses-support] srilm way of computing n1, n2 for
unmodified-Kneser-Ney
To: moses-support@mit.edu
Cc: koormoosh@gmail.com
Message-ID:
<CAN3_CDhhBrXMG2GZUcrm9d13TDS0NL==XqWU2oSnPUGdZwQ8mA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello,

I am looking at the debug output of ./ngram-count -order 2 -read toy.ngrams
-lm toy.binary -interpolate -ukndiscount -gt1min 0 -gt2min 0
-write-binary-lm -debug 2

and I am seeing that for my training dataset, the n1,n2 quantities for
1-gram is not consistent with the actual n1,n2 I should get from the data.
The debug output confirms this guess by showing "modifying 1-gram counts
for Kneser-Ney smoothing". However, it matches the actual n1,n2 for the
2-grams case. A sample output to demonstrate my case:

using KneserNey for* 1-grams*
modifying 1-gram counts for Kneser-Ney smoothing ***
Kneser-Ney smoothing 1-grams
n1 = 704 ***
n2 = 189 ***
D = 0.650647 **//the discount also changes since it is based on n1, n2*
using KneserNey for *2-grams*
Kneser-Ney smoothing 2-gram
n1 = 2884 ***
n2 = 274 ***
D = 0.840326 ***

So, here are my questions:
1) Is there a way to avoid this refinement and force srilm to use the
actual n1,n2 ?
2) what are the criteria for refining n1,n2, and how it is done? (Any
documentation??)

Thanks,
Koorm
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150414/17d9de8d/attachment-0001.htm

------------------------------

Message: 2
Date: Tue, 14 Apr 2015 09:09:20 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Server development
To: Tomas Fulajtar <TomasFu@moravia.com>, "moses-support
(moses-support@mit.edu)" <moses-support@mit.edu>, Ulrich Germann
<ugermann@inf.ed.ac.uk>
Message-ID: <552CA100.6060707@gmail.com>
Content-Type: text/plain; charset="windows-1252"

i think uli is trying to merge the server into the command line.

On 01/04/2015 12:48, Tomas Fulajtar wrote:
>
> Dear all,
>
> I have spotted there were numerous commits in the server side
> development - could the developers share the news/goals with the
> forum? I think it might be interesting for more users ? especially
> those out of core team.
>
> Thank you,
>
> *Tom?? Fulajt?r*|Researcher
> *T:* +420-545-552-340
> tomasfu@moravia.com <mailto:tomasfu@moravia.com>|moravia.com
> <http://www.moravia.com/>|*Skype:*tomasfulajtar
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150414/bee90ad6/attachment-0001.htm

------------------------------

Message: 3
Date: Tue, 14 Apr 2015 12:59:34 +0200
From: "Ihab Ramadan" <i.ramadan@saudisoft.com>
Subject: [Moses-support] Required Licenses
To: <moses-support@mit.edu>
Message-ID: <001f01d076a2$196dcc30$4c496490$@saudisoft.com>
Content-Type: text/plain; charset="us-ascii"

Dears,

If I want to use Moses commercially what licenses should I buy for this

Thanks



Regards,
Ihab Ramadan | Senior Developer | Saudisoft-Egypt | Tel: +2 023 303 2037 -
ext 128 | M +2 01007570826 | Fax +2 023 303 2036 | Follow us on
<https://www.facebook.com/pages/Saudisoft-Co-Ltd/289968997768973?ref_type=bo
okmark> | <https://twitter.com/Saudisoft> |
<https://www.linkedin.com/company/77017?trk=vsrp_companies_res_name&trkInfo=
VSRPsearchId%3A1489659901402995947155%2CVSRPtargetId%3A77017%2CVSRPcmpt%3Apr
imary>




-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150414/361322d9/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1336 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150414/361322d9/attachment.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1370 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150414/361322d9/attachment-0001.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1314 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150414/361322d9/attachment-0002.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 6337 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150414/361322d9/attachment.jpg

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 102, Issue 23
**********************************************

Tweet