Moses-support Digest, Vol 85, Issue 36

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Estimating probabilities with KenLM (Prasanth K)


----------------------------------------------------------------------

Message: 1
Date: Fri, 22 Nov 2013 20:19:28 +0530
From: Prasanth K <prasanthk.ms09@gmail.com>
Subject: [Moses-support] Estimating probabilities with KenLM
To: moses-support <moses-support@mit.edu>
Message-ID:
<CA+n+9-iLtRws3=WS=AEDiZoDno5=Sh7B5gwkg0yNNbW7NXyyfg@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi,

I am trying to use KenLM for building a language model on the Europarl
corpus. Following the instructions in (
http://www.statmt.org/moses/?n=FactoredTraining.BuildingLanguageModel#ntoc19),
I added the few lines for getting KenLM to estimate the LM probabilities
(order/n=5) to my config file to the EMS. The language model dies down
during training saying that the "Function not implemented" at counting and
sorting n-grams stage (the first stage itself). Does this mean there is
something wrong with my installation? Or is just insufficient memory?

Incidentally, when I started giving the amount of memory in terms of %
(80%) there was an error "Failed to parse .. into memory size because
physical memory size could not be determined". I am also curious why this
happens?

Kenneth, can you shed some light on this? Thanks.

- Regards,
Prasanth



--
"Theories have four stages of acceptance. i) this is worthless nonsense;
ii) this is an interesting, but perverse, point of view, iii) this is true,
but quite unimportant; iv) I always said so."

--- J.B.S. Haldane
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131122/bc618752/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 85, Issue 36
*********************************************

Tweet