Moses-support Digest, Vol 82, Issue 32

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. How do Moses use the LM for unknown words (Per Tunedal)


----------------------------------------------------------------------

Message: 1
Date: Fri, 23 Aug 2013 21:20:46 +0200
From: Per Tunedal <per.tunedal@operamail.com>
Subject: [Moses-support] How do Moses use the LM for unknown words
To: moses-support@mit.edu
Message-ID:
<1377285646.4570.13411789.3C62BBFC@webmail.messagingengine.com>
Content-Type: text/plain; charset="UTF-8"


Hi,
how do Moses calculate the probability of a sentence with an unknown
word? How is the LM used?

I've estimated a 3-gram LM with IRSTLM for a base line system, according
to the instructions in the Wiki. The arpa-file contains entries like:

-7.2625 redescendue -0.1681
-7.2625 serviabilit? -0.1681
-2.51072 <unk>

-3.26915 cadre tr?s -0.096544
-4.52727 cadre lors
-4.57217 cadre seulement

I suppose the first number is the probability and the second number is
the "back-off weight". Is it used somehow? In that case, what happens
when it's absent (4.52727 cadre lors) ?

Yours,
Per Tunedal



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 82, Issue 32
*********************************************

Tweet