Moses-support Digest, Vol 100, Issue 24

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: max phrase length (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Fri, 06 Feb 2015 16:03:07 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] max phrase length
To: Jorg Tiedemann <tiedeman@gmail.com>, moses-support
<moses-support@mit.edu>
Message-ID: <54D4E5BB.4000106@gmail.com>
Content-Type: text/plain; charset="windows-1252"

the decoder creates a list of all possible paths through the lattice up
the the max-phrase-length before it does the pt lookups

So if the lattice is large and the max-phrase-length is high, it will
consume a lot of memory.

in the old version of moses (v1), it only built the paths as it does the
lookup and only keep the path if it finds rules for it. This is more
memory efficient but the code was too convoluted

On 06/02/15 12:43, Jorg Tiedemann wrote:
> Hi,
>
> I have a question about the -max-phrase-length flag. I have lattice
> input that collects a lot of memory and eventually crashes when memory
> runs out (over 90GB). Now I realized that setting max-phrase-length
> helps even when setting it to length 7 which is the maximum length in
> my extracted phrase table. I do't really see why this is the case but
> maybe I misunderstand the flag and what it does. Is it not related to
> the max length of translation options coming from the phrase table?
> Thanks for clarifying this to me.
>
> cheers,
> J?rg
>
>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

--
Hieu Hoang
Research Associate (until March 2015)
** searching for interesting commercial MT position **
University of Edinburgh
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150206/bc19a6f3/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 100, Issue 24
**********************************************

Tweet