Moses-support Digest, Vol 106, Issue 50

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Memory efficient MT (Kenneth Heafield)
2. Re: Memory efficient MT (Marcin Junczys-Dowmunt)
3. Re: Memory efficient MT (Maxim Khalilov)


----------------------------------------------------------------------

Message: 1
Date: Wed, 26 Aug 2015 17:01:43 +0100
From: Kenneth Heafield <moses@kheafield.com>
Subject: Re: [Moses-support] Memory efficient MT
To: moses-support@mit.edu
Message-ID: <55DDE2E7.200@kheafield.com>
Content-Type: text/plain; charset=windows-1252

Hi,

How much of http://www.statmt.org/moses/?n=Moses.Optimize have you
used? Be sure to read the last line of the page too.

Kenneth

On 08/26/2015 04:55 PM, Maxim Khalilov wrote:
> *Hi all,*
>
> *I am trying to use an MT engine trained on the 800,000 line
> EuroParlament corpus in an online MT gisting application.*
>
> *The process occupies around 23 Gb of RAM that is a bit too much in our
> settings. *
>
> *Since I don't know what is the text user will be translating, **the
> phrase table can not be prefiltered. However probably there are other
> tools and techniques that can be used to make the application more
> efficient in terms of RAM?*
>
> *Thank you beforehand,*
>
> *Maxim*
>
> *
> *
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

Message: 2
Date: Wed, 26 Aug 2015 19:32:54 +0200
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Memory efficient MT
To: moses-support@mit.edu
Message-ID: <55DDF846.4020004@amu.edu.pl>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

I just realized that page is seriously understating the memory-saving
effects of my phrase (reordering) table :)

On 26.08.2015 18:01, Kenneth Heafield wrote:
> Hi,
>
> How much of http://www.statmt.org/moses/?n=Moses.Optimize have you
> used? Be sure to read the last line of the page too.
>
> Kenneth
>
> On 08/26/2015 04:55 PM, Maxim Khalilov wrote:
>> *Hi all,*
>>
>> *I am trying to use an MT engine trained on the 800,000 line
>> EuroParlament corpus in an online MT gisting application.*
>>
>> *The process occupies around 23 Gb of RAM that is a bit too much in our
>> settings. *
>>
>> *Since I don't know what is the text user will be translating, **the
>> phrase table can not be prefiltered. However probably there are other
>> tools and techniques that can be used to make the application more
>> efficient in terms of RAM?*
>>
>> *Thank you beforehand,*
>>
>> *Maxim*
>>
>> *
>> *
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support



------------------------------

Message: 3
Date: Thu, 27 Aug 2015 15:31:54 +0200
From: Maxim Khalilov <maxkhalilov@gmail.com>
Subject: Re: [Moses-support] Memory efficient MT
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAPKeiSDn69duUKUnHQ5O_acCCHS-eJVdsb21BtNvui=rHBC9+Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

Thanks a lot for pointing me to the optimization page, it seems we are not
the only ones facing the performance problem:)
I am trying the Compact Phrase Table feature and it seems to be working
very well.

Thanks again,
Maxim

On Wed, Aug 26, 2015 at 7:32 PM, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
wrote:

> I just realized that page is seriously understating the memory-saving
> effects of my phrase (reordering) table :)
>
> On 26.08.2015 18:01, Kenneth Heafield wrote:
> > Hi,
> >
> > How much of http://www.statmt.org/moses/?n=Moses.Optimize have you
> > used? Be sure to read the last line of the page too.
> >
> > Kenneth
> >
> > On 08/26/2015 04:55 PM, Maxim Khalilov wrote:
> >> *Hi all,*
> >>
> >> *I am trying to use an MT engine trained on the 800,000 line
> >> EuroParlament corpus in an online MT gisting application.*
> >>
> >> *The process occupies around 23 Gb of RAM that is a bit too much in our
> >> settings. *
> >>
> >> *Since I don't know what is the text user will be translating, **the
> >> phrase table can not be prefiltered. However probably there are other
> >> tools and techniques that can be used to make the application more
> >> efficient in terms of RAM?*
> >>
> >> *Thank you beforehand,*
> >>
> >> *Maxim*
> >>
> >> *
> >> *
> >>
> >>
> >>
> >> _______________________________________________
> >> Moses-support mailing list
> >> Moses-support@mit.edu
> >> http://mailman.mit.edu/mailman/listinfo/moses-support
> >>
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>



--

*Maxim Khalilov*

*Mob.: +49 162 249 6243*

*Skype: Maxim Khalilov (desperbcn)*

*Twitter: twitter.com/maximkhalilov <http://twitter.com/maximkhalilov>*

*LinkedIn: https://nl.linkedin.com/in/maximkhalilov
<https://nl.linkedin.com/in/maximkhalilov>*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150827/022ae786/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 106, Issue 50
**********************************************

Tweet