Moses-support Digest, Vol 88, Issue 71

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Very slow tuning with binarised kenlm language model
(Felipe S?nchez Mart?nez)


----------------------------------------------------------------------

Message: 1
Date: Fri, 28 Feb 2014 17:11:19 +0100
From: Felipe S?nchez Mart?nez <fsanchez@dlsi.ua.es>
Subject: Re: [Moses-support] Very slow tuning with binarised kenlm
language model
To: Barry Haddow <bhaddow@staffmail.ed.ac.uk>, moses-support
<moses-support@mit.edu>
Message-ID: <5310B527.7070600@dlsi.ua.es>
Content-Type: text/plain; charset=UTF-8; format=flowed

Hi all,

Thanks for your quick answer!

Most probably it has to do with I/O operations. I have rebooted the
machine. Not it is working find. No other process are running in parallel.

Hope to have it tuned for the WMT14 deadline.

Have a good weekend.
Cheers!
--
Felipe


El 28/02/14 16:19, Barry Haddow escribi?:
> Hi Felipe
>
> If it's not swapping, and cpu is at 15%, then it's likely to be waiting
> on IO. Are you sure all the models are on local disks? Is any other
> process accessing the disks? Sometimes iotop can help see what is going on,
>
> cheers - Barry
>
> On 28/02/14 11:56, Felipe S?nchez Mart?nez wrote:
>> Hello all,
>>
>> I am tuning a system that uses a binarised kenlm language model. This
>> model was binarised with default parameters and is 22 GB in size after
>> binarisation.
>>
>> The thing is that the language model and the (filtered) phrase table fit
>> into memory (32 GB ; so, no swaping) but moses is translating very very
>> slowly, it is only using around 15% of CPU.
>>
>> Is there anything I can do to make it faster?
>>
>> Thank you very much for your help
>> Regards
>
>

--
Felipe S?nchez Mart?nez
Dep. de Llenguatges i Sistemes Inform?tics
Universitat d'Alacant, E-03071 Alacant (Spain)
Tel.: +34 965 903 400, ext: 2966 Fax: +34 965 909 326
http://www.dlsi.ua.es/~fsanchez


------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 88, Issue 71
*********************************************

Tweet