Moses-support Digest, Vol 87, Issue 33

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: When using moses, cpu is are not stable. (Wang Pidong)


----------------------------------------------------------------------

Message: 1
Date: Wed, 15 Jan 2014 00:53:26 -0800
From: Wang Pidong <wangpd@comp.nus.edu.sg>
Subject: Re: [Moses-support] When using moses, cpu is are not stable.
To: Hansung Cho <gyuber@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAKYvXDFeFACsYRbbdWbH+eW_vwo3LNkuovM8vqKcv98N33_4nw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

The unstable state can be caused by the fact that Moses create a new thread
to translate each new sentence, so when translating a large file, Moses
frequently creates threads and then OS has to reschedule frequently also.

Even in single-thread Moses, given each input sentence, it also needs to
load phrase table, language model, etc. which may also be blocked due to IO
operations, if you use binarized models.

Just for your reference.

Best wishes!
Pidong



On 14 January 2014 23:24, Hansung Cho <gyuber@gmail.com> wrote:

> hello.
>
> To change the option "-threads 64" then monitoring at server CPUs status.
> but, result is the same..
> Try the other way?
>
> Attach the CPUs status picture
>
> thank you
> Hansung Cho
>
> [image: ?? ??? 1]
>
>
> 2014/1/15 Tom Hoar <tahoar@precisiontranslationtools.com>
>
>> To change the threads, run with '-threads x' added to your command line:
>>
>> moses -f /path/to/moses.ini -threads 20
>>
>>
>>
>>
>> On 01/14/2014 11:41 PM, Philipp Koehn wrote:
>>
>> Hi,
>>
>> you can try specifying more threads than the number of CPUs.
>> I have no idea if this speeds things up or causes blockage in
>> your setup. Just try it out and see what happens.
>>
>> -phi
>>
>>
>> On Tue, Jan 14, 2014 at 4:31 AM, Hansung Cho <gyuber@gmail.com> wrote:
>>
>>> My server configuration are multiple CPUs 16 core and running thread 16.
>>>
>>> How do I adjust the moses running thread?
>>>
>>> I need your help...
>>>
>>> Thank you
>>>
>>>
>>> 2014/1/14 Tom Hoar <tahoar@precisiontranslationtools.com>
>>>
>>>> With a system as complex as Moses, why would you think the CPU usage
>>>> would be steady? Each sentence task goes through many stages with different
>>>> CPU demands which probably map to the variation in each cycle.
>>>>
>>>> You can also look first at your threading configuration. If your system
>>>> has multiple CPUs (cores) and Moses is running multi-threaded, I suspect
>>>> the cycles' frequencies are related to the activities on each thread.
>>>>
>>>>
>>>>
>>>> On 01/14/2014 01:09 PM, Hansung Cho wrote:
>>>>
>>>> hello..
>>>>
>>>> I'm using mosesdecoding
>>>>
>>>> When monitoring a physical server, Server cpu is not very stable.
>>>> However, the state is constantly moving cpu
>>>>
>>>> Look at the picture below
>>>> [image: ?? ??? 1]
>>>>
>>>> Is it because the moses system cache??
>>>> Should any part option of the adjustment?
>>>>
>>>> My moses commit a1584c608f8bbd83921896bac9eac97d9effc0c8
>>>> Options related to the cache are "clean-lm-cache" ( default ==1 )
>>>>
>>>> Will be waiting for your input.
>>>>
>>>> Thank you
>>>> Hansung cho
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>>
>> _______________________________________________
>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> --
> Wang Pidong
>
> Department of Computer Science
> School of Computing
> National University of Singapore
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140115/3d8d222e/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 4887 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140115/3d8d222e/attachment.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 4432 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140115/3d8d222e/attachment-0001.png

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 87, Issue 33
*********************************************

Tweet