Moses-support Digest, Vol 106, Issue 1

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Parallelizer multi core (Hieu Hoang)
2. Re: Parallelizer multi core (Nikolay Bogoychev)
3. Re: Parallelizer multi core (Marcin Junczys-Dowmunt)
4. Re: Parallelizer multi core (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Fri, 31 Jul 2015 22:30:58 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Parallelizer multi core
To: Vincent Nguyen <vnguyen@neuf.fr>, moses-support
<moses-support@mit.edu>
Message-ID: <55BBBEE2.9050007@gmail.com>
Content-Type: text/plain; charset="windows-1252"

good suggestion. Changed:
https://github.com/moses-smt/mosesdecoder/commit/f894dec0fd8d5b15eb16c35d3d2599338894ee9d
if you have any more suggestions, it's best if you can just me a patch
and I'll check it in

On 31/07/2015 15:59, Vincent Nguyen wrote:
>
> for inexperienced people like me :)
> Add |--decoder-flags="-threads 4"| is key
>
> if EMS config.basic had "-threads all" by default we would gain A LOT
> of time.
>
> cheers,
>
> Vincent
>
>
> Le 29/07/2015 22:05, Vincent Nguyen a ?crit :
>> Hi,
>>
>> I am wondering what tasks of the EMS are really parallelized.
>> I activated the script line + 8 cores.
>>
>> Training / binarizing / Tuning all make only one core to actually work.
>>
>> Am I correct ?
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150731/832b3c4c/attachment-0001.htm

------------------------------

Message: 2
Date: Fri, 31 Jul 2015 23:35:03 +0100
From: Nikolay Bogoychev <nheart@gmail.com>
Subject: Re: [Moses-support] Parallelizer multi core
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAJzPUEy7c_vZ-Q_nWTdyK_18VKxEtMcQxCgc9dwVdgrAMeWxFw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hey,

I have opposed this change in the past for two reasons:

Using more than 4 threads doesn't help unless the user is using
PhraseDictionaryCompact. See this issue
https://github.com/moses-smt/mosesdecoder/issues/39 in fact on most
machines you rarely want to run moses on all available threads.

Also - threads all picks up virtual (hyper) threads which are in fact
harmful to performance.

If you want to change the default I think it would be better to have a sane
default like 4.. It would boost performance for most people and if you run
it on machines with less available cores it would be not too bad.

Cheers,

Nick
On 31 Jul 2015 7:31 pm, "Hieu Hoang" <hieuhoang@gmail.com> wrote:

> good suggestion. Changed:
>
> https://github.com/moses-smt/mosesdecoder/commit/f894dec0fd8d5b15eb16c35d3d2599338894ee9d
> if you have any more suggestions, it's best if you can just me a patch and
> I'll check it in
>
> On 31/07/2015 15:59, Vincent Nguyen wrote:
>
>
> for inexperienced people like me :)
> Add --decoder-flags="-threads 4" is key
>
> if EMS config.basic had "-threads all" by default we would gain A LOT of
> time.
>
> cheers,
>
> Vincent
>
>
> Le 29/07/2015 22:05, Vincent Nguyen a ?crit :
>
> Hi,
>
> I am wondering what tasks of the EMS are really parallelized.
> I activated the script line + 8 cores.
>
> Training / binarizing / Tuning all make only one core to actually work.
>
> Am I correct ?
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> --
> Hieu Hoang
> Researcher
> New York University, Abu Dhabihttp://www.hoang.co.uk/hieu
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150731/2710304f/attachment-0001.htm

------------------------------

Message: 3
Date: Sat, 01 Aug 2015 08:35:45 +0200
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Parallelizer multi core
To: moses-support@mit.edu
Message-ID: <55BC68C1.7090208@amu.edu.pl>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

Hi, I agree with Nick. I am using a 64-core machine. "-threads all" will
grind to a still-stand. I am however fine with a few more threads, say 16.
Best,
Marcin

On 01.08.2015 00:35, Nikolay Bogoychev wrote:
>
> Hey,
>
> I have opposed this change in the past for two reasons:
>
> Using more than 4 threads doesn't help unless the user is using
> PhraseDictionaryCompact. See this issue
> https://github.com/moses-smt/mosesdecoder/issues/39 in fact on most
> machines you rarely want to run moses on all available threads.
>
> Also - threads all picks up virtual (hyper) threads which are in fact
> harmful to performance.
>
> If you want to change the default I think it would be better to have a
> sane default like 4.. It would boost performance for most people and
> if you run it on machines with less available cores it would be not
> too bad.
>
> Cheers,
>
> Nick
>
> On 31 Jul 2015 7:31 pm, "Hieu Hoang" <hieuhoang@gmail.com
> <mailto:hieuhoang@gmail.com>> wrote:
>
> good suggestion. Changed:
> https://github.com/moses-smt/mosesdecoder/commit/f894dec0fd8d5b15eb16c35d3d2599338894ee9d
> if you have any more suggestions, it's best if you can just me a
> patch and I'll check it in
>
> On 31/07/2015 15:59, Vincent Nguyen wrote:
>>
>> for inexperienced people like me :)
>> Add |--decoder-flags="-threads 4"| is key
>>
>> if EMS config.basic had "-threads all" by default we would gain A
>> LOT of time.
>>
>> cheers,
>>
>> Vincent
>>
>>
>> Le 29/07/2015 22:05, Vincent Nguyen a ?crit :
>>> Hi,
>>>
>>> I am wondering what tasks of the EMS are really parallelized.
>>> I activated the script line + 8 cores.
>>>
>>> Training / binarizing / Tuning all make only one core to actually work.
>>>
>>> Am I correct ?
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> --
> Hieu Hoang
> Researcher
> New York University, Abu Dhabi
> http://www.hoang.co.uk/hieu
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support




------------------------------

Message: 4
Date: Sat, 1 Aug 2015 11:38:43 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Parallelizer multi core
To: moses-support@mit.edu
Message-ID: <55BC7783.1060805@gmail.com>
Content-Type: text/plain; charset=windows-1252; format=flowed

oh alright. I've made it 4 cores. The example config files are aimed at
beginners with laptops.

On 01/08/2015 10:35, Marcin Junczys-Dowmunt wrote:
> Hi, I agree with Nick. I am using a 64-core machine. "-threads all" will
> grind to a still-stand. I am however fine with a few more threads, say 16.
> Best,
> Marcin
>
> On 01.08.2015 00:35, Nikolay Bogoychev wrote:
>> Hey,
>>
>> I have opposed this change in the past for two reasons:
>>
>> Using more than 4 threads doesn't help unless the user is using
>> PhraseDictionaryCompact. See this issue
>> https://github.com/moses-smt/mosesdecoder/issues/39 in fact on most
>> machines you rarely want to run moses on all available threads.
>>
>> Also - threads all picks up virtual (hyper) threads which are in fact
>> harmful to performance.
>>
>> If you want to change the default I think it would be better to have a
>> sane default like 4.. It would boost performance for most people and
>> if you run it on machines with less available cores it would be not
>> too bad.
>>
>> Cheers,
>>
>> Nick
>>
>> On 31 Jul 2015 7:31 pm, "Hieu Hoang" <hieuhoang@gmail.com
>> <mailto:hieuhoang@gmail.com>> wrote:
>>
>> good suggestion. Changed:
>> https://github.com/moses-smt/mosesdecoder/commit/f894dec0fd8d5b15eb16c35d3d2599338894ee9d
>> if you have any more suggestions, it's best if you can just me a
>> patch and I'll check it in
>>
>> On 31/07/2015 15:59, Vincent Nguyen wrote:
>>> for inexperienced people like me :)
>>> Add |--decoder-flags="-threads 4"| is key
>>>
>>> if EMS config.basic had "-threads all" by default we would gain A
>>> LOT of time.
>>>
>>> cheers,
>>>
>>> Vincent
>>>
>>>
>>> Le 29/07/2015 22:05, Vincent Nguyen a ?crit :
>>>> Hi,
>>>>
>>>> I am wondering what tasks of the EMS are really parallelized.
>>>> I activated the script line + 8 cores.
>>>>
>>>> Training / binarizing / Tuning all make only one core to actually work.
>>>>
>>>> Am I correct ?
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>> --
>> Hieu Hoang
>> Researcher
>> New York University, Abu Dhabi
>> http://www.hoang.co.uk/hieu
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>

--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 106, Issue 1
*********************************************

Tweet