Moses-support Digest, Vol 104, Issue 91

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Number of CPUs and cores in training for, server with 24
cores? (Tom Hoar)


----------------------------------------------------------------------

Message: 1
Date: Fri, 26 Jun 2015 22:13:08 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] Number of CPUs and cores in training for,
server with 24 cores?
To: moses-support@mit.edu
Message-ID: <558D6C04.9090504@precisiontranslationtools.com>
Content-Type: text/plain; charset=utf-8; format=flowed

My tests with a quad-core dual threaded (8 virtual cores) i7 with 16 GB
RAM shows have shown the Intel is pretty good at managing throughput
when you configure with full CPU count for each value.

-mgiza -mgiza-cpus 8 -cores 8 -parallel

I've experienced a 5% to 10% reduction in processing time (steps 1-9)
with this configuration compared to either no -parallel or halving the
count for -mgiza-cpus. I have no idea what happens with 24 cores. You
might want to test.

Tom



On 6/26/2015 9:57 PM, moses-support-request@mit.edu wrote:
> Date: Fri, 26 Jun 2015 14:57:35 +0000
> From: Davood Mohammadifar<davood_mf@hotmail.com>
> Subject: [Moses-support] FW: Number of CPUs and cores in training for
> server with 24 cores?
> To:"moses-support@mit.edu" <moses-support@mit.edu>,"phi@jhu.edu"
> <phi@jhu.edu>
> Message-ID:<SNT150-W234B5024BDE105386B98EC8CAD0@phx.gbl>
> Content-Type: text/plain; charset="iso-8859-1"
>
>
> Thanks a lot Mr Koehn.
>
>
>> >Date: Fri, 26 Jun 2015 09:06:24 -0400
>> >Subject: Re: [Moses-support] Number of CPUs and cores in training for server with 24 cores?
>> >From:phi@jhu.edu
>> >To:davood_mf@hotmail.com
>> >CC:moses-support@mit.edu
>> >
>> >Hi,
>> >
>> >if you have 24 cores, then
>> >
>> >-mgiza -mgiza-cpus 12 -cores 24 -parallel
>> >
>> >sounds plausible to me.
>> >
>> >The "parallel" will parallelize the 2 mgiza runs, so you should use 12
>> >CPUs for each.
>> >
>> >The 24 cores setting is relevant for phrase table building.
>> >
>> >-phi
>> >
>> >
>> >On Fri, Jun 26, 2015 at 6:45 AM, Davood Mohammadifar
>> ><davood_mf@hotmail.com> wrote:
>>> > >Hello everyone
>>> > >
>>> > >I want to use mgiza for training. What is your recommendation for number of
>>> > >cores and CPUs, for good performance and quality in train-model command? Is
>>> > >24 suitable for both? what is your recommendation for other options (such as
>>> > >-parallel,...)?
>>> > >
>>> > >train-model.perl -mgiza -mgiza-cpus ?? -cores ?? ...
>>> > >
>>> > >
>>> > >System:
>>> > >Number of cores: 24
>>> > >RAM: 40GB
>>> > >OS: Ubuntu 12.04
>>> > >
>>> > >Thanks
>>> > >
>>> > >_______________________________________________
>>> > >Moses-support mailing list
>>> > >Moses-support@mit.edu
>>> > >http://mailman.mit.edu/mailman/listinfo/moses-support
>>> > >
>



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 104, Issue 91
**********************************************

Tweet