Moses-support Digest, Vol 123, Issue 4

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Moses-support post from ankit21.lnmiit@gmail.com requires
approval (Ankit Gupta)
2. Re: Moses-support post from ankit21.lnmiit@gmail.com requires
approval (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Wed, 4 Jan 2017 16:58:00 +0530
From: Ankit Gupta <ankit21.lnmiit@gmail.com>
Subject: Re: [Moses-support] Moses-support post from
ankit21.lnmiit@gmail.com requires approval
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAPSAqeEfUG9b9osxYcRS_FOBURF8Xtoju4HY2y9d09G-rqY4YA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thanks Hieu. Now it is working on different cores on server using your
server command.

Also, I have one more question that suppose only one client hits the
server. In this case, How can we use all cores of the server system during
decoding of the input sentence given by the client ?

Thanks.


On Tue, Jan 3, 2017 at 3:51 AM, Hieu Hoang <hieuhoang@gmail.com> wrote:

> what happens if you try with more clients, say 20? How fast is your
> network? What happens if your clients is on the server?
>
> My server is using multiple cores. I run multiple clients on the same
> server. My server command is:
>
> $MOSES_DIR/bin/moses2 -f $CONFIG -i $IN -threads 12 -server
> The client command is
>
> $MOSES_DIR/contrib/server/client-stdin.perl < in.800k
>
> top gives me:
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+
> COMMAND
>
> 3217 hieu 20 0 28.987g 0.014t 0.013t S 655.8 11.2 48:30.92
> moses2
>
> 18754 hieu 20 0 64860 21884 4980 S 34.2 0.0 2:37.20
> perl
>
> 4779 hieu 20 0 64856 21836 4936 S 31.9 0.0 3:12.29
> perl
>
> 5526 hieu 20 0 64856 21968 5060 S 31.9 0.0 3:08.91
> perl
>
> 11989 hieu 20 0 64860 21852 4948 S 31.2 0.0 3:00.67 perl
>
> On 02/01/2017 15:24, Ankit Gupta wrote:
>
> Hi Hieu,
>
> Thanks for your reply.
> Actually, I did htop in mosesserver machine on which I was hitting from
> different client machines at the same time. Then after htop, I saw that
> mosesserver machine was using only single core during decoding. At the same
> time I saw on two different client machine and found that when one client
> was giving decoding result then only second client machine starts decoding.
> Can you help me with this problem that why is it not using all core if I
> am hitting from different clients at the same time.
>
> Thanks.
>
> On Mon, Jan 2, 2017 at 6:25 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>
>> please subscribe to the Moses mailing list before posting to it. You can
>> subscribe here:
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>> btw, how do you know it's executing 1-by-1?
>>
>> Hieu Hoang
>> http://moses-smt.org/
>>
>> ---------- Forwarded message ----------
>> From: <moses-support-owner@mit.edu>
>> Date: 2 January 2017 at 12:46
>> Subject: Moses-support post from ankit21.lnmiit@gmail.com requires
>> approval
>> To: moses-support-owner@mit.edu
>>
>>
>> As list administrator, your authorization is requested for the
>> following mailing list posting:
>>
>> List: Moses-support@mit.edu
>> From: ankit21.lnmiit@gmail.com
>> Subject: Query in mosesserver for multiple clients
>> Reason: Post by non-member to a members-only list
>>
>> At your convenience, visit:
>>
>> http://mailman.mit.edu/mailman/admindb/moses-support
>>
>> to approve or deny the request.
>>
>>
>> ---------- Forwarded message ----------
>> From: Ankit Gupta <ankit21.lnmiit@gmail.com>
>> To: moses-support@mit.edu
>> Cc:
>> Date: Mon, 2 Jan 2017 18:16:19 +0530
>> Subject: Query in mosesserver for multiple clients
>> Hi all,
>>
>> I am running mosesserver on one machine on port 8080 and using 2
>> different machine as a client machine.
>> The Moses server can be used by more than one client at the same time.
>> However when I hit at the mosesserver from those 2 different machines then
>> it executes those 2 hits one by one. It does not execute them in parallel
>> way because it is using single thread.
>> Can you please tell how can I run multiple hits from different client
>> machines in different threads of the mosesserver at the same time ?
>>
>> Just for the information, I am using following command to run mosesserver:
>> -> ~/mosesdecoder/bin/moses2 -server -search-algorithm 1
>> -cube-pruning-pop-limit 2000 -s 2000 --server-port 8080 -config moses.ini
>> --threads 8 --server-maxconn 8 --server-maxconn-backlog 8
>> --server-keepalive-maxconn 8
>>
>> Thanks.
>>
>> Regards,
>> Ankit
>>
>>
>> ---------- Forwarded message ----------
>> From: moses-support-request@mit.edu
>> To:
>> Cc:
>> Date:
>> Subject: confirm 43abcae06bfeddab54bc378bf011cb79825ef9a4
>> If you reply to this message, keeping the Subject: header intact,
>> Mailman will discard the held message. Do this if the message is
>> spam. If you reply to this message and include an Approved: header
>> with the list password in it, the message will be approved for posting
>> to the list. The Approved: header can also appear in the first line
>> of the body of the reply.
>>
>>
>
> --
> Hieu Hoanghttp://moses-smt.org/
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170104/d930916f/attachment-0001.html

------------------------------

Message: 2
Date: Wed, 4 Jan 2017 13:26:03 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Moses-support post from
ankit21.lnmiit@gmail.com requires approval
To: Ankit Gupta <ankit21.lnmiit@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbhHuQfdmdJs6HGRpoLSDY8vHj4qUsOobYGBjfVFScOHSQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dunno. It may be that the server-client communication has to be changed so
that multiple sentences are handled at the same time.

still up for discussion, nothing done about it yet

Hieu Hoang
http://moses-smt.org/

On 4 January 2017 at 11:28, Ankit Gupta <ankit21.lnmiit@gmail.com> wrote:

> Thanks Hieu. Now it is working on different cores on server using your
> server command.
>
> Also, I have one more question that suppose only one client hits the
> server. In this case, How can we use all cores of the server system during
> decoding of the input sentence given by the client ?
>
> Thanks.
>
>
> On Tue, Jan 3, 2017 at 3:51 AM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>
>> what happens if you try with more clients, say 20? How fast is your
>> network? What happens if your clients is on the server?
>>
>> My server is using multiple cores. I run multiple clients on the same
>> server. My server command is:
>>
>> $MOSES_DIR/bin/moses2 -f $CONFIG -i $IN -threads 12 -server
>> The client command is
>>
>> $MOSES_DIR/contrib/server/client-stdin.perl < in.800k
>>
>> top gives me:
>>
>> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+
>> COMMAND
>>
>> 3217 hieu 20 0 28.987g 0.014t 0.013t S 655.8 11.2 48:30.92
>> moses2
>>
>> 18754 hieu 20 0 64860 21884 4980 S 34.2 0.0 2:37.20
>> perl
>>
>> 4779 hieu 20 0 64856 21836 4936 S 31.9 0.0 3:12.29
>> perl
>>
>> 5526 hieu 20 0 64856 21968 5060 S 31.9 0.0 3:08.91
>> perl
>>
>> 11989 hieu 20 0 64860 21852 4948 S 31.2 0.0 3:00.67 perl
>>
>> On 02/01/2017 15:24, Ankit Gupta wrote:
>>
>> Hi Hieu,
>>
>> Thanks for your reply.
>> Actually, I did htop in mosesserver machine on which I was hitting from
>> different client machines at the same time. Then after htop, I saw that
>> mosesserver machine was using only single core during decoding. At the same
>> time I saw on two different client machine and found that when one client
>> was giving decoding result then only second client machine starts decoding.
>> Can you help me with this problem that why is it not using all core if I
>> am hitting from different clients at the same time.
>>
>> Thanks.
>>
>> On Mon, Jan 2, 2017 at 6:25 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>
>>> please subscribe to the Moses mailing list before posting to it. You can
>>> subscribe here:
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>> btw, how do you know it's executing 1-by-1?
>>>
>>> Hieu Hoang
>>> http://moses-smt.org/
>>>
>>> ---------- Forwarded message ----------
>>> From: <moses-support-owner@mit.edu>
>>> Date: 2 January 2017 at 12:46
>>> Subject: Moses-support post from ankit21.lnmiit@gmail.com requires
>>> approval
>>> To: moses-support-owner@mit.edu
>>>
>>>
>>> As list administrator, your authorization is requested for the
>>> following mailing list posting:
>>>
>>> List: Moses-support@mit.edu
>>> From: ankit21.lnmiit@gmail.com
>>> Subject: Query in mosesserver for multiple clients
>>> Reason: Post by non-member to a members-only list
>>>
>>> At your convenience, visit:
>>>
>>> http://mailman.mit.edu/mailman/admindb/moses-support
>>>
>>> to approve or deny the request.
>>>
>>>
>>> ---------- Forwarded message ----------
>>> From: Ankit Gupta <ankit21.lnmiit@gmail.com>
>>> To: moses-support@mit.edu
>>> Cc:
>>> Date: Mon, 2 Jan 2017 18:16:19 +0530
>>> Subject: Query in mosesserver for multiple clients
>>> Hi all,
>>>
>>> I am running mosesserver on one machine on port 8080 and using 2
>>> different machine as a client machine.
>>> The Moses server can be used by more than one client at the same time.
>>> However when I hit at the mosesserver from those 2 different machines then
>>> it executes those 2 hits one by one. It does not execute them in parallel
>>> way because it is using single thread.
>>> Can you please tell how can I run multiple hits from different client
>>> machines in different threads of the mosesserver at the same time ?
>>>
>>> Just for the information, I am using following command to run
>>> mosesserver:
>>> -> ~/mosesdecoder/bin/moses2 -server -search-algorithm 1
>>> -cube-pruning-pop-limit 2000 -s 2000 --server-port 8080 -config moses.ini
>>> --threads 8 --server-maxconn 8 --server-maxconn-backlog 8
>>> --server-keepalive-maxconn 8
>>>
>>> Thanks.
>>>
>>> Regards,
>>> Ankit
>>>
>>>
>>> ---------- Forwarded message ----------
>>> From: moses-support-request@mit.edu
>>> To:
>>> Cc:
>>> Date:
>>> Subject: confirm 43abcae06bfeddab54bc378bf011cb79825ef9a4
>>> If you reply to this message, keeping the Subject: header intact,
>>> Mailman will discard the held message. Do this if the message is
>>> spam. If you reply to this message and include an Approved: header
>>> with the list password in it, the message will be approved for posting
>>> to the list. The Approved: header can also appear in the first line
>>> of the body of the reply.
>>>
>>>
>>
>> --
>> Hieu Hoanghttp://moses-smt.org/
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170104/a3379b54/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 123, Issue 4
*********************************************

Tweet