Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Moses2 questions (Mike Ladwig)
2. Re: Moses2 questions (Hieu Hoang)
3. Re: Moses2 questions (Mike Ladwig)
4. Re: Moses2 questions (Mike Ladwig)
----------------------------------------------------------------------
Message: 1
Date: Mon, 26 Dec 2016 15:28:43 -0500
From: Mike Ladwig <mdladwig@gmail.com>
Subject: [Moses-support] Moses2 questions
To: Moses Support <moses-support@mit.edu>
Message-ID:
<CAB3VaD2McTTmhBQMCGJ=vnjpFRan=RJsHKdmO+cTRw2c5JsHkw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hello. I was experimenting a bit with moses2 as a replacement for
mosesserver and have a couple of issues I am looking at.
First, I don't seem to get multithreading; max cpu is 100% even though the
XML client is using 8 threads. Is there something I need to change to
enable multithreading?
Second, it seems to crash on sentences with zones and walls. Are they
implemented in moses2?
Thanks, mike.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161226/14117e22/attachment-0001.html
------------------------------
Message: 2
Date: Mon, 26 Dec 2016 21:11:43 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Moses2 questions
To: Mike Ladwig <mdladwig@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbjv9cPA5ywGLvPorW24KvZ585v544fgB0-A+vsesO-JAQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hiya
Can you provide a model, inputs, and your client code so I can reproduce
the issues.
Hieu
Sent while bumping into things
On 26 Dec 2016 20:29, "Mike Ladwig" <mdladwig@gmail.com> wrote:
Hello. I was experimenting a bit with moses2 as a replacement for
mosesserver and have a couple of issues I am looking at.
First, I don't seem to get multithreading; max cpu is 100% even though the
XML client is using 8 threads. Is there something I need to change to
enable multithreading?
Second, it seems to crash on sentences with zones and walls. Are they
implemented in moses2?
Thanks, mike.
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161226/e147ea7d/attachment-0001.html
------------------------------
Message: 3
Date: Mon, 26 Dec 2016 18:45:45 -0500
From: Mike Ladwig <mdladwig@gmail.com>
Subject: Re: [Moses-support] Moses2 questions
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAB3VaD2PawZ-kAsPFWqDJAmxUZY22kX894CNLe3xS4yzyQ2pbw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Unfortunately I can't do that easily. The client code has worked with
mosesserver for years, as has the wall/zone code.
Since I'm not certain that these are moses2 issues yet, I just wanted to
confirm that I'm not missing something on either issue -- to confirm that
the moses2 server mode is supposed to work as mosesserver did (allocate a
new thread to each incoming service request) without any additional
configuration and that the wall/zone features are implemented and expected
to work.
Thanks,
mike.
On Mon, Dec 26, 2016 at 4:11 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:
> Hiya
>
> Can you provide a model, inputs, and your client code so I can reproduce
> the issues.
>
> Hieu
> Sent while bumping into things
>
> On 26 Dec 2016 20:29, "Mike Ladwig" <mdladwig@gmail.com> wrote:
>
> Hello. I was experimenting a bit with moses2 as a replacement for
> mosesserver and have a couple of issues I am looking at.
>
> First, I don't seem to get multithreading; max cpu is 100% even though the
> XML client is using 8 threads. Is there something I need to change to
> enable multithreading?
>
> Second, it seems to crash on sentences with zones and walls. Are they
> implemented in moses2?
>
> Thanks, mike.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161226/2aa59b86/attachment-0001.html
------------------------------
Message: 4
Date: Mon, 26 Dec 2016 22:21:44 -0500
From: Mike Ladwig <mdladwig@gmail.com>
Subject: Re: [Moses-support] Moses2 questions
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAB3VaD3+J3tH-5C+fQo__k-hA=Xgp3SPohJnDfCQah8NJ1W0CA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
I have made no progress on the multithreading of moses2 in server mode.
When processing a file specified via -i it appears to respect the threads
setting in the .ini file
I am fairly confident that the crash is related to decoding zone and wall
tags.
If I eliminate that element from my pipeline moses2 seems to work
correctly. An example is:
<zone> <wall/> ( <wall/> en <wall/> ) <wall/> </zone> es ist beschamend fur
die europaische union , dass sie die technische zusammenarbeit mit russland
trotz des volker mordes am tschetschenischen volk unterstutzt , und das zu
einem zeit punkt , da dieses haus die ende fassung
Here is some information on how I've setup moses2:
moses2 -server -search-algorithm 1 -cube-pruning-pop-limit 2000 -s
2000 -placeholder-factor 1 -xml-input exclusive --server-port 8082
-config /opt/models/xlate.ger-eng/decoder.ini
# input factors
[input-factors]
0
# mapping steps
[mapping]
0 T 0
[distortion-limit]
6
# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
ProbingPT name=TranslationModel0 num-features=4
path=/opt/models/xlate.ger-eng/pt2
input-factor=0 output-factor=0
LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
property-index=0
Distortion
KENLM name=LM0 factor=0 path=/opt/models/xlate.ger-eng/languagemodel-en
order=5
# dense weights for feature functions
[placeholder-factor]
1
[threads]
8
[xml-input]
exclusive
[weight]
LexicalReordering0= 0.095698 0.0346659 0.111703 0.0987009 0.112696 0.153312
Distortion0= 0.00145445
LM0= 0.0998281
WordPenalty0= -0.105109
PhrasePenalty0= 0.0459613
TranslationModel0= 0.0322297 0.0625015 0.0378206 0.00831904
UnknownWordPenalty0= 1
On Mon, Dec 26, 2016 at 6:45 PM, Mike Ladwig <mdladwig@gmail.com> wrote:
> Unfortunately I can't do that easily. The client code has worked with
> mosesserver for years, as has the wall/zone code.
>
> Since I'm not certain that these are moses2 issues yet, I just wanted to
> confirm that I'm not missing something on either issue -- to confirm that
> the moses2 server mode is supposed to work as mosesserver did (allocate a
> new thread to each incoming service request) without any additional
> configuration and that the wall/zone features are implemented and expected
> to work.
>
> Thanks,
> mike.
>
> On Mon, Dec 26, 2016 at 4:11 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>
>> Hiya
>>
>> Can you provide a model, inputs, and your client code so I can reproduce
>> the issues.
>>
>> Hieu
>> Sent while bumping into things
>>
>> On 26 Dec 2016 20:29, "Mike Ladwig" <mdladwig@gmail.com> wrote:
>>
>> Hello. I was experimenting a bit with moses2 as a replacement for
>> mosesserver and have a couple of issues I am looking at.
>>
>> First, I don't seem to get multithreading; max cpu is 100% even though
>> the XML client is using 8 threads. Is there something I need to change to
>> enable multithreading?
>>
>> Second, it seems to crash on sentences with zones and walls. Are they
>> implemented in moses2?
>>
>> Thanks, mike.
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161226/daefedbd/attachment.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 122, Issue 37
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 122, Issue 37"
Post a Comment