Moses-support Digest, Vol 92, Issue 35

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: mosesserver parallelization issue (Mike Ladwig)
2. Re: mosesserver parallelization issue (Hieu Hoang)
3. (no subject) (Kalyani Baruah)
4. Re: (no subject) (Philipp Koehn)


----------------------------------------------------------------------

Message: 1
Date: Mon, 16 Jun 2014 12:48:20 -0400
From: Mike Ladwig <mdladwig@gmail.com>
Subject: Re: [Moses-support] mosesserver parallelization issue
To: moses-support@mit.edu
Message-ID:
<CAB3VaD2Y8iady+xdR40aAEffBTh2m+Wg3TCZeqt=EhFmNj5NmA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Barry Haddow writes:

>The -threads switch is intended for command-line Moses, not for Moses
>server, but I didn't realise that it had this negative effect on the
>Moses server. Moses server uses the threading model provided by xmlrpc-c
>which, afaik, creates a new thread for each new tcp/ip connection. The
>-threads switch controls the thread pool for command-line Moses.

>This threading model interacts badly with the new caching mechanism in
>Moses server 2.1.1 so needs to be updated - there was an earlier thread
>(sorry!) on this topic,
>
>cheers - Barry

I just got bitten by this regression in 2.11. I'm not sure changing out
the xmlrpc library will help, but a pool for translation worker threads
would. I took a quick look at the moses-cmd TranslationTask code but didn't
see the problematic cache. Could someone point me in the right direction?

Regards,
mike.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140616/a9ca440a/attachment-0001.htm

------------------------------

Message: 2
Date: Mon, 16 Jun 2014 20:13:33 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] mosesserver parallelization issue
To: Mike Ladwig <mdladwig@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbiR=yiXyx46Y1sQT7XHUtF4WYGV0niUrVfY2_C7eu4e3g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

the cache is in
moses/TranslationModel/PhraseDictionary.h line 160
It's 1 cache per thread



On 16 June 2014 17:48, Mike Ladwig <mdladwig@gmail.com> wrote:

> Barry Haddow writes:
>
> >The -threads switch is intended for command-line Moses, not for Moses
> >server, but I didn't realise that it had this negative effect on the
> >Moses server. Moses server uses the threading model provided by xmlrpc-c
> >which, afaik, creates a new thread for each new tcp/ip connection. The
> >-threads switch controls the thread pool for command-line Moses.
>
> >This threading model interacts badly with the new caching mechanism in
> >Moses server 2.1.1 so needs to be updated - there was an earlier thread
> >(sorry!) on this topic,
> >
> >cheers - Barry
>
> I just got bitten by this regression in 2.11. I'm not sure changing out
> the xmlrpc library will help, but a pool for translation worker threads
> would. I took a quick look at the moses-cmd TranslationTask code but didn't
> see the problematic cache. Could someone point me in the right direction?
>
> Regards,
> mike.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140616/505f20e3/attachment-0001.htm

------------------------------

Message: 3
Date: Tue, 17 Jun 2014 13:39:11 +0530
From: Kalyani Baruah <kajubaruah04@gmail.com>
Subject: [Moses-support] (no subject)
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAJZ5LDfMw9=pgpbq4wH7pEbHm5kRns_WF3SbT1SfL+gioEVTOQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

?Hiee Good day everyone.. English words have only one connection because
they dont have any inflection is not it, am i correct.and using BLEU and
WER,PER gives a vast difference why is it so. ?

Regards,



*Kalyanee Kanchan Baruah*
Institute of Science and Technology,
Gauhati University,Guwahati,India
Phone- +91-9706242124
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140617/c1bc8f27/attachment-0001.htm

------------------------------

Message: 4
Date: Tue, 17 Jun 2014 08:29:00 -0400
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] (no subject)
To: Kalyani Baruah <kajubaruah04@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDAuSr-YG1ndQdtBNvrV_TL5bysvALNoinPyN38HgaB+hg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

it is true that metrics like BLEU that only count words as correct when
they are identically
and do not give partial credit to morphological variants are more
appropriate for English
and other less inflected languages. Scores for English are typically
higher, which does
reflect to some degree that translating into a morphologically poorer
language is easier,
and partially an artifact of the metric.

There have been several attempts of equipping metrics with morphological
awareness.
See the metrics task at WMT2014 for the latest research on this:
http://www.statmt.org/wmt14/program.html

-phi


On Tue, Jun 17, 2014 at 4:09 AM, Kalyani Baruah <kajubaruah04@gmail.com>
wrote:

>
> ?Hiee Good day everyone.. English words have only one connection because
> they dont have any inflection is not it, am i correct.and using BLEU and
> WER,PER gives a vast difference why is it so. ?
>
> Regards,
>
>
>
> *Kalyanee Kanchan Baruah*
> Institute of Science and Technology,
> Gauhati University,Guwahati,India
> Phone- +91-9706242124
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140617/b9b545e9/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 92, Issue 35
*********************************************

Tweet