Moses-support Digest, Vol 87, Issue 27

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: How to Improve the translation (Hieu Hoang)
2. moses.ini config weights (nadeem khan)
3. Issues when running mosesserver (Roee Aharoni)
4. Re: moses.ini config weights (Philipp Koehn)
5. Re: When using moses, cpu is are not stable. (Philipp Koehn)


----------------------------------------------------------------------

Message: 1
Date: Tue, 14 Jan 2014 10:23:06 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] How to Improve the translation
To: "Asad A.Malik" <asad_12204@yahoo.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAEKMkbhnSE9wdOyu3V-QEmBGih3-1zhb1OJmgg7qxmWaDeu7qQ@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

The easiest way to improve translation is to find more data. The 2nd
easiest way is to improve the tokenization of your languages


On 11 January 2014 07:29, Asad A.Malik <asad_12204@yahoo.com> wrote:

> Hi All,
>
> I've developed Urdu to English SMT using MOSES, and it is currently giving
> me BLEU score of 8. Now I wanted to improve its translation so that it
> gives me higher BLEU score.
>
> Regards
>
>
> Asad A.Malik
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140114/fffcb31b/attachment-0001.htm

------------------------------

Message: 2
Date: Tue, 14 Jan 2014 02:26:08 -0800 (PST)
From: nadeem khan <nad_star06@yahoo.com>
Subject: [Moses-support] moses.ini config weights
To: moses-support <moses-support@mit.edu>
Message-ID:
<1389695168.51863.YahooMailNeo@web162402.mail.bf1.yahoo.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi all;

?I want to know some details about the Moses weights that are generated after training step under moses.ini config file and also we use tuning step to improve those weights.?
Where & how actually these weights are being used? and how decoder take those weights while translating a input sentence? Can someone elaborate the use of these weights with example.
What if we modified those weights manually without using tuning??

Regards
nadeem khan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140114/94f75672/attachment-0001.htm

------------------------------

Message: 3
Date: Tue, 14 Jan 2014 16:52:31 +0200
From: Roee Aharoni <roee.aharoni@gmail.com>
Subject: [Moses-support] Issues when running mosesserver
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <566923F1-C252-4290-8F0B-61D3B5AF55B7@gmail.com>
Content-Type: text/plain; charset="us-ascii"

Hi!

l built moses successfully with mosesserver (with xmlrpc option), and noticed that the mosesserver executable was created at mosesdecoder/bin.
Then, I executed the mosesserver process and after a while got the error:
Undefined symbol: libxmlrpc_server_abyss_set_handler3

I thought I have a wrong version of xmlrpc_server_abyss, though I couldn't find a better one.

Do you have an idea of what would solve the problem?

Thanks,

Roee
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140114/c5b7d321/attachment-0001.htm

------------------------------

Message: 4
Date: Tue, 14 Jan 2014 11:38:39 -0500
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] moses.ini config weights
To: nadeem khan <nad_star06@yahoo.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAAFADDA_KzoNLyKE7ivRM6PG0+KJJP4Lgx0+8FS_E=a7qO9xsg@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1

Hi,

each possible translation of the input sentence is scored by a few different
component models, such as the language model, the direct phrase translation
probabiity, etc. Tuning sets weights for these component models based on
how important they are to achieve good translations.

Tuning is described here:
http://www.statmt.org/moses/?n=FactoredTraining.Tuning

The MERT paper by Franz Och
http://aclweb.org/anthology//P/P03/P03-1021.pdf
introduced these ideas into statistical machine translation.

-phi

On Tue, Jan 14, 2014 at 5:26 AM, nadeem khan <nad_star06@yahoo.com> wrote:
> Hi all;
>
> I want to know some details about the Moses weights that are generated
> after training step under moses.ini config file and also we use tuning step
> to improve those weights.
> Where & how actually these weights are being used? and how decoder take
> those weights while translating a input sentence? Can someone elaborate the
> use of these weights with example.
> What if we modified those weights manually without using tuning?
>
> Regards
> nadeem khan
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

Message: 5
Date: Tue, 14 Jan 2014 11:41:54 -0500
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] When using moses, cpu is are not stable.
To: Hansung Cho <gyuber@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDDvf_DEDGdyfMwqTR8HrXykYrbyyr6mx6QSR=uhZb9UpA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

you can try specifying more threads than the number of CPUs.
I have no idea if this speeds things up or causes blockage in
your setup. Just try it out and see what happens.

-phi


On Tue, Jan 14, 2014 at 4:31 AM, Hansung Cho <gyuber@gmail.com> wrote:

> My server configuration are multiple CPUs 16 core and running thread 16.
>
> How do I adjust the moses running thread?
>
> I need your help...
>
> Thank you
>
>
> 2014/1/14 Tom Hoar <tahoar@precisiontranslationtools.com>
>
>> With a system as complex as Moses, why would you think the CPU usage
>> would be steady? Each sentence task goes through many stages with different
>> CPU demands which probably map to the variation in each cycle.
>>
>> You can also look first at your threading configuration. If your system
>> has multiple CPUs (cores) and Moses is running multi-threaded, I suspect
>> the cycles' frequencies are related to the activities on each thread.
>>
>>
>>
>> On 01/14/2014 01:09 PM, Hansung Cho wrote:
>>
>> hello..
>>
>> I'm using mosesdecoding
>>
>> When monitoring a physical server, Server cpu is not very stable.
>> However, the state is constantly moving cpu
>>
>> Look at the picture below
>> [image: ?? ??? 1]
>>
>> Is it because the moses system cache??
>> Should any part option of the adjustment?
>>
>> My moses commit a1584c608f8bbd83921896bac9eac97d9effc0c8
>> Options related to the cache are "clean-lm-cache" ( default ==1 )
>>
>> Will be waiting for your input.
>>
>> Thank you
>> Hansung cho
>>
>>
>> _______________________________________________
>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140114/5fa8b414/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 4887 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140114/5fa8b414/attachment.png

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 87, Issue 27
*********************************************

Tweet