Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: static build of mosesdecoder (Hieu Hoang)
2. Moses kbmira/pro with non-Moses decoder (Kenneth Heafield)
3. does mosesserver use -threads argument? (Wang Pidong)
4. Re: does mosesserver use -threads argument? (Barry Haddow)
5. Re: Moses kbmira/pro with non-Moses decoder (Barry Haddow)
6. How to Improve the translation (Asad A.Malik)
----------------------------------------------------------------------
Message: 1
Date: Fri, 10 Jan 2014 20:23:01 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] static build of mosesdecoder
To: Tak Kuya <kuyatak@gmail.com>, moses-support@mit.edu
Message-ID: <52D056A5.8010909@gmail.com>
Content-Type: text/plain; charset="iso-8859-1"
double check that libz.a and librt.a exist in
/usr/lib
or
/usr/lib64
I statically compiled on Suse Linux and it was ok. My bjam command was:
./bjam --with-boost=/home/s0565741/workspace/boost/boost_1_54_0/
--with-irstlm=/home/s0565741/workspace/irstlm/
--with-cmph=/home/s0565741/workspace/cmph-2.0
--with-dalm=/home/s0565741/workspace/github/DALM -j16 -static -a
On 10/01/2014 09:56, Tak Kuya wrote:
> Hi. How do you build mosesdecoder using static libraries like
> http://www.statmt.org/moses/RELEASE-1.0/binaries/ ? To make things
> simple, I use the master branch instead of Rel.1.0 and edit
> mosesdecoder/Jamroot a little and build the decoder only.
>
> I can build the normal "shared" version of moses without any problems
> and usually use it (on CentOS 6.5 with boost 1.41). But I failed to
> build moses with --static option. So I installed boost 1.41 to my home
> directory. But I still couldn't build moses. It said "cannot find -lz
> and -lrt" so I installed zlib-static and glibc-static with yum.
>
> And... It failed again. Here are build.log and Jamroot I used. Could
> anyone teach me how to solve the problem? Thank you.
>
> Best regards,
> Tak Kuya
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140110/fa985d51/attachment-0001.htm
------------------------------
Message: 2
Date: Fri, 10 Jan 2014 12:39:09 -0800
From: Kenneth Heafield <moses@kheafield.com>
Subject: [Moses-support] Moses kbmira/pro with non-Moses decoder
To: moses-support@mit.edu
Cc: Daniel Silva <raditzman@yahoo.com>, Colin Cherry
<colin.cherry@nrc-cnrc.gc.ca>
Message-ID:
<CAA+pi35DK-mGT+oxb2vjY8eOmxR4irp2yGf=A5-vXc35142HGQ@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Hi,
What's the best way to use Moses optimization without using Moses
the decoder? I've got my own system combination decoder (MEMT).
Currently, the scripts use Z-MERT but 1) MERT supports a limited
number of features and 2) Users keep finding bugs in Z-MERT.
I can run pro or kbmira directly but is there documentation of
their file formats? Another option is to use mert-moses.pl and try to
look like Moses. How much does my decoder have to look like Moses for
that to work? Keep in mind the input isn't a flat text file anymore.
Kenneth
------------------------------
Message: 3
Date: Fri, 10 Jan 2014 12:40:36 -0800
From: Wang Pidong <wangpd@comp.nus.edu.sg>
Subject: [Moses-support] does mosesserver use -threads argument?
To: moses-support@mit.edu
Message-ID:
<CAKYvXDEVqrQoOsGabgUOWYARD4YLrOQKWrzce=SPNeFAZOL84w@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"
Hi all,
Does anyone know whether mosesserver use -threads argument to control the
number of threads?
As we know that mosesserver uses XMLRPC to set up a http server, and I
found that XMLRPC only has two modes about threads: serial (using runOnce
method) or unlimited threads (using run method) from:
http://xmlrpc-c.sourceforge.net/doc/libxmlrpc_server_abyss++.html
I had a look at moseserver.cpp, and I think mosesserver does not use the
-threads to control the number of threads.
Is anyone familiar with this?
Thank you in advance!
Best wishes!
--
Wang Pidong
Department of Computer Science
School of Computing
National University of Singapore
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140110/82978037/attachment-0001.htm
------------------------------
Message: 4
Date: Fri, 10 Jan 2014 21:17:27 +0000
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] does mosesserver use -threads argument?
To: Wang Pidong <wangpd@comp.nus.edu.sg>
Cc: moses-support@mit.edu
Message-ID: <20140110211727.89721fugpbnsok1w@www.staffmail.ed.ac.uk>
Content-Type: text/plain; charset=ISO-8859-1; DelSp="Yes";
format="flowed"
Hi Wang
Yes, you're right. mosesserver uses the threading model from xmlrpc,
which is either a thread per connection, or single threaded.
cheers - Barry
Quoting Wang Pidong <wangpd@comp.nus.edu.sg> on Fri, 10 Jan 2014
12:40:36 -0800:
> Hi all,
>
> Does anyone know whether mosesserver use -threads argument to control the
> number of threads?
> As we know that mosesserver uses XMLRPC to set up a http server, and I
> found that XMLRPC only has two modes about threads: serial (using runOnce
> method) or unlimited threads (using run method) from:
> http://xmlrpc-c.sourceforge.net/doc/libxmlrpc_server_abyss++.html
>
> I had a look at moseserver.cpp, and I think mosesserver does not use the
> -threads to control the number of threads.
> Is anyone familiar with this?
> Thank you in advance!
>
> Best wishes!
>
> --
> Wang Pidong
>
> Department of Computer Science
> School of Computing
> National University of Singapore
>
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
------------------------------
Message: 5
Date: Fri, 10 Jan 2014 21:26:09 +0000
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] Moses kbmira/pro with non-Moses decoder
To: Kenneth Heafield <moses@kheafield.com>
Cc: moses-support@mit.edu, Daniel Silva <raditzman@yahoo.com>, Colin
Cherry <colin.cherry@nrc-cnrc.gc.ca>
Message-ID: <20140110212609.12281kmj2nu1jwro@www.staffmail.ed.ac.uk>
Content-Type: text/plain; charset=ISO-8859-1; DelSp="Yes";
format="flowed"
Hi Kenneth
If your decoder can output the n-best list in the same format as
Moses, then you can run the Moses extractor (to get bleu sufficient
stats and features from the n-best), then the optimiser. For PRO this
means running the Moses pro binary, followed by MegaM. For k-best
mira, I think you just have to run the kbmira binary. You should be
able to see what arguments to use from looking at the output of a
mert-moses.perl run, as it reports the commands as it runs them.
Each of the optimisers outputs the new weight set, which you then have
to parse and send back to your decoder. I don't think these formats
are documented, but they should be clear enough.
If you want to make your own decoder "look like Moses", then the
outputting the n-best list is probably straightforward - you have to
do that anyway. The hassle is that mert-moses.pl will expect your
decoder to understand all the Moses command line options for
specifying new weights,
cheers - Barry
Quoting Kenneth Heafield <moses@kheafield.com> on Fri, 10 Jan 2014
12:39:09 -0800:
> Hi,
>
> What's the best way to use Moses optimization without using Moses
> the decoder? I've got my own system combination decoder (MEMT).
> Currently, the scripts use Z-MERT but 1) MERT supports a limited
> number of features and 2) Users keep finding bugs in Z-MERT.
>
> I can run pro or kbmira directly but is there documentation of
> their file formats? Another option is to use mert-moses.pl and try to
> look like Moses. How much does my decoder have to look like Moses for
> that to work? Keep in mind the input isn't a flat text file anymore.
>
> Kenneth
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
------------------------------
Message: 6
Date: Fri, 10 Jan 2014 23:29:22 -0800 (PST)
From: "Asad A.Malik" <asad_12204@yahoo.com>
Subject: [Moses-support] How to Improve the translation
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<1389425362.20035.YahooMailNeo@web122201.mail.ne1.yahoo.com>
Content-Type: text/plain; charset="iso-8859-1"
Hi All,
I've developed Urdu to English SMT using MOSES, and it is currently giving me BLEU score of 8. Now I wanted to improve its translation so that it gives me higher BLEU score.
?
Regards?
Asad A.Malik
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140110/8d5464ce/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 87, Issue 22
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 87, Issue 22"
Post a Comment