Moses-support Digest, Vol 89, Issue 42

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Problem in Web Based Version of MT System using MOSES -
Please help (Hieu Hoang)
2. Re: Multiple reordering models while creating ini at step 9
(Hieu Hoang)
3. Re: Recaser - LM model loading (Hieu Hoang)
4. Re: Moses using other LMs (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Wed, 19 Mar 2014 00:21:55 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Problem in Web Based Version of MT System
using MOSES - Please help
To: Vishal Goyal(????? ????) <vishal.pup@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbg1Nr2B6_CqiOykBujKcxkZUagm8hpwgcUWpNjEbVHsQg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

I'm not an expert on the moses server but I haven't heard this error
occuring with the moses script.

However, since you've made quite a few changes to the scripts that came
with Moses, you'll have to debug it yourself.


On 18 March 2014 15:02, Vishal Goyal(????? ????) <vishal.pup@gmail.com>wrote:

> Respected All,
> Greetings
>
> We have installed the moses server and web server on a single machine on
> linux platform. when tested on the local host the system work fine, when we
> installed the system on web server for public use. The system some work
> fine but most of the we are not getting the translation of the input text
> instead the input text is transliterated in the post processing script
> written in transliterate.pl.
>
> Moses server is running as daemon.pl. The index.cgi is being used to take
> user input and translate.cgi start the moses thread for tranlation.
>
> When error log is inspected it show that only one thread of moses is
> running and all other threads are terminated with the error message (error
> log attached.)
>
> Please also find the attached source code of daemon.pl, index.cgi and
> translate.cgi
>
>
>
>
> --
> *Regards,*
> Vishal Goyal,
> Ph.D., M.Tech., MCA, M.C.S.D.
> Assistant Professor(Stage III) and Placement Coordinator,
> Department of Computer Science,
> Punjabi University Patiala-147002
> [*Online Hindi to Punjabi Machine Translation Tool -*
> http://h2p.learnpunjabi.org ]
> *[Research Cell: An International Journal of Engineering Sciences,
> http://ijoes.vidyapublications.com <http://ijoes.vidyapublications.com>]*
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140319/2b9a11b5/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 19 Mar 2014 00:29:26 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Multiple reordering models while creating
ini at step 9
To: jian zhang <zhangj@computing.dcu.ie>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbhn3we8P30rbsvyE+RQbYB3rCF8b-SxnBAeyM5bqQ8OKQ@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

like this?

https://github.com/moses-smt/mosesdecoder/commit/1c6061e78174d09ea4a7a8125ee0df7f41d88ae5

thanks


On 18 March 2014 22:20, jian zhang <zhangj@computing.dcu.ie> wrote:

> Hi,
>
> Just a bug, i think
>
> Line 2011 at
> https://github.com/moses-smt/mosesdecoder/blob/master/scripts/training/train-model.perl
> .
> The $i++ should be placed into the loop while creating multiple reordering
> models, otherwise all reordering models will have index 0.
>
> Jian Zhang
> --
> Jian Zhang
> Centre for Next Generation Localisation (CNGL)<http://www.cngl.ie/index.html>
> Dublin City University <http://www.dcu.ie/>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140319/2c846f9d/attachment-0001.htm

------------------------------

Message: 3
Date: Wed, 19 Mar 2014 00:35:43 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Recaser - LM model loading
To: Tomas Fulajtar <TomasFu@moravia.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAEKMkbha8WHw6sZuysco+jueqUv=W7v73EOMrchOnC+ZdAacTg@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

What is a recaser LM? What command is taking 20 minutes? Can you send me
the moses.ini file you're using.




On 17 March 2014 12:58, Tomas Fulajtar <TomasFu@moravia.com> wrote:

> Hello,
>
>
>
> I am experiencing strange behavior when using recaser LM model after
> migrated to moses(1.0) compiled on different machine.
>
> The problem is that loading of LM takes 20 minutes on my new machine
> (SUSE), while on previous it was 20 secs or so.
>
>
>
> Machine 1: Fedora 18:
>
> ? gcc: 4.7.2
>
> ? perl 5.16
>
> ? moses 1.0
>
> ? irstlm 5.80.01
>
> ? mgiza 0.7.0
>
> ? boost 1.52
>
>
>
> Machine 2: SUSE SLES 11 SP3
>
>
>
> ? perl: 5.10.0
>
> ? gcc: 4.3
>
> ? moses 1.0
>
> ? irstlm 5.80.03
>
> ? mgiza 0.6.3
>
> ? boost 1.55
>
>
>
> Moses compilation command:
>
>
>
> sudo ./bjam --prefix=/opt/moses --install-scripts=/opt/moses/scripts -j4
> -a --with-irstlm=/usr/local/irstlm --with-xmlrpc-c=/usr/local
> --with-cmph=usr/local --with-boost=/opt/boost --with-giza=/usr/local/bin
> --enable-boost-pool --enable-optimization --debug-symbols=off toolset=gcc
> -d2 --debug-configuration --max-kenlm-order=7 |tee ~/build.log 2>&1
>
>
>
> I have tested the speed using the same recaser IRSTLM model data in ARPA
> format . There is actually no error displayed, thus I wonder where to
> continue with debugging. Also tried to retrain model on SUSE and then test
> on Fedora, but the result is same (no error, but too slow on SUSE). Does
> anybody have idea where to look for resolution? Maybe the problem is in
> IRSTLM used?
>
>
>
>
>
> Thank you,
>
>
>
> Tomas Fulajtar
>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140319/a85c0811/attachment-0001.htm

------------------------------

Message: 4
Date: Wed, 19 Mar 2014 00:39:32 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Moses using other LMs
To: Zheng Yuan <yuanzheng_bupt@126.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAEKMkbii2+08_CECdk5ydt16DRdxwVo6zJeUPeo8XWffP_a02w@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Moses supports RandLM and neural network LM which can handle very large
amounts of data, I think.

I'm not sure if IRSTLM or KenLM can handle Google ngram data, but I know
they can handle large amount of data


On 17 March 2014 14:56, Zheng Yuan <yuanzheng_bupt@126.com> wrote:

> Hi,
>
> I am wondering is it possible for Moses to use other kinds of LMs? Like
> some existing Web interface or Google n-gram?
>
> Regards,
> Zheng
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>



--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140319/c5510947/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 89, Issue 42
*********************************************

Tweet