Moses-support Digest, Vol 94, Issue 17

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Using only the Moses decoder (liling tan)
2. Re: xmlrpc problem (Barry Haddow)
3. Re: xmlrpc problem (Sandipan Dandapat)


----------------------------------------------------------------------

Message: 1
Date: Wed, 13 Aug 2014 21:00:53 +0200
From: liling tan <alvations@gmail.com>
Subject: Re: [Moses-support] Using only the Moses decoder
To: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAKzPaJL_8+8xCz4v1PHL=Qx-f4t=_ncxmOs8=Ew2ucnuLXOhcQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear Phi and Moses dev/users,

@Phi , thank you for answering the question on moses' input.

Is that usually the phrase-table.gz file? Like this:

a ||| me ||| 0.1 0.2 0.1 0.2 2.7 ||| ||| ||| sp 2
b ||| you ||| 0.4 0.5 0.1 0.6 2.7 ||| ||| ||| so 8
b ||| it ||| 0.4 0.5 0.1 0.6 2.7 ||| ||| ||| po 2 io 7.1
c ||| she ||| 0.1 0.2 0.3 0.1 2.7 ||| ||| ||| o 1.2


What does the columns represent? Is there a documentation of how
the phrase-table.gz is formatted?

Regards,
Liling


On Mon, Aug 11, 2014 at 5:53 PM, Philipp Koehn <pkoehn@inf.ed.ac.uk> wrote:

> Hi,
>
> the decoder does not use the lex files - it requires the phrase table
> (and often the reordering table), as specified in a "moses.ini"
> configuration file.
>
> So you will need those files.
>
> -phi
>
>
>
> On Mon, Aug 11, 2014 at 11:42 AM, liling tan <alvations@gmail.com> wrote:
>
>> Dear Moses dev/users,
>>
>> I have a lex.e2f and lex.f2e and the language model files generated by
>> other software.
>>
>> May I know how do I use only the moses decoder to produce machine
>> translation output?
>>
>> How do I specify which lex file and language model file when using only
>> the moses decoder?
>>
>> Which script file should I use? Is there a single line command where i
>> call the moses decoder and specify the lex and langauge model file?
>>
>> Regards,
>> Liling
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140813/f0a28ffe/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 13 Aug 2014 20:50:47 +0100
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] xmlrpc problem
To: Sandipan Dandapat <sandipandandapat@gmail.com>, moses-support
<moses-support@mit.edu>
Message-ID: <53EBC197.4050804@staffmail.ed.ac.uk>
Content-Type: text/plain; charset="iso-8859-1"

Hi Sandipan

It looks as though GIZA++ cannot find the xmlrpc-c libraries. You need
to set your LD_LIBRARY_PATH, like this (assuming bash):

export LD_LIBRARY_PATH=/home/sdandapat/Moses/xmlrpc-c/lib64:$LD_LIBRARY_PATH

then check if you can run GIZA++ from the command line, before you try
building the model,

cheers - Barry


On 13/08/14 14:04, Sandipan Dandapat wrote:
> Hi,
> I am using inc-giza-pp, xmlrpc-c. All of them successfully compiled
> and my xmlrpc in installed in a local directory and the library files
> are located in /home/sdandapat/Moses/xmlrpc-c/lib64.
>
> Moses decoder also compiled fine with inc-giza-pp.
>
> During building the translation model, it fails with following error:
>
> /home/sdandapat/Moses/mosesdecoder/tools/GIZA++: error while loading
> shared libraries: libxmlrpc_server_abyss++.so.8: cannot open shared
> object file: No such file or directory
> Exit code: 127
> ERROR: Giza did not produce the output file
> /home/sdandapat/Moses_retrain/EnPl/train/giza.en-pl/en-pl.Ahmm.5. Is
> your corpus clean (reasonably-sized sentences)? at
> /home/sdandapat/Moses/mosesdecoder/scripts/training/train-model.perl
> line 1199.
>
> I am attaching the entire log. What am I doing wrong?
> I found similar post in
> http://blog.gmane.org/gmane.comp.nlp.moses.user/month=20111201 but
> could not find the end solution.
>
> Thanks and regards,
> sandipan
>
>
> --------------------------------
> Sandipan Dandapat
> Postdoctoral Researcher
> CNGL, School of Computing
> Dublin City University
> Google Scholar Profile:
> http://scholar.google.co.in/citations?user=DWD_FiQAAAAJ&hl=en
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140813/ed349d72/attachment-0001.htm

------------------------------

Message: 3
Date: Wed, 13 Aug 2014 22:15:59 +0100
From: Sandipan Dandapat <sandipandandapat@gmail.com>
Subject: Re: [Moses-support] xmlrpc problem
To: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAGr2oZR-8hWG7iyY=ObSJtfGw8ynYe=RT2LELvAe0-5oyhserQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Barry,
Thanks a ton, it worked. I have couple of follow up question.

1. Do we need to use moses-server version for incremental retraining using
moses?

2. In the website, I found we need to do something

% zcat ${CORPUS}.${L1}.gz | mtt-build -i -o /some/path/${CORPUS}.${L1}


But who generate this ${CORPUS}.${L1}.gz file. I am using inc-giza-pp and
I compiled mosesdecoder with --with-mm option and during training I used
option

However I am unable to figure out how to perform step 2 & 3 in
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc40 ?
Thanks and regards,
sandipan

--------------------------------
Sandipan Dandapat
Postdoctoral Researcher
CNGL, School of Computing
Dublin City University
Google Scholar Profile:
http://scholar.google.co.in/citations?user=DWD_FiQAAAAJ&hl=en


On Wed, Aug 13, 2014 at 8:50 PM, Barry Haddow <bhaddow@staffmail.ed.ac.uk>
wrote:

> Hi Sandipan
>
> It looks as though GIZA++ cannot find the xmlrpc-c libraries. You need to
> set your LD_LIBRARY_PATH, like this (assuming bash):
>
> export
> LD_LIBRARY_PATH=/home/sdandapat/Moses/xmlrpc-c/lib64:$LD_LIBRARY_PATH
>
> then check if you can run GIZA++ from the command line, before you try
> building the model,
>
> cheers - Barry
>
>
>
> On 13/08/14 14:04, Sandipan Dandapat wrote:
>
> Hi,
> I am using inc-giza-pp, xmlrpc-c. All of them successfully compiled and
> my xmlrpc in installed in a local directory and the library files are
> located in /home/sdandapat/Moses/xmlrpc-c/lib64.
>
> Moses decoder also compiled fine with inc-giza-pp.
>
> During building the translation model, it fails with following error:
>
> /home/sdandapat/Moses/mosesdecoder/tools/GIZA++: error while loading
> shared libraries: libxmlrpc_server_abyss++.so.8: cannot open shared object
> file: No such file or directory
> Exit code: 127
> ERROR: Giza did not produce the output file
> /home/sdandapat/Moses_retrain/EnPl/train/giza.en-pl/en-pl.Ahmm.5. Is your
> corpus clean (reasonably-sized sentences)? at
> /home/sdandapat/Moses/mosesdecoder/scripts/training/train-model.perl line
> 1199.
>
> I am attaching the entire log. What am I doing wrong?
> I found similar post in
> http://blog.gmane.org/gmane.comp.nlp.moses.user/month=20111201 but could
> not find the end solution.
>
> Thanks and regards,
> sandipan
>
>
> --------------------------------
> Sandipan Dandapat
> Postdoctoral Researcher
> CNGL, School of Computing
> Dublin City University
> Google Scholar Profile:
> http://scholar.google.co.in/citations?user=DWD_FiQAAAAJ&hl=en
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140813/6e059144/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 94, Issue 17
*********************************************

Tweet