Moses-support Digest, Vol 109, Issue 55

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: experiment.perl not working with config.toy (Hieu Hoang)
2. Pruning phrase-table (Sanjanashree Palanivel)
3. Re: Moses-support Digest, Vol 109, Issue 50 (Martin Baumg?rtner)


----------------------------------------------------------------------

Message: 1
Date: Tue, 24 Nov 2015 01:19:13 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] experiment.perl not working with
config.toy
To: Nicholas Ruiz <nicruiz@fbk.eu>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbja3Hv5h+S5sPETbpHcPAAoU3eRxVhqvuEkogb3R-mXpg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

my training-tools directory contains this:

Hieus:~/workspace/bin/training-tools$ll
total 2984
drwxr-xr-x 6 hieu staff 204 22 Apr 2015 ./
drwxr-xr-x 3 hieu staff 102 22 Apr 2015 ../
-rwxr-xr-x 1 hieu staff 2070 22 Apr 2015 merge_alignment.py*
-rwxr-xr-x 1 hieu staff 1096056 22 Apr 2015 mgiza*
-rwxr-xr-x 1 hieu staff 376012 22 Apr 2015 mkcls*
-rwxr-xr-x 1 hieu staff 48224 22 Apr 2015 snt2cooc*
Hieus:~/workspace/bin/training-tools$


Hieu Hoang
http://www.hoang.co.uk/hieu

On 20 November 2015 at 20:09, Nicholas Ruiz <nicruiz@fbk.eu> wrote:

> Hi all,
>
> I'm having some issues running config.toy with EMS (experiment.py). I have
> a vanilla installation of Moses, which compiles successfully, but EMS is
> giving me a headache with mgiza. I followed the instructions here and here
> to install Moses and mgiza:
> http://www.statmt.org/moses/?n=Development.GetStarted
> http://www.statmt.org/moses/?n=Moses.ExternalTools#ntoc3
>
> My moses installation is here:
> [nruiz@cheetah-h2 training-tools]$ cd
> /n/w10-nruiz/mosesdecoder/bin/training-tools
> [nruiz@cheetah-h2 training-tools]$ ls -l
> total 8
> -rwxr-xr-x 1 nruiz slt 3291 Nov 20 14:52 merge_alignment.py
> drwxr-xr-x 2 nruiz slt 4096 Nov 20 14:50 mgizapp
> [nruiz@cheetah-h2 training-tools]$ ls -l mgizapp/
> total 4188
> -rw-r--r-- 1 nruiz slt 3848 Nov 20 14:50 alignment.o
> -rw-r--r-- 1 nruiz slt 11144 Nov 20 14:50 AlignTables.o
> -rw-r--r-- 1 nruiz slt 57344 Nov 20 14:50 ATables.o
> ....
>
> When executing experiment.perl, I get an error in mgiza, complaining that
> mkcls can't be found. I'm enclosing my minor modification of config.toy for
> troubleshooting.
>
> Here's the command that fails:
>
> $ /n/w10-nruiz/mosesdecoder/scripts/training/train-model.perl -mgiza
> -mgiza-cpus 16 -dont-zip -first-step 2 -last-step 2 -external-bin-dir
> /n/w10-nruiz/mosesdecoder/bin/training-tools -f fr -e en -alignment
> grow-diag-final-and -max-phrase-length 5 -reordering msd-bidirectional-fe
> -score-options '--GoodTuring --MinScore 2:0.0001' -parallel -corpus-dir
> /n/w10-nruiz/mt/zh-en/experiment/toy/training/prepared.3 -giza-e2f
> /n/w10-nruiz/mt/zh-en/experiment/toy/training/giza.5 -direction 2
>
> Use of implicit split to @_ is deprecated at
> /n/w10-nruiz/mosesdecoder/scripts/training/train-model.perl line 2091.
>
> Using SCRIPTS_ROOTDIR: /n/w10-nruiz/mosesdecoder/scripts
>
> Using multi-thread GIZA
>
> using gzip
>
> ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in
> /n/w10-nruiz/mosesdecoder/bin/training-tools.
>
> You MUST specify the parameter -external-bin-dir at
> /n/w10-nruiz/mosesdecoder/scripts/training/train-model.perl line 484.
> Do you know why train-model.perl is having trouble finding the mgiza
> executables? Thanks for your help!
>
> Thanks,
> Nick
>
> z?n? ???u
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151123/4e35d5ef/attachment-0001.html

------------------------------

Message: 2
Date: Tue, 24 Nov 2015 11:12:27 +0530
From: Sanjanashree Palanivel <sanjanashree@gmail.com>
Subject: [Moses-support] Pruning phrase-table
To: moses-support@mit.edu
Message-ID:
<CAAc_kp4rj=4aXt-6gTq=rKDefDQf_yEKqB9-qpbR1eXG8f+uvA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear All,

I just tried to prune the phrase table using relent-filter insisde
mosesdecoder. I used the command as mentioned in the moses site (
http://www.statmt.org/moses/?n=Advanced.RuleTables). But, I am getting the
following error "Use of uninitialized value $_[0] in substitution (s///) at
/usr/share/perl/5.18/File/Basename.pm line 341.
fileparse(): need a valid pathname at
/home/sanjana/Documents/SMT/mosesdecoder/contrib/relent-filter/scripts/calcPruningScores.pl
line 140." . Where am i being worng.


--
Thanks and regards,

Sanjanasri J.P
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151124/f419760d/attachment-0001.html

------------------------------

Message: 3
Date: Tue, 24 Nov 2015 09:29:39 +0100
From: Martin Baumg?rtner <martin.baumgaertner@star-group.net>
Subject: Re: [Moses-support] Moses-support Digest, Vol 109, Issue 50
To: moses-support@mit.edu
Message-ID: <56541FF3.4060308@star-group.net>
Content-Type: text/plain; charset="windows-1252"

Hi Uli,

have you been successful with downloading the sample engine? If you got
problems with it, please let me know. Please take also into account that
it's a time limited upload (7 days) ...

Martin


Am 23.11.2015 um 08:21 schrieb moses-support-request@mit.edu:
> Send Moses-support mailing list submissions to
> moses-support@mit.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.mit.edu/mailman/listinfo/moses-support
> or, via email, send a message with subject or body 'help' to
> moses-support-request@mit.edu
>
> You can reach the person managing the list at
> moses-support-owner@mit.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Moses-support digest..."
>
>
> Today's Topics:
>
> 1. Re: Moses-support Digest, Vol 109, Issue 45 (Martin Baumg?rtner)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 23 Nov 2015 08:21:25 +0100
> From: Martin Baumg?rtner <martin.baumgaertner@star-group.net>
> Subject: Re: [Moses-support] Moses-support Digest, Vol 109, Issue 45
> To: moses-support@mit.edu
> Message-ID: <5652BE75.7020607@star-group.net>
> Content-Type: text/plain; charset="windows-1252"
>
> Hi Uli,
>
> you can download a hopefully tiny enough model [de-en] from here:
>
> https://fil.email/20szKB?utm_source=confirmation&utm_medium=email&utm_campaign=Email%20Confirmation&utm_content=free
>
> It's based on the first 5000 lines of the europarl corpus -
> http://www.statmt.org/europarl/v7/de-en.tgz + one magic sentence "Dies
> ist ein Test." - with 150 tune / 50 test segments randomly extracted.
>
> Extraction: tar xvfj walgn.tar.bz2
> Execution: cd waln_engine ; moses --servermoses.ini &
>
> Use xmlrpc-request (see previous email) or simply modify
> mosesdecoder/moses/TranslationRequest.cpp (line 396)
>
> if (m_withWordAlignInfo) {
>
> =>
>
> if (1) {
>
> ... recompile (mosesdecoder/previous.sh) and then call script
> client_test.perl ...
>
> Best,
> Martin
>
>
> Am 19.11.2015 um 18:10 schrieb moses-support-request@mit.edu:
>> Send Moses-support mailing list submissions to
>> moses-support@mit.edu
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>> or, via email, send a message with subject or body 'help' to
>> moses-support-request@mit.edu
>>
>> You can reach the person managing the list at
>> moses-support-owner@mit.edu
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of Moses-support digest..."
>>
>>
>> Today's Topics:
>>
>> 1. Re: Server issue with word-align (Martin Baumg?rtner)
>>
>>
>> ----------------------------------------------------------------------
>>
>> Message: 1
>> Date: Thu, 19 Nov 2015 18:10:28 +0100
>> From: Martin Baumg?rtner<martin.baumgaertner@star-group.net>
>> Subject: Re: [Moses-support] Server issue with word-align
>> To:ugermann@inf.ed.ac.uk
>> Cc:"moses-support@mit.edu" <moses-support@mit.edu>
>> Message-ID:<564E0284.9050802@star-group.net>
>> Content-Type: text/plain; charset="utf-8"
>>
>> Hi Uli,
>>
>> I'm using the following xmlrpc request:
>>
>> <?xml version="1.0" encoding="UTF-8"?>
>> <methodCall>
>> <methodName>translate</methodName>
>> <params><param><value>
>> <struct>
>> <member>
>> <name>text</name>
>> <value>
>> <string>dies ist ein Test .</string>
>> </value>
>> </member>
>> <member>
>> <name>word-align</name>
>> <value>
>> <string>1</string>
>> </value>
>> </member>
>> </struct></value></param>
>> </params>
>> </methodCall>
>>
>> For models, .ini etc. I'll send you tomorrow ...
>>
>> Martin
>>
>> Am 19.11.2015 um 17:53 schrieb Ulrich Germann:
>>> I can't replicate the crash. Can you send me small (!) models, the
>>> corresponding .ini file, and a json request that demonstrate the
>>> behaviour?
>>>
>>> - Uli
>>>
>>> On Thu, Nov 19, 2015 at 2:19 PM, Martin Baumg?rtner
>>> <martin.baumgaertner@star-group.net
>>> <mailto:martin.baumgaertner@star-group.net>> wrote:
>>>
>>> Hi all,
>>>
>>> after having pulled the latest version from master [b002fade]
>>> moses crashes when being called in server mode and requested with
>>> xmlrpc-c parameter 'word-align':
>>>
>>> > moses --server -f /path/to/moses.ini &
>>>
>>> Then send a request from client using 'word-align' member:
>>>
>>> [...]
>>> [moses/server/Server.cpp:36] Listening on port 8080
>>>
>>> [moses/server/TranslationRequest.cpp:319] Input: Dies ist ein
>>> Test .
>>> Translating: Dies ist ein Test .
>>> binary file loaded, default OFF_T: -1
>>> Line 0: Collecting options took 0.020 seconds at
>>> moses/Manager.cpp:134
>>> Line 0: Search took 0.042 seconds
>>> [moses/server/TranslationRequest.cpp:417] SERVER TRANSLATION:
>>> This is a test .
>>> terminate called after throwing an instance of 'girerr::error'
>>> what(): Assigning to already instantiated xmlrpc_c::value
>>>
>>>
>>> ... which appears to me like a bug.
>>>
>>> Thanks in advance!
>>>
>>> Cheers,
>>> Martin
>>>
>>> --
>>>
>>> *STAR Group*<http://www.star-group.net>
>>> <http://www.star-group.net/>
>>>
>>> *Martin Baumg?rtner*
>>>
>>> STAR Language Technology & Solutions GmbH
>>> Umberto-Nobile-Stra?e 19 | 71063 Sindelfingen | Germany
>>> Tel. +49 70 31-4 10 92-0
>>> <mailto:martin.baumgaertner@star-group.net>martin.baumgaertner@star-group.net
>>> <mailto:martin.baumgaertner@star-group.net>
>>> Fax +49 70 31-4 10 92-70 www.star-group.net
>>> <http://www.star-group.net/>
>>> Gesch?ftsf?hrer: Oliver Rau, Bernd Barth
>>> Handelsregister Stuttgart HRB 245654 | St.-Nr. 56098/11677
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>>
>>>
>>> --
>>> Ulrich Germann
>>> Senior Researcher
>>> School of Informatics
>>> University of Edinburgh

--

*STAR Group* <http://www.star-group.net>
<http://www.star-group.net/>

*Martin Baumg?rtner*

STAR Language Technology & Solutions GmbH
Umberto-Nobile-Stra?e 19 | 71063 Sindelfingen | Germany
Tel. +49 70 31-4 10 92-0 martin.baumgaertner@star-group.net
<mailto:martin.baumgaertner@star-group.net>
Fax +49 70 31-4 10 92-70 www.star-group.net <http://www.star-group.net/>
Gesch?ftsf?hrer: Oliver Rau, Bernd Barth
Handelsregister Stuttgart HRB 245654 | St.-Nr. 56098/11677

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151124/73b8a289/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ebiaihhg.gif
Type: image/gif
Size: 8030 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20151124/73b8a289/attachment.gif

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 109, Issue 55
**********************************************

Tweet