Moses-support Digest, Vol 88, Issue 51

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: publication for "mert-moses.pl --pro-starting-point " ?
(Marcin Junczys-Dowmunt)
2. Re: ERROR: Lexical reordering scoring failed at
moses/scripts/training/train-model.perl line 1738. (Barry Haddow)
3. Re: ERROR: Lexical reordering scoring failed at
moses/scripts/training/train-model.perl line 1738.
(=?GB2312?B?wO673bvd?=)


----------------------------------------------------------------------

Message: 1
Date: Mon, 24 Feb 2014 16:01:13 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] publication for "mert-moses.pl
--pro-starting-point " ?
To: Barry Haddow <bhaddow@staffmail.ed.ac.uk>, moses-support
<moses-support@mit.edu>
Message-ID: <530B5EB9.2050904@amu.edu.pl>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

Thanks,
what's your general experience with pro/kbmira and BLEU. For my metric,
it seems both methods do not really converge too well, although they
find improvements from time to time. Do you have a similar experience
with BLEU? If yes, do you let the optimization hit the 25 iterations limit?
Best,
Marcin

W dniu 23.02.2014 17:55, Barry Haddow pisze:
> Hi Marcin
>
> It's mentioned here:
> http://www.aclweb.org/anthology/W/W12/W12-3139.pdf
> (section 4.2) but it's not something we spent much time experimenting
> with,
>
> cheers - Barry
>
> On 23/02/14 15:12, Marcin Junczys-Dowmunt wrote:
>> Hi,
>> Is there a publication that describes the idea behind
>> "--pro-starting-point" option in mert-moses.pl? This seems to be working
>> really well for me.
>> Best,
>> Marcin
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>



------------------------------

Message: 2
Date: Mon, 24 Feb 2014 15:48:17 +0000
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] ERROR: Lexical reordering scoring failed
at moses/scripts/training/train-model.perl line 1738.
To: ??? <hui.li@informatik.uni-heidelberg.de>, moses-support@mit.edu
Message-ID: <530B69C1.4010204@staffmail.ed.ac.uk>
Content-Type: text/plain; charset=UTF-8; format=flowed

Hi Hui

It looks like your extract failed, but there is no error message. Do you
think it ran out of disk? Could you try again, but use absolute paths
everywhere?

cheers - Barry

On 24/02/14 09:44, ??? wrote:
>
>
> Hi Barry,
> attached is my log of phrase model training. Thx a lot.
>
> Best,
> Hui
>
>
>
> 2014-02-24 10:18 GMT+01:00 Barry Haddow <bhaddow@staffmail.ed.ac.uk
> <mailto:bhaddow@staffmail.ed.ac.uk>>:
>
> Hi Hui
>
> Something went wrong earlier in training which meant that
> extract.o.sorted.gz was not created. You need to attach the log of
> train-model,
>
> cheers - Barry
>
>
> On 24/02/14 08:38, ??? wrote:
>
>
>
>
> Hi all,
>
> when I was training the phrase model,
> hli@themisto:~/MT$ moses/scripts/training/train-model.perl
> home/hli/MT -corpus lm/1545.test.lowercased -external-bin-dir
> bin -e de -f ade -alignment grow-diag-final-and -reordering
> msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm
>
> I obtained this error:
>
> scores lexical reordering models of several types
> (hierarchical, phrase-based and word-based-extraction
> terminate called after throwing an instance of
> 'util::ErrnoException'
> what(): util/file.cc:67 in int util::OpenReadOrThrow(const
> char*) threw ErrnoException because `-1 == (ret = open(name,
> 00))'.
> No such file or directory while opening
> ./model/extract.o.sorted.gz
> Aborted (core dumped)
> Exit code: 134
> ERROR: Lexical reordering scoring failed at
> moses/scripts/training/train-model.perl line 1738.
>
> Attached is my corpus, could you help me to find out what's
> wrong with it ?
>
> Thx a lot!
>
> Best Regards,
> Hui Li
> Institute of Computer Science
> Heidelberg
>
> *
> *
>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support


--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

Message: 3
Date: Mon, 24 Feb 2014 17:00:49 +0100
From: =?GB2312?B?wO673bvd?= <hui.li@informatik.uni-heidelberg.de>
Subject: Re: [Moses-support] ERROR: Lexical reordering scoring failed
at moses/scripts/training/train-model.perl line 1738.
To: Barry Haddow <bhaddow@staffmail.ed.ac.uk>, moses-support@mit.edu
Message-ID:
<CAOG3Tm9wY+mHqktLSX1ZjN8+K+_rX-7xAOcoPTsYbAOrC+Cy3A@mail.gmail.com>
Content-Type: text/plain; charset="gb2312"

Hi Barry,
I tried to use absolute paths like this:

hli@themisto:~$ /home/hli/MT/moses/scripts/training/train-model.perl
/home/hli/MT -corpus /home/hli/MT/lm/1545.test.lowercased -external-bin-dir
/home/hli/MT/bin -e de -f ade -alignment grow-diag-final-and -reordering
msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm >& training.out &

but the same error still exists.

Is that anything wrong with my corpus?

Best,
Hui


2014-02-24 16:48 GMT+01:00 Barry Haddow <bhaddow@staffmail.ed.ac.uk>:

> Hi Hui
>
> It looks like your extract failed, but there is no error message. Do you
> think it ran out of disk? Could you try again, but use absolute paths
> everywhere?
>
> cheers - Barry
>
>
> On 24/02/14 09:44, ?????? wrote:
>
>>
>>
>> Hi Barry,
>> attached is my log of phrase model training. Thx a lot.
>>
>> Best,
>> Hui
>>
>>
>>
>> 2014-02-24 10:18 GMT+01:00 Barry Haddow <bhaddow@staffmail.ed.ac.uk<mailto:
>> bhaddow@staffmail.ed.ac.uk>>:
>>
>>
>> Hi Hui
>>
>> Something went wrong earlier in training which meant that
>> extract.o.sorted.gz was not created. You need to attach the log of
>> train-model,
>>
>> cheers - Barry
>>
>>
>> On 24/02/14 08:38, ?????? wrote:
>>
>>
>>
>>
>> Hi all,
>>
>> when I was training the phrase model,
>> hli@themisto:~/MT$ moses/scripts/training/train-model.perl
>> home/hli/MT -corpus lm/1545.test.lowercased -external-bin-dir
>> bin -e de -f ade -alignment grow-diag-final-and -reordering
>> msd-bidirectional-fe -lm 0:3:/home/hli/MT/lm/1545.test.lm
>>
>> I obtained this error:
>>
>> scores lexical reordering models of several types
>> (hierarchical, phrase-based and word-based-extraction
>> terminate called after throwing an instance of
>> 'util::ErrnoException'
>> what(): util/file.cc:67 in int util::OpenReadOrThrow(const
>> char*) threw ErrnoException because `-1 == (ret = open(name,
>> 00))'.
>> No such file or directory while opening
>> ./model/extract.o.sorted.gz
>> Aborted (core dumped)
>> Exit code: 134
>> ERROR: Lexical reordering scoring failed at
>> moses/scripts/training/train-model.perl line 1738.
>>
>> Attached is my corpus, could you help me to find out what's
>> wrong with it ?
>>
>> Thx a lot!
>>
>> Best Regards,
>> Hui Li
>> Institute of Computer Science
>> Heidelberg
>>
>> *
>> *
>>
>>
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> -- The University of Edinburgh is a charitable body, registered in
>> Scotland, with registration number SC005336.
>>
>>
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140224/ce117d0e/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 88, Issue 51
*********************************************

Tweet