Moses-support Digest, Vol 121, Issue 4

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. error in mosesdecoder tuning (Hasan Sait ARSLAN)
2. Re: error in mosesdecoder tuning (Hieu Hoang)
3. Re: error in mosesdecoder tuning (Hasan Sait ARSLAN)


----------------------------------------------------------------------

Message: 1
Date: Tue, 1 Nov 2016 19:30:47 +0200
From: Hasan Sait ARSLAN <hasan.sait.arslan@gmail.com>
Subject: [Moses-support] error in mosesdecoder tuning
To: moses-support@mit.edu
Message-ID:
<CAJj7HD2j27hcX1B-qOgePBt_-pEur17cPW=ExWU5qCA+fqC7Bg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello,

I have trained dataset for 5 days, and for 2-3 days I am dealing with the
bug in tuning, but still couldn't solve the problem.

I use the following command to run:



*/home/sait/mosesdecoder/scripts/training/mert-moses.pl
<http://mert-moses.pl> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr
<http://dev.clean.tr> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.en
/home/sait/mosesdecoder/bin/moses
/home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini --working-dir
/home/sait/Kairit/Task3/working_tr-en/mert --decoder-flags "--threads 32"*
Then I get the following error:









*Using SCRIPTS_ROOTDIR: /home/sait/mosesdecoder/scriptsAssuming
--mertdir=/home/sait/mosesdecoder/binfiltering the phrase tables... T
nov 1 19:17:39 EET 2016exec:
/home/sait/mosesdecoder/scripts/training/filter-model-given-input.pl
<http://filter-model-given-input.pl> ./filtered
/home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini
/home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr
<http://dev.clean.tr>Executing:
/home/sait/mosesdecoder/scripts/training/filter-model-given-input.pl
<http://filter-model-given-input.pl> ./filtered
/home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini
/home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr <http://dev.clean.tr> >
filterphrases.out 2> filterphrases.errExit code: 255ERROR: Failed to run
'/home/sait/mosesdecoder/scripts/training/filter-model-given-input.pl
<http://filter-model-given-input.pl> ./filtered
/home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini
/home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr <http://dev.clean.tr>'.
at /home/sait/mosesdecoder/scripts/training/mert-moses.pl
<http://mert-moses.pl> line 1748.*
I have searched over the internet about the error, but unfortunately I
couldn't find any beneficial solution.

It is so annoying, and eats my time, please help me to solve my problem.

Thanks,
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161101/677386d8/attachment-0001.html

------------------------------

Message: 2
Date: Tue, 1 Nov 2016 14:37:03 -0500
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] error in mosesdecoder tuning
To: Hasan Sait ARSLAN <hasan.sait.arslan@gmail.com>,
moses-support@mit.edu
Message-ID: <e6800669-06e9-b42c-6327-ffbfdb51fe88@gmail.com>
Content-Type: text/plain; charset="windows-1252"

the command you execute looks ok. the problem is likely to be with your
using tuning data.

You should look at your tuning data, make sure you've spelt the path and
filename correctly, use a very small subset (eg. start with 1 parallel
sentence) and increase the number of sentences until you find the problem



On 01/11/2016 12:30, Hasan Sait ARSLAN wrote:
> Hello,
>
> I have trained dataset for 5 days, and for 2-3 days I am dealing with
> the bug in tuning, but still couldn't solve the problem.
>
> I use the following command to run:
>
> */home/sait/mosesdecoder/scripts/training/mert-moses.pl
> <http://mert-moses.pl>
> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr
> <http://dev.clean.tr>
> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.en
> /home/sait/mosesdecoder/bin/moses
> /home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini
> --working-dir /home/sait/Kairit/Task3/working_tr-en/mert
> --decoder-flags "--threads 32"
>
> *
> Then I get the following error:
>
> *Using SCRIPTS_ROOTDIR: /home/sait/mosesdecoder/scripts
> Assuming --mertdir=/home/sait/mosesdecoder/bin
> filtering the phrase tables... T nov 1 19:17:39 EET 2016
> exec:
> /home/sait/mosesdecoder/scripts/training/filter-model-given-input.pl
> <http://filter-model-given-input.pl> ./filtered
> /home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini
> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr <http://dev.clean.tr>
> Executing:
> /home/sait/mosesdecoder/scripts/training/filter-model-given-input.pl
> <http://filter-model-given-input.pl> ./filtered
> /home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini
> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr
> <http://dev.clean.tr> > filterphrases.out 2> filterphrases.err
> Exit code: 255
> ERROR: Failed to run
> '/home/sait/mosesdecoder/scripts/training/filter-model-given-input.pl
> <http://filter-model-given-input.pl> ./filtered
> /home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini
> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr
> <http://dev.clean.tr>'. at
> /home/sait/mosesdecoder/scripts/training/mert-moses.pl
> <http://mert-moses.pl> line 1748.
>
> *
> I have searched over the internet about the error, but unfortunately I
> couldn't find any beneficial solution.
>
> It is so annoying, and eats my time, please help me to solve my problem.
>
> Thanks,
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161101/0bc3f0ad/attachment-0001.html

------------------------------

Message: 3
Date: Tue, 1 Nov 2016 21:41:43 +0200
From: Hasan Sait ARSLAN <hasan.sait.arslan@gmail.com>
Subject: Re: [Moses-support] error in mosesdecoder tuning
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAJj7HD307JBsQvKOjR81TYHTu+1TEd7esEy2husXE7pWUXojWQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thank you Hieu, I will do it, and give you feedback about it.

Kind Regards,

2016-11-01 21:37 GMT+02:00 Hieu Hoang <hieuhoang@gmail.com>:

> the command you execute looks ok. the problem is likely to be with your
> using tuning data.
>
> You should look at your tuning data, make sure you've spelt the path and
> filename correctly, use a very small subset (eg. start with 1 parallel
> sentence) and increase the number of sentences until you find the problem
>
>
>
> On 01/11/2016 12:30, Hasan Sait ARSLAN wrote:
>
> Hello,
>
> I have trained dataset for 5 days, and for 2-3 days I am dealing with the
> bug in tuning, but still couldn't solve the problem.
>
> I use the following command to run:
>
>
>
> */home/sait/mosesdecoder/scripts/training/mert-moses.pl
> <http://mert-moses.pl> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr
> <http://dev.clean.tr> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.en
> /home/sait/mosesdecoder/bin/moses
> /home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini --working-dir
> /home/sait/Kairit/Task3/working_tr-en/mert --decoder-flags "--threads 32" *
> Then I get the following error:
>
>
>
>
>
>
>
>
>
> *Using SCRIPTS_ROOTDIR: /home/sait/mosesdecoder/scripts Assuming
> --mertdir=/home/sait/mosesdecoder/bin filtering the phrase tables... T
> nov 1 19:17:39 EET 2016 exec:
> /home/sait/mosesdecoder/scripts/training/filter-model-given-input.pl
> <http://filter-model-given-input.pl> ./filtered
> /home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini
> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr <http://dev.clean.tr>
> Executing:
> /home/sait/mosesdecoder/scripts/training/filter-model-given-input.pl
> <http://filter-model-given-input.pl> ./filtered
> /home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini
> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr <http://dev.clean.tr> >
> filterphrases.out 2> filterphrases.err Exit code: 255 ERROR: Failed to run
> '/home/sait/mosesdecoder/scripts/training/filter-model-given-input.pl
> <http://filter-model-given-input.pl> ./filtered
> /home/sait/Kairit/Task3/working_tr-en/train/model/moses.ini
> /home/sait/Kairit/Task3/dataset_tur_en/dev.clean.tr <http://dev.clean.tr>'.
> at /home/sait/mosesdecoder/scripts/training/mert-moses.pl
> <http://mert-moses.pl> line 1748. *
> I have searched over the internet about the error, but unfortunately I
> couldn't find any beneficial solution.
>
> It is so annoying, and eats my time, please help me to solve my problem.
>
> Thanks,
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161101/423d5f08/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 121, Issue 4
*********************************************

Tweet