Moses-support Digest, Vol 97, Issue 13

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Can't find Bleu Score (Apoorvi Singh)
2. Re: Can't find Bleu Score (Prashant Mathur)
3. Re: Help (Philipp Koehn)
4. Re: Can't find Bleu Score (Apoorvi Singh)
5. Re: Can't find Bleu Score (Prashant Mathur)


----------------------------------------------------------------------

Message: 1
Date: Tue, 11 Nov 2014 20:19:47 +0100
From: Apoorvi Singh <apoorvisingh@gmail.com>
Subject: [Moses-support] Can't find Bleu Score
To: moses-support@mit.edu
Message-ID:
<CAFB5vfSnW6hRpgQR_ajREC-Me_pgfhiE4US73P=WJSF8O9WeBQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear,

I am using the moses.ini configuration file with num-features=1.

While running the bleu script of the baseline system to find the bleu score
with this new configuration, I encounter Aborted-core dumped error.

I am unable to calculate bleu score. Do I need to make other changes in
configuration. Kindly help me with this.

Thanks and Regards,
Apoorvi
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141111/571dab40/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 12 Nov 2014 00:17:02 +0100
From: Prashant Mathur <prashant@fbk.eu>
Subject: Re: [Moses-support] Can't find Bleu Score
To: Apoorvi Singh <apoorvisingh@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAK3pNhJ4st1FLrSnF3Tef9pR6mWY9ANxZJDvLqCzz4VbQr85Rw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Apoorvi,

Can you send us your configuration file and also the exact command you ran
to produce the output?

Which script did you use to calculate BLEU score? How did you use it?

--Prashant

On Tue, Nov 11, 2014 at 8:19 PM, Apoorvi Singh <apoorvisingh@gmail.com>
wrote:

> Dear,
>
> I am using the moses.ini configuration file with num-features=1.
>
> While running the bleu script of the baseline system to find the bleu
> score with this new configuration, I encounter Aborted-core dumped error.
>
> I am unable to calculate bleu score. Do I need to make other changes in
> configuration. Kindly help me with this.
>
> Thanks and Regards,
> Apoorvi
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141112/ce3e96c0/attachment-0001.htm

------------------------------

Message: 3
Date: Tue, 11 Nov 2014 21:38:49 -0500
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] Help
To: Maria Marpaung <maria_marpaung@yahoo.co.id>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDAzk7xhiVphO90TyfL7D22cG6UDc6DpwExhe0Tw3ANrEA@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

Hi,

these are very small corpus sizes to train statistical machine
translation system. Typically, folks use at least 100 times
as many words.

You should be able to track down, why some translations
deteriorate - I would expect that coverage increases and
you would get better translations.

-phi

On Sun, Nov 9, 2014 at 7:50 AM, Maria Marpaung
<maria_marpaung@yahoo.co.id> wrote:
> Hello please help me,
> I want to ask, I have can run the translation using Moses. First, I using
> 1000 words. next I add a document to 2000 words. But, results generated
> translation worse than the 1000 document words.
> Can you give advice, what should I do?
>
> Best regards,
>
> Maria Marpaung
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

Message: 4
Date: Wed, 12 Nov 2014 04:54:18 +0100
From: Apoorvi Singh <apoorvisingh@gmail.com>
Subject: Re: [Moses-support] Can't find Bleu Score
To: Prashant Mathur <prashant@fbk.eu>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAFB5vfQWXWdkj+sX2gCB4wwE1RMpiivTX6RQz6f242UOP5JzXg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Prashant,

-- The modified configuration file 'moses.ini' is attached.

Changes done: num-features chnaged from 4 to 1 and TranslationModel0= 0.2.

-- Exact Bleu script used to produce the output:

> ~/btpp/mosesdecoder/scripts/training/filter-model-given-input.pl
filtered-newstest2011 mert-work/moses.ini
~/btpp/corpus/testingBleu/bleu.true.sorc -Binarizer
~/btpp/mosesdecoder/bin/processPhraseTable
[This script runs well]

> nohup nice ~/btpp/mosesdecoder/bin/moses -f
~/btpp/working/filtered-newstest2011/moses.ini <
~/btpp/corpus/testingBleu/bleu.true.sorc >
~/btpp/working/bleu.translated.dest 2> ~/btpp/working/bleu.out
[This command returns Aborted core dumped]


-Apoorvi


On Wed, Nov 12, 2014 at 12:17 AM, Prashant Mathur <prashant@fbk.eu> wrote:

> Hi Apoorvi,
>
> Can you send us your configuration file and also the exact command you ran
> to produce the output?
>
> Which script did you use to calculate BLEU score? How did you use it?
>
> --Prashant
>
> On Tue, Nov 11, 2014 at 8:19 PM, Apoorvi Singh <apoorvisingh@gmail.com>
> wrote:
>
>> Dear,
>>
>> I am using the moses.ini configuration file with num-features=1.
>>
>> While running the bleu script of the baseline system to find the bleu
>> score with this new configuration, I encounter Aborted-core dumped error.
>>
>> I am unable to calculate bleu score. Do I need to make other changes in
>> configuration. Kindly help me with this.
>>
>> Thanks and Regards,
>> Apoorvi
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>


--
*Apoorvi Singh*
*Undergraduate Student,*
*Department of Electrical Engineering,*
*IIT Delhi.*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141112/206f6f05/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: moses.ini
Type: application/octet-stream
Size: 903 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141112/206f6f05/attachment-0001.obj

------------------------------

Message: 5
Date: Wed, 12 Nov 2014 14:38:50 +0100
From: Prashant Mathur <prashant@fbk.eu>
Subject: Re: [Moses-support] Can't find Bleu Score
To: Apoorvi Singh <apoorvisingh@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAK3pNhLj8TW3i2OhgjADGC-D848J3UQ-2Vdm3wSKuNjOAJKN3A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Your config file looks ok as long as you have 1 feature in your phrase
table.

This script is used to filter the phrases in your phrase table and
reordering table based on "bleu.true.sorc" file.
*~/btpp/mosesdecoder/scripts/training/filter-model-given-input.pl
<http://filter-model-given-input.pl/> filtered-newstest2011
mert-work/moses.ini ~/btpp/corpus/testingBleu/bleu.true.sorc -Binarizer
~/btpp/mosesdecoder/bin/processPhraseTable*

Your problem is related to decoding. Can you send this log file :
*~/btpp/working/bleu.out *
It will better explain where the problem occurs.


On Wed, Nov 12, 2014 at 4:54 AM, Apoorvi Singh <apoorvisingh@gmail.com>
wrote:

> Hi Prashant,
>
> -- The modified configuration file 'moses.ini' is attached.
>
> Changes done: num-features chnaged from 4 to 1 and TranslationModel0= 0.2.
>
> -- Exact Bleu script used to produce the output:
>
> > ~/btpp/mosesdecoder/scripts/training/filter-model-given-input.pl
> filtered-newstest2011 mert-work/moses.ini
> ~/btpp/corpus/testingBleu/bleu.true.sorc -Binarizer
> ~/btpp/mosesdecoder/bin/processPhraseTable
> [This script runs well]
>
> > nohup nice ~/btpp/mosesdecoder/bin/moses -f
> ~/btpp/working/filtered-newstest2011/moses.ini <
> ~/btpp/corpus/testingBleu/bleu.true.sorc >
> ~/btpp/working/bleu.translated.dest 2> ~/btpp/working/bleu.out
> [This command returns Aborted core dumped]
>
>
> -Apoorvi
>
>
> On Wed, Nov 12, 2014 at 12:17 AM, Prashant Mathur <prashant@fbk.eu> wrote:
>
>> Hi Apoorvi,
>>
>> Can you send us your configuration file and also the exact command you
>> ran to produce the output?
>>
>> Which script did you use to calculate BLEU score? How did you use it?
>>
>> --Prashant
>>
>> On Tue, Nov 11, 2014 at 8:19 PM, Apoorvi Singh <apoorvisingh@gmail.com>
>> wrote:
>>
>>> Dear,
>>>
>>> I am using the moses.ini configuration file with num-features=1.
>>>
>>> While running the bleu script of the baseline system to find the bleu
>>> score with this new configuration, I encounter Aborted-core dumped error.
>>>
>>> I am unable to calculate bleu score. Do I need to make other changes in
>>> configuration. Kindly help me with this.
>>>
>>> Thanks and Regards,
>>> Apoorvi
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>
>
> --
> *Apoorvi Singh*
> *Undergraduate Student,*
> *Department of Electrical Engineering,*
> *IIT Delhi.*
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141112/6d059a7c/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 97, Issue 13
*********************************************

Tweet