Moses-support Digest, Vol 126, Issue 29

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: MERT: process n-best list before mert (Jorg Tiedemann)


----------------------------------------------------------------------

Message: 1
Date: Sat, 22 Apr 2017 17:44:06 +0300
From: Jorg Tiedemann <tiedeman@gmail.com>
Subject: Re: [Moses-support] MERT: process n-best list before mert
To: "Anoop (?????)" <anoop.kunchukuttan@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <C6E87F39-A161-4455-ABAE-99D30A7916E7@gmail.com>
Content-Type: text/plain; charset="utf-8"


Great - thanks. I modified a little to make it possible to pass a command to the new option.
I hope I didn?t break anything. Maybe this modification could become part of the official moses package?

J?rg

J?rg Tiedemann
tiedeman@gmail.com






> On 22 Apr 2017, at 15:50, Anoop (?????) <anoop.kunchukuttan@gmail.com> wrote:
>
> Hi Jorg,
>
> I had made changes to mert-moses.perl to achieve exactly what you are looking for. Please find the script attached.
>
> To enable character level to word level transformation, you have to pass the option '--transform-decoded-file' to mert-moses.pl <http://mert-moses.pl/>
> The script assumes that a caret token '^' has been added between words while preprocessing the corpora. So, all subwords between two carets are merged to create a single word. The changes are on line 826--834.
>
> Regards,
> Anoop.
>
>
>
> On Sat, Apr 22, 2017 at 5:10 PM, Jorg Tiedemann <tiedeman@gmail.com <mailto:tiedeman@gmail.com>> wrote:
> Hi,
>
> Is there an easy way to integrate a small script to process n-best lists in mert-moses.perl before running mert at each iteration? An example would be to merge character-level translations to run mert on word-level segmentations. It?s probably rather straightforward to add an option to specify a script for filtering but it may already exist and I just don?t see it?
>
> Thanks!
> J?rg
>
> **********************************************************************************************
> J?rg Tiedemann
> Department of Modern Languages http://blogs.helsinki.fi/tiedeman/ <http://blogs.helsinki.fi/tiedeman/>
> University of Helsinki http://blogs.helsinki.fi/language-technology/ <http://blogs.helsinki.fi/language-technology/>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support <http://mailman.mit.edu/mailman/listinfo/moses-support>
>
>
>
>
> --
> I claim to be a simple individual liable to err like any other fellow mortal. I own, however, that I have humility enough to confess my errors and to retrace my steps.
>
> http://flightsofthought.blogspot.com <http://flightsofthought.blogspot.com/><mert-moses.pl>_______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170422/f32af9d4/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: mert-moses.pl
Type: text/x-perl-script
Size: 71372 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20170422/f32af9d4/attachment.bin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170422/f32af9d4/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 126, Issue 29
**********************************************

Tweet