Moses-support Digest, Vol 126, Issue 28

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. MERT: process n-best list before mert (Jorg Tiedemann)
2. Re: MERT: process n-best list before mert (Anoop (?????))


----------------------------------------------------------------------

Message: 1
Date: Sat, 22 Apr 2017 14:40:03 +0300
From: Jorg Tiedemann <tiedeman@gmail.com>
Subject: [Moses-support] MERT: process n-best list before mert
To: moses-support <moses-support@mit.edu>
Message-ID: <5F340323-2F83-4812-8FBC-A6F556553726@gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

Is there an easy way to integrate a small script to process n-best lists in mert-moses.perl before running mert at each iteration? An example would be to merge character-level translations to run mert on word-level segmentations. It?s probably rather straightforward to add an option to specify a script for filtering but it may already exist and I just don?t see it?

Thanks!
J?rg

**********************************************************************************************
J?rg Tiedemann
Department of Modern Languages http://blogs.helsinki.fi/tiedeman/ <http://blogs.helsinki.fi/tiedeman/>
University of Helsinki http://blogs.helsinki.fi/language-technology/ <http://blogs.helsinki.fi/language-technology/>


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170422/bbc06c81/attachment-0001.html

------------------------------

Message: 2
Date: Sat, 22 Apr 2017 18:20:37 +0530
From: Anoop (?????) <anoop.kunchukuttan@gmail.com>
Subject: Re: [Moses-support] MERT: process n-best list before mert
To: Jorg Tiedemann <tiedeman@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CADXxMYf=G0D2YJ4Kwn98jcBdPEyU2Er0wRANLaVZN-cDAp9+YA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Jorg,

I had made changes to mert-moses.perl to achieve exactly what you are
looking for. Please find the script attached.

To enable character level to word level transformation, you have to pass
the option '--transform-decoded-file' to mert-moses.pl
The script assumes that a caret token '^' has been added between words
while preprocessing the corpora. So, all subwords between two carets are
merged to create a single word. The changes are on line 826--834.

Regards,
Anoop.



On Sat, Apr 22, 2017 at 5:10 PM, Jorg Tiedemann <tiedeman@gmail.com> wrote:

> Hi,
>
> Is there an easy way to integrate a small script to process n-best lists
> in mert-moses.perl before running mert at each iteration? An example would
> be to merge character-level translations to run mert on word-level
> segmentations. It?s probably rather straightforward to add an option to
> specify a script for filtering but it may already exist and I just don?t
> see it?
>
> Thanks!
> J?rg
>
> ************************************************************
> **********************************
> J?rg Tiedemann
> Department of Modern Languages http://blogs.helsinki.fi/tiedeman/
> University of Helsinki
> http://blogs.helsinki.fi/language-technology/
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
I claim to be a simple individual liable to err like any other fellow
mortal. I own, however, that I have humility enough to confess my errors
and to retrace my steps.

http://flightsofthought.blogspot.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170422/d2419f6b/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: mert-moses.pl
Type: application/x-perl
Size: 70955 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20170422/d2419f6b/attachment.bin

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 126, Issue 28
**********************************************

Tweet