Moses-support Digest, Vol 127, Issue 30

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Convert parallel text files to sgm format (Rico Sennrich)


----------------------------------------------------------------------

Message: 1
Date: Thu, 18 May 2017 12:20:15 +0100
From: Rico Sennrich <rico.sennrich@gmx.ch>
Subject: Re: [Moses-support] Convert parallel text files to sgm format
To: moses-support@mit.edu
Message-ID: <27bebd67-4adc-e9f2-50bc-546245dd091e@gmx.ch>
Content-Type: text/plain; charset="windows-1252"

Hi Roee,

I know people have written scripts like this in the past, but I don't
know of any that is public.

I also have a variant of multi-bleu.perl that takes in plain text, but
re-uses the internal tokenization of mteval-v13a.pl. As a consequence,
you can pass it untokenized references and output, and it will produce
the same results as mteval-v13a.pl.

The script is at
https://github.com/rsennrich/nematus/blob/master/data/multi-bleu-detok.perl

best wishes,
Rico

On 08/05/17 07:26, Roee Aharoni wrote:
> Hi,
>
> Is there a script in moses that converts simple parallel text files
> into the .sgm format required by the mteval-v13a.pl
> <http://mteval-v13a.pl>?
>
> I only found: /scripts/ems/support/wrap-xml.perl which wraps the
> target file, but requires the source file to be in sgm format.
>
> Thanks,
> Roee
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170518/66172695/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 127, Issue 30
**********************************************

Tweet