Moses-support Digest, Vol 91, Issue 16

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Preparing training data (Achim Ruopp)


----------------------------------------------------------------------

Message: 1
Date: Sun, 11 May 2014 20:23:34 -0400
From: "Achim Ruopp" <achimru@gmail.com>
Subject: Re: [Moses-support] Preparing training data
To: "'Hieu Hoang'" <hieuhoang@gmail.com>, " 'Ricardo Cabello S?nchez'
" <ricardo.cabello.sanchez@googlemail.com>, <moses-support@mit.edu>
Message-ID: <027701cf6d78$69793d10$3c6bb730$@com>
Content-Type: text/plain; charset="iso-8859-1"

There are several tools in M4Loc to process TMX files (e.g. convert them to
parallel corpus files):

https://code.google.com/p/m4loc/wiki/TMXTools

The Perl scripts are platform independent. Adobe provided the TMX to Moses
Corpus Tooltool, so I'm not too familiar with it (indeed the install
packages are available only for the Mac - the only platform where both the
UI package Adobe AIR and Moses Unix-scripts are fully supported).



There is also https://code.google.com/p/extract-tmx-corpus/



I think there is at least one more tool to convert TMX into a parallel
corpus, but the name escapes me right now.



Achim





From: moses-support-bounces@mit.edu [mailto:moses-support-bounces@mit.edu]
On Behalf Of Hieu Hoang
Sent: Saturday, May 10, 2014 5:11 PM
To: Ricardo Cabello S?nchez; moses-support@mit.edu
Subject: Re: [Moses-support] Preparing training data



the Moses4Localization project might have tools you need to deal with TMX.
https://code.google.com/p/m4loc/
Moses itself only accept raw text file

On 05/05/2014 11:58, Ricardo Cabello S?nchez wrote:

Dear all,



I would like to ask you how to proceed to prepare data to train the system.

The thing is that I have a lot of translation data in xml files: one with
original text and one with translation text and I would like to know how to
prepare them. I would need to convert files into text files without tags? Is
there some way to use a tmx file to train system?



Thank you and best regards,



Ricardo






_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support



-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140511/3af31651/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 91, Issue 16
*********************************************

Tweet