Moses-support Digest, Vol 135, Issue 22

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Recommendations for preparing Korean parallel corpora? (daideqi)
2. Compress PhraseTable in Moses 2 (Kuznetsova, Rita)


----------------------------------------------------------------------

Message: 1
Date: Wed, 17 Jan 2018 01:01:29 +0000 (UTC)
From: daideqi <daideqi@yahoo.com>
Subject: [Moses-support] Recommendations for preparing Korean parallel
corpora?
To: Moses-support <moses-support@mit.edu>
Message-ID: <212978559.2228520.1516150889373@mail.yahoo.com>
Content-Type: text/plain; charset="utf-8"

Dear Moses-Support,
Some colleagues and I, who are all new to SMT and Moses, have some Korean parallel corpora that we want to use to train Moses.??
My question is how do we go about preparing/tokenizing the data, and can you recommend any specific tools?? I searched the moses-support archive and the Interwebs and couldn't find any specific recommendations or step-by-step instructions for newbs like us.
We'd be very grateful if you could point us in the right direction.
Thanks in advance!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180116/ed601d53/attachment-0001.html

------------------------------

Message: 2
Date: Wed, 17 Jan 2018 15:26:45 +0300
From: "Kuznetsova, Rita" <rita.kuznetsova@phystech.edu>
Subject: [Moses-support] Compress PhraseTable in Moses 2
To: moses-support@mit.edu
Message-ID:
<CAODKyR+pGwsV+BJeu7=W4qbnG84Gq-Uw4iNLa2_dEO0F04c06w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello,
I am trying to improve the performance of Moses and use Moses2. As I
understood Moses2 doesn't support the Compact phrase-table. But I need to
compress PhraseTable and ReorderingTable.
What the alternative for this - script
scripts/generic/binarize4moses2.perl? Is there any readme or tutorial?

Thanks, Rita
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180117/2d6d4dca/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 135, Issue 22
**********************************************

Tweet