Moses-support Digest, Vol 115, Issue 3

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Data for building a factored model (Marwa Refaie)


----------------------------------------------------------------------

Message: 1
Date: Mon, 2 May 2016 19:45:22 +0200
From: Marwa Refaie <basmallah@hotmail.com>
Subject: Re: [Moses-support] Data for building a factored model
To: Sa?o Kuntaric <saso.kuntaric@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <DUB408-EAS5504ECE00A0C44B7DDCC5BA790@phx.gbl>
Content-Type: text/plain; charset="utf-8"

Corpus for translation model should be on 2 parallel files in the format
Word | pos | Lema .... For example , by a file for each language. You can prepare files using word net , Stanford , or any tagger & stemmer as can deal with your language pairs. May be before enter the files to moses you should adjust the text files by a python script (write it your self)

For language model ... You must build it as follows
Verb noun noun
Noun Det adj
....... Depending on the target language only ,, Then build it as usual n-gram lm.

Sent from my iPad

> On May 2, 2016, at 10:11, Sa?o Kuntaric <saso.kuntaric@gmail.com> wrote:
>
> Hi all,
>
> I am having some issues producing the corpora in the correct format for Moses to execute factored training.
>
> I am looking at the factored tutorial on the Moses website and I am wondering, how to get such consistent corpora for two languages. What tools are being used and can they be trained for specific languages (Slovenian in my example). Are such tools available for download or is such data produced with custom scripts?
>
> --
> Best regards,
>
> Sa?o
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 115, Issue 3
*********************************************

Tweet