Moses-support Digest, Vol 88, Issue 40

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: How to split data into training/testing sets (Philipp Koehn)


----------------------------------------------------------------------

Message: 1
Date: Tue, 18 Feb 2014 10:21:01 -0500
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] How to split data into training/testing
sets
To: Arefeh Kazemi <arefeh_kazemi@yahoo.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDAJFETuBYfyUncnwp2TqM=awA0trSgDwfu2W8G5Bh3yaA@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1

Hi,

in the WMT evaluations, we typically have a test set of 3000 sentences,
so you should choose something similar in size. The bulk of the data
should go into training. A tuning set should have 1000-3000 sentences
as well.

-phi

On Sat, Feb 15, 2014 at 5:50 PM, Arefeh Kazemi <arefeh_kazemi@yahoo.com> wrote:
> Hello,
>
> I want to estimate the bleu score for translating between two languages
> using Moses. I have a corpus with one million sentence pairs which should be
> divided into train, development and test sets. I used 1000 sentences for
> tuning and split the others into train and test sets. By increasing the size
> of the test set, the bleu score will decrease.
> I want to know what is the reasonable size for the train and test data sets
> to get a reliable bleu score?
>
> Regards
> Arefeh
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 88, Issue 40
*********************************************

Tweet