Moses-support Digest, Vol 86, Issue 63

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. about testing on part of training dataset (nadeem khan)


----------------------------------------------------------------------

Message: 1
Date: Sat, 21 Dec 2013 08:13:51 -0800 (PST)
From: nadeem khan <nad_star06@yahoo.com>
Subject: [Moses-support] about testing on part of training dataset
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<1387642431.92835.YahooMailNeo@web162401.mail.bf1.yahoo.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi?

Can anyone please tell me about why we got low BLEU score on a testset we get from training set for sparse resourced languages like Indian languages.
I tested a Hindi system on both, means original testset and a testset extracted from Training data, just to get how things goes with testing the system some segments from training.
But I got shocked when go through BLEU scores there is only 20-30% improvments in BLEU from original to training set. I was expecting a 100% BLEU from testset extracted from training data for experimenting.
Kindly anyone of you tell me with some example why we cannot get 100% BLEU on testset from training ???

THANK YOU

Regards
Nadeem Khan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131221/dad58afe/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 86, Issue 63
*********************************************

Tweet