Moses-support Digest, Vol 104, Issue 89

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: statistical significance test in moses (Ulrich Germann)


----------------------------------------------------------------------

Message: 1
Date: Thu, 25 Jun 2015 17:57:09 +0200
From: Ulrich Germann <ulrich.germann@gmail.com>
Subject: Re: [Moses-support] statistical significance test in moses
To: Saeed Farzi <saeedfarzi@gmail.com>, "moses-support@mit.edu"
<moses-support@mit.edu>
Message-ID:
<CAHQSRUqZ8HxHg-qxvtMsmOx3AvoFAhKK6sbhjLmUrEP2n2HK2w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

first number: observed "normal" BLEU score

second and third number: lower and upper bound of confidence interval at
confidence level choses (.95 by default, I think)

fourth number median BLEU score

Are the numbers you are giving actual numbers? They would mean that the
observed BLEU score is an extreme outlier. This does not make sense to me.
The first number should be close to the fourth. Was that be 21.26, maybe?

- Uli

On Thu, Jun 25, 2015 at 5:28 PM, Saeed Farzi <saeedfarzi@gmail.com> wrote:

> Tnx Ulrich.
>
> Would please tell me about its output
>
> ex. 23.26 multi-ref [20.29-21.71; 21.27]
>
> On Tue, Jun 9, 2015 at 2:40 AM, Ulrich Germann <ulrich.germann@gmail.com>
> wrote:
>
>> scripts/generic/bsbleu.py -h
>>
>> - Uli
>>
>> On Sun, Jun 7, 2015 at 2:40 PM, Saeed Farzi <saeedfarzi@gmail.com> wrote:
>>
>>> Dear all,
>>> I need a script for testing the statistical significance using bootstrap
>>> re-sampling . I heard that there is a tool in Mmoses toolkit for this. I
>>> need some information about it and how to use it.
>>>
>>> tnx in advance,
>>> bests,
>>> --
>>> S.Farzi, Ph.D. Student
>>> Natural Language Processing Lab,
>>> School of Electrical and Computer Eng.,
>>> Tehran University
>>> Tel: +9821-6111-9719
>>>
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>>
>> --
>> Ulrich Germann
>> Senior Researcher
>> School of Informatics
>> University of Edinburgh
>>
>
>
>
> --
> S.Farzi, Ph.D. Student
> Natural Language Processing Lab,
> School of Electrical and Computer Eng.,
> Tehran University
> Tel: +9821-6111-9719
>
>
>


--
Ulrich Germann
Senior Researcher
School of Informatics
University of Edinburgh
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150625/15cc7956/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 104, Issue 89
**********************************************

Tweet