Moses-support Digest, Vol 107, Issue 64

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Number of sentences (tokens) for tuning and testing
(peyman passban)
2. Re: Number of sentences (tokens) for tuning and testing
(peyman passban)
3. Re: Number of sentences (tokens) for tuning and testing
(Davood Mohammadifar)


----------------------------------------------------------------------

Message: 1
Date: Tue, 29 Sep 2015 10:27:39 +0100
From: peyman passban <pe.psbn@gmail.com>
Subject: Re: [Moses-support] Number of sentences (tokens) for tuning
and testing
To: Davood Mohammadifar <davood_mf@hotmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAC-B35QPESsm4UykXSFWBtqqfFrtNXgGqOTZSsEaaLyh5SSSNw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Davood
for Farsi (usually) 2k for dev and 1k for test is a good number

Cheers
Peyman

On Sat, Sep 26, 2015 at 12:37 PM, Davood Mohammadifar <davood_mf@hotmail.com
> wrote:

> Hello everyone
>
> For testing and tuning in Persian to English statistical machine
> translation with Moses, how many sentences (tokens) should the Dev and test
> contain? what is your recommendation?
> Both Persian and English sides have about 6 millions tokens (240K
> sentences).
>
> Thanks
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150929/c9ca68a9/attachment-0001.html

------------------------------

Message: 2
Date: Tue, 29 Sep 2015 10:28:50 +0100
From: peyman passban <pe.psbn@gmail.com>
Subject: Re: [Moses-support] Number of sentences (tokens) for tuning
and testing
To: Davood Mohammadifar <davood_mf@hotmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAC-B35S9XMd1EjNPXgrFz=fYnH369-FcrHuxEKO9WsY07LDjmg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

in my last email I meant 2k sentences not tokens !

Cheers
Peyman

On Tue, Sep 29, 2015 at 10:27 AM, peyman passban <pe.psbn@gmail.com> wrote:

> Hi Davood
> for Farsi (usually) 2k for dev and 1k for test is a good number
>
> Cheers
> Peyman
>
> On Sat, Sep 26, 2015 at 12:37 PM, Davood Mohammadifar <
> davood_mf@hotmail.com> wrote:
>
>> Hello everyone
>>
>> For testing and tuning in Persian to English statistical machine
>> translation with Moses, how many sentences (tokens) should the Dev and test
>> contain? what is your recommendation?
>> Both Persian and English sides have about 6 millions tokens (240K
>> sentences).
>>
>> Thanks
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150929/e27fa1bc/attachment-0001.html

------------------------------

Message: 3
Date: Tue, 29 Sep 2015 15:46:12 +0000
From: Davood Mohammadifar <davood_mf@hotmail.com>
Subject: Re: [Moses-support] Number of sentences (tokens) for tuning
and testing
To: peyman passban <pe.psbn@gmail.com>, Moses Support
<moses-support@mit.edu>
Message-ID: <SNT150-W82A3AA7298847ED68C31548C4E0@phx.gbl>
Content-Type: text/plain; charset="iso-8859-1"

Thanks Peyman for your help!

Date: Tue, 29 Sep 2015 10:28:50 +0100
Subject: Re: [Moses-support] Number of sentences (tokens) for tuning and testing
From: pe.psbn@gmail.com
To: davood_mf@hotmail.com
CC: moses-support@mit.edu

in my last email I meant 2k sentences not tokens !
Cheers Peyman
On Tue, Sep 29, 2015 at 10:27 AM, peyman passban <pe.psbn@gmail.com> wrote:
Hi Davood for Farsi (usually) 2k for dev and 1k for test is a good number
Cheers Peyman
On Sat, Sep 26, 2015 at 12:37 PM, Davood Mohammadifar <davood_mf@hotmail.com> wrote:



Hello everyone

For testing and tuning in Persian to English statistical machine translation with Moses, how many sentences (tokens) should the Dev and test contain? what is your recommendation?
Both Persian and English sides have about 6 millions tokens (240K sentences).

Thanks


_______________________________________________

Moses-support mailing list

Moses-support@mit.edu

http://mailman.mit.edu/mailman/listinfo/moses-support






-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150929/7dd363eb/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 107, Issue 64
**********************************************

Tweet