Moses-support Digest, Vol 159, Issue 6

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. CFP: 2020 Duolingo Shared Task on Translation + Paraphrase
(Klinton Bicknell)


----------------------------------------------------------------------

Message: 1
Date: Wed, 15 Jan 2020 11:47:58 -0500
From: Klinton Bicknell <klinton@duolingo.com>
Subject: [Moses-support] CFP: 2020 Duolingo Shared Task on Translation
+ Paraphrase
To: moses-support@mit.edu
Message-ID:
<CAAymc2b4MyHwY9qc-OxZ57wzMz7918h0wxt0tpLKb5PXN7udxw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

CFP: 2020 Duolingo Shared Task on Translation + Paraphrase1st call for
participation in STAPLE: Simultaneous Translation And Paraphrase for
Language Education

Duolingo AI Research <https://research.duolingo.com/> is excited to
announce a new shared task on translation and paraphrasing to be held as
part of the Workshop on Neural Generation and Translation (WNGT)
<https://sites.google.com/view/wngt20/>, collocated with ACL 2020
<https://acl2020.org/> in Seattle.

Visit the shared task website here: sharedtask.duolingo.com

Sign up on the mailing list here:
https://groups.google.com/forum/#!forum/duolingo-sharedtask-2020

BACKGROUND

Machine translation systems typically produce a single output, but in
certain cases, it is desirable to have many possible translations of a
given input text. This situation is common with Duolingo
<https://www.duolingo.com/> (the world's largest language-learning
platform), where some learning happens via translation-based exercises, and
grading is done by comparing learners' responses against a large set of
human-curated acceptable translations.

SHARED TASK

In this shared task, participants start with English prompts and generate
high-coverage sets of plausible translations in five other languages. For
evaluation, we provide sentences with handcrafted, field-tested sets of
possible translations, weighted and ranked according to actual learner
response frequency. We will also provide high-quality automatic
translations of each input sentence that may (optionally) be used as a
reference/anchor point, and also serves as a strong baseline. In this way,
we expect the task to be of interest to diverse researchers in machine
translation, MT evaluation, multilingual paraphrase, and language education
technology fields.

IMPORTANT DATES

13-Jan-2020: Data release (phase 1): TRAIN set + starter code

02-Mar-2020: Data release (phase 2): blind DEV set

30-Mar-2020: Data release (phase 3): blind TEST set

06-Apr-2020: Final predictions deadline

08-Apr-2020: Final results announcement

13-Apr-2020: Draft system papers due

04-May-2020: System paper reviews returned

18-May-2020: Camera-ready system papers due

~9-Jul-2020: Workshop at ACL in Seattle!

ORGANIZERS

Klinton Bicknell (Duolingo)

Chris Brust (Duolingo)

Stephen Mayhew (Duolingo)

Bill McDowell (Duolingo)

Will Monroe (Duolingo)

Burr Settles (Duolingo)

sharedtask.duolingo.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20200115/d250a0e7/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 159, Issue 6
*********************************************

Tweet