Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Call for Participation in Community Evaluation Effort for
MultiLingual Information Access (MLIA) on Covid-19 (Miguel Domingo)
----------------------------------------------------------------------
Message: 1
Date: Tue, 20 Oct 2020 09:15:12 +0200
From: Miguel Domingo <midobal@prhlt.upv.es>
Subject: [Moses-support] Call for Participation in Community
Evaluation Effort for MultiLingual Information Access (MLIA) on
Covid-19
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAPiKx4LSpDsMhoO4wT6qFDBVcvsPnaDQ6hr=+qiEJfq4_7X_yw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Covid-19 MLIA @ Eval
Call for Participation in the First Evaluation Round - Round Starts on 23
October 2020
Website: http://eval.covid19-mlia.eu/
<https://www.google.com/url?q=http://eval.covid19-mlia.eu/&sa=D&ust=1603132450458000&usg=AOvVaw13X2bUuOLmgFNhsLj38TAn>
Registration: http://eval.covid19-mlia.eu/registration/
<https://www.google.com/url?q=http://eval.covid19-mlia.eu/registration/&sa=D&ust=1603132450459000&usg=AOvVaw0cRGCjHJU3mhEZdYfjpIPc>
Twitter: @covid19mlia
Email: info@covid19-mlia.eu
*Overall Description*
Covid-19 MLIA @ Eval organizes a community evaluation effort aimed at
accelerating the creation of resources and tools for improved MultiLingual
Information Access (MLIA) in the current emergency situation with a
reference to a general public use case:
?Sofia has heard that a drug has been experimented in different countries
and she would like to have a consolidated and trustworthy view of the main
findings, whether the drug is effective or not, and whether there are any
adverse effects?.
Distillation for the general public also implies a level of
specialist-non-specialist communication, when the aggregated sources
contain both disseminative and specialised sources. Therefore, the general
public would need to understand medical expertise by using their
correspondent in the "popular" language or by using an appropriately
calibrated language for the communication to be effective.
Covid-19 MLIA @ Eval adopts an incremental and iterative evaluation
methodology to enable the release of intermediate (but functional)
resources and to progressively (iteration-after-iteration) move towards
finally consolidated tools and resources. We plan for three rounds,
tentatively one and half-month long each.
Each round consists of the following phases:
- - data release
- - submission of participants? runs
- - ground-truth creation (when needed)
- - scoring of participants? runs
- - writing of the rolling technical report
- - round wrap virtual meeting
An integral part of the Covid-19 MLIA @ Eval approach is the sharing of
information and ideas among the participants. This happens via the rolling
technical report where participants describe their solutions as the
evaluation rounds progress and the virtual meetings at the end of each
round where participants briefly present the main highlights of what worked
and what did not work and interactively discuss together in order to share
ideas and improve for the next round.
Moreover, to facilitate the exchange of resources and components and to
jointly work together for improving MLIA technologies for Covid-19,
participants are provided with a dedicated git repository where to push and
share the outcomes of your participation in the different rounds, i.e.
runs, code, (language) resources, and a technical report. To facilitate
sharing and re-use, all the contents of the repositories are released under
the Creative Commons Attribution-ShareAlike 4.0 International License.
Tasks
Covid-19 MLIA @ Eval offers the following tasks for its first round:
- - Information Extraction. More information at:
http://eval.covid19-mlia.eu/task1/
<https://www.google.com/url?q=http://eval.covid19-mlia.eu/task1/&sa=D&ust=1603132450462000&usg=AOvVaw0uEUhato9Wn-PEySD_i1Ru>
- - Multilingual Semantic Search. More information at:
http://eval.covid19-mlia.eu/task2/
<https://www.google.com/url?q=http://eval.covid19-mlia.eu/task2/&sa=D&ust=1603132450463000&usg=AOvVaw2TzrV8CSsEegf6HVxxzYL2>
- - Machine Translation. More information at:
http://eval.covid19-mlia.eu/task3/
<https://www.google.com/url?q=http://eval.covid19-mlia.eu/task3/&sa=D&ust=1603132450464000&usg=AOvVaw3p0pyTvRDEDEHaR1ABuU_W>
Registration for the tasks is open at:
http://eval.covid19-mlia.eu/registration/
<https://www.google.com/url?q=http://eval.covid19-mlia.eu/registration/&sa=D&ust=1603132450464000&usg=AOvVaw02EKyOgjbJSlrb5fF2_Y1N>
Important Dates - First Round
-
- - Registration Opens: 19 October 2020
- - Registration Closes: 14 May 2021
- - First Round Starts: 23 October 2020 (data release)
- - Submission of Technical Report: 8 January 2021
- - Round Wrap-up Virtual Meeting: 11-15 January 2021 (exact date TBD)
- - First Round Ends: 15 January 2021
More detailed dates are provided on the Web pages dedicated to each
specific task, since the internal scheduling of each task may differ
slightly to better match the task design.
Organizers
Overall
- - Khalid Choukri, ELDA, France
- - Nicola Ferro, University of Padua, Italy
Information Extraction
- - Cyril Grouin, LIMSI, France
- - Thierry Declerck, DFKI, Germany
- - Pierre Zweigenbaum, LIMSI, France
Multilingual Semantic Search
- - Giorgio Maria Di Nunzio, University of Padua, Italy
- - Maria Eskevich, CLARIN ERIC
Machine Translation
- - Francisco Casacuberta, Universitat Polit?cnica de Val?ncia, Spain
- - Miguel Domingo, Universitat Polit?cnica de Val?ncia, Spain
- - Mercedes Garc?a-Mart?nez, Pangeanic, Spain
- - Manuel Herranz, Pangeanic, Spain
Supporters
Covid-19 MLIA @ Eval is an evaluation effort promoted by several
communities which are closely working together.
- - European Commission https://ec.europa.eu/
<https://www.google.com/url?q=https://ec.europa.eu/&sa=D&ust=1603132450468000&usg=AOvVaw0v0f9n35aiCIUgnyQNnTw7>
- - European Language Resources Coordination (ELRC),
http://www.lr-coordination.eu/
<https://www.google.com/url?q=http://www.lr-coordination.eu/&sa=D&ust=1603132450468000&usg=AOvVaw0svqJ8djzuhNxCkSB1IHhM>
- - European Language Resources Association (ELRA)
http://www.elra.info/en/
<https://www.google.com/url?q=http://www.elra.info/en/&sa=D&ust=1603132450469000&usg=AOvVaw07ZQd4ID-Tcr0T7JqovDOh>
- - European Research Infrastructure for Language Resources and
Technology (CLARIN) https://www.clarin.eu/
<https://www.google.com/url?q=https://www.clarin.eu/&sa=D&ust=1603132450469000&usg=AOvVaw25Tqc4kFBAJK3z6sSTwi0u>
- - CLEF Initiative http://www.clef-initiative.eu/
<https://www.google.com/url?q=http://www.clef-initiative.eu/&sa=D&ust=1603132450470000&usg=AOvVaw3yC7FKTKsIzDgnCzEzypey>
We hope that other communities will join us in this shared effort. You are
very welcome!
Additional Information
You can find additional information on our Website:
http://eval.covid19-mlia.eu/
<https://www.google.com/url?q=http://eval.covid19-mlia.eu/&sa=D&ust=1603132450471000&usg=AOvVaw0KzEsTJJM2MylW3u42g9ea>
You can follow updates through our Twitter account @covid19mlia
Any requests or comments? Drop us an email at: info@covid19-mlia.eu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20201020/760d7406/attachment.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 168, Issue 8
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 168, Issue 8"
Post a Comment