Moses-support Digest, Vol 196, Issue 2

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
https://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. [2nd CfP] Second Shared Task on Automatic Minuting at INLG
(Ondrej Bojar)


----------------------------------------------------------------------

Message: 1
Date: Wed, 15 Mar 2023 17:20:39 +0100 (CET)
From: Ondrej Bojar <bojar@ufal.mff.cuni.cz>
To: moses-support <moses-support@mit.edu>
Subject: [Moses-support] [2nd CfP] Second Shared Task on Automatic
Minuting at INLG
Message-ID:
<1248191904.1951601.1678897239758.JavaMail.zimbra@ufal.mff.cuni.cz>
Content-Type: text/plain; charset=utf-8

(apologies for multiple copies; this is not a MT task but related)

*** Second Shared Task on Automatic Minuting ***
*** AutoMin 2023 as INLG Challenge ***

Automatic summarization of meetings into meeting minutes (aka
`minuting') would be an amazing tool. Superficially, large language
models like BART, GPT* and friends may seem to have solved it already,
but serious concerns still remain regarding completeness and factual
correctness.

We would like invite you to take part in AutoMin 2023, the second
instance of the shared on automatic minuting, i.e. summarization of
English and Czech meeting transcripts into meeting minutes and their
evaluation. See the details on task options below.

AutoMin 2023 is a registered INLG Challenge this year.

*** Website ***

https://ufal.github.io/automin-2023/

*** Key Tasks (one or both) ***

- Task A: The main task consists of automatically creating minutes
from multiparty meeting transcripts. The generated minute will be
evaluated both via automatic and manual metrics.

- Task D: Given a meeting transcript, a candidate minutes, and a set of
one or more reference minutes, assign a score indicating the quality
of the candidate. Task D will not be evaluated by a single criterion.
All submissions to Task D will be evaluated in terms of Pearson
correlation against all manual and all automatic evaluation scores
available in AutoMin 2023, including other submissions to Task D.

*** Registration ***

Registration and participation is free of charge.

All participants need to register to get access to the test data.
Use this form and provide us with your github user name (one member
per team is fine):

https://forms.office.com/e/jdvsdtV5Tm

After registration, we will give you github access to the test data.

Please get in touch in case you would be willing to contribute to manual
evaluation of AutoMin submissions.

*** Important Dates (EXTENDED) ***

May 1, 2023 System Submission Deadline
May 15, 2023 Report Submission Deadline
July 25, 2023 Camera Ready Submission; in line with INLG
September, 2023 AutoMin @ INLG 2023

*** Publication ***

All teams are required to submit a brief technical report describing
their method. Please submit using the INLG paper template (details
here: https://inlg2023.github.io/calls.html).

All reports must be a minimum of 2 pages and a maximum of 4
pages excluding references. Reports must be written in English.
The proceedings will be published in ACL Anthology.

*** Organizers ***

Ond?ej Bojar, UFAL, Charles University, Czech Republic
Tirthankar Ghosal, UFAL, Charles University, Czech Republic
Marie Hledikova, UFAL, Charles University, Czech Republic
Anja Nedoluzhko, UFAL, Charles University, Czech Republic

*** Contact ***

For inquiries, contact <automin@ufal.mff.cuni.cz>.

--
Ondrej Bojar (mailto:obo@cuni.cz / bojar@ufal.mff.cuni.cz)
http://www.cuni.cz/~obo



------------------------------

Subject: Digest Footer

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
https://mailman.mit.edu/mailman/listinfo/moses-support


------------------------------

End of Moses-support Digest, Vol 196, Issue 2
*********************************************

Tweet