Moses-support Digest, Vol 174, Issue 9

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. (no subject) (Namrata Hadimani)
2. Call for Participation: WMT 2021 Machine Translation using
Terminologies (Philipp Koehn)
3. Failed to compile moses using command on Ubuntu 20.04 WSL
(Namrata Hadimani)


----------------------------------------------------------------------

Message: 1
Date: Fri, 23 Apr 2021 19:21:17 +0100
From: Namrata Hadimani <namrata.hadimani@mycit.ie>
Subject: [Moses-support] (no subject)
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAN3QW0BOoWMBskkS0fvc9T2rLi7Y4=eYyzhLq9LYp6gca2516w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Moses-Support,

I ran the following command :
mkdir ~/working

cd ~/working
nohup nice ~/mosesdecoder/scripts/training/train-model.perl -root-dir train \
-corpus ~/corpus/news-commentary-v8.fr-en.clean \
-f fr -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe \
-lm 0:3:$HOME/lm/news-commentary-v8.fr-en.blm.en:8 \
-external-bin-dir ~/mosesdecoder/tools >& training.out &


And it generated the training.out file in the working directory. But there
seems to be an error can you guys guide me on this?

ERROR:





*nohup: ignoring inputUsing SCRIPTS_ROOTDIR:
/home/namrata/smt/mosesdecoder/scriptsUsing single-thread GIZAusing
gzipERROR: use --f to specify foreign language at
/home/namrata/smt/mosesdecoder/scripts/training/train-model.perl line 524.*

Regards,
Namrata Hadimani
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20210423/884239b8/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 23 Apr 2021 18:03:43 -0400
From: Philipp Koehn <phi@jhu.edu>
Subject: [Moses-support] Call for Participation: WMT 2021 Machine
Translation using Terminologies
To: <wmt-tasks@googlegroups.com>, Moses Support
<moses-support@mit.edu>, "corpora@uib.no" <CORPORA@uib.no>
Message-ID:
<CAAFADDBpQCyXGOdFTYMN185fB_iKKYn=CqFDoqsRnoj3XXwDEQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

WMT 2021 Shared Task:
Machine Translation using Terminologies

*November 10-11 , 2021Punta Cana, Dominican Republic*

Language domains that require very careful use of terminology are abundant.
The need to adequately translate within such domains is undeniable, as
shown by e.g. the different WMT shared tasks on biomedical translation.

More interestingly, as the abundance of research on domain adaptation
shows, such language domains are (a) not adequately covered by existing
data and models, while (b) new (or ?surge?) domains arise and models need
to be adapted, often with significant downstream implications: consider the
new COVID-19 domain and the large efforts for translation of critical
information regarding pandemic handling and infection prevention strategies.

In the case of newly developed domains, while parallel data are hard to
come by, it is fairly straightforward to create word- or phrase-level
terminologies, which can be used to guide professional translators and
ensure both accuracy and consistency.

This shared task will replicate such a scenario, and invites participants
to explore methods to incorporate terminologies into either the training or
the inference process, in order to improve both the accuracy and
consistency of MT systems on a new domain.
IMPORTANT DATES
Release of training data and terminologies April 2021
Surprise languages announced: June 28, 2021
Test set available July 19, 2021
Submission of translations July 23, 2021
System descriptions due August 5, 2021
Camera-ready for system descriptions September 15, 2021
Conference in Punta Cana November 10-11, 2021SETTINGSIn this shared task,
we will distinguish submissions that use the terminology only at inference
time (e.g., for constrained decoding or something similar) and submissions
that use the terminology at training time (e.g., for data selection, data
augmentation, explicit training, etc). Note that basic linguistic tools
such as taggers, parsers, or morphological analyzers are allowed in the
constrained condition.

The submission report should highlight in which ways participants? methods
and data differ from the standard MT approach. They should make clear which
tools were used, and which training sets were used.
LANGUAGE PAIRSThe shared task will focus on four language pairs, with
systems evaluated:

- English to French
- English to Chinese
- Two surprise language pairs English-X (announced 3 weeks before the
evaluation deadline)

We will provide training/development data and terminologies for the above
language pairs. Test sets will be released at the beginning of the
evaluation period. The goal of this setting (with both development and
surprise language pairs) is to avoid approaches that overfit on language
selection, and instead evaluate the more realistic scenario of needing to
tackle the new domain in a new language in a limited amount of time. The
surprise language pairs will be announced 3 weeks before the start of the
evaluation campaigns. At the same time we will provide training data and
terminologies for the surprise language pairs.

You may participate in any or all of the language pairs.
ORGANIZERSAntonis Anastasopoulos, George Mason University
Md Mahfuz ibn Alam, George Mason University
Laurent Besacier, NAVER
James Cross, Facebook
Georgiana Dinu, AWS
Marcello Federico, AWS
Matthias Gall?, NAVER
Philipp Koehn, Facebook / Johns Hopkins University
Vassilina Nikoulina, NAVER
Kweon Woo Jung, NAVER
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20210423/03c64979/attachment-0001.html

------------------------------

Message: 3
Date: Sat, 24 Apr 2021 12:18:14 +0100
From: Namrata Hadimani <namrata.hadimani@mycit.ie>
Subject: [Moses-support] Failed to compile moses using command on
Ubuntu 20.04 WSL
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAN3QW0A8+B31pamGKNEfu42ymmPRY7Z75uaH8eR8n0GPUALj1g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

HI Team,

I am trying to compile the MosesToolKit using the following command and it
is failing with the error .
1) sudo ./bjam --with-boost=/home/namrata/smt/boost_1_64_0 -j4
= > Got SUCCESS

But when i am trying to do :

1) sudo ./bjam --with-cmph=/home/namrata/smt/cmph-2.0 -j4
=> It is failing with errors like "... failed gcc.link ... "

What might be the possible solution? I am running these commands on Ubuntu
20.04 WSL

Regards,
Namrata Hadimani
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20210424/d6aa8233/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 174, Issue 9
*********************************************

Tweet