Moses-support Digest, Vol 129, Issue 8

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Adding Dictionary (Sanjanashree Palanivel)
2. Re: Adding Dictionary (Matthias Huck)
3. Adding dictionary (Sanjanashree Palanivel)
4. Re: Adding Dictionary (Matthias Huck)
5. Registration open: MT Summit XVI Nagoya Sep. 18?22, 2017
(Mikel L. Forcada)
6. EMS - EVALUATION_test_apply-filter (Despina Mouratidi)


----------------------------------------------------------------------

Message: 1
Date: Fri, 7 Jul 2017 15:02:54 +0530
From: Sanjanashree Palanivel <sanjanashree@gmail.com>
Subject: [Moses-support] Adding Dictionary
To: moses-support@mit.edu
Message-ID:
<CAAc_kp4kcsWC0i6Gfbz3baNve_NRVLzPD_xyOLV_rBQORp+h9g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

HI all,

What are the possibilities to add dictionary to moses. It would be great
if I could get an earnest reply.

--
Thanks and regards,

Sanjanasri J.P
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170707/7690b784/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 07 Jul 2017 12:56:41 +0200
From: Matthias Huck <mhuck@cis.lmu.de>
Subject: Re: [Moses-support] Adding Dictionary
To: Sanjanashree Palanivel <sanjanashree@gmail.com>,
moses-support@mit.edu
Message-ID: <1499425001.2344.805.camel@cis.lmu.de>
Content-Type: text/plain; charset="UTF-8"

Hi,

A simple solution would be to just append your dictionary to the
parallel training data. Or create a second phrase table from the
dictionary and do phrase table fillup or something similar.

Cheers,
Matthias


On Fri, 2017-07-07 at 15:02 +0530, Sanjanashree Palanivel wrote:
> HI all,
>
> ? What are the possibilities to??add dictionary to moses. It would be great
> if I could get an earnest reply.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support


------------------------------

Message: 3
Date: Fri, 7 Jul 2017 17:56:55 +0530
From: Sanjanashree Palanivel <sanjanashree@gmail.com>
Subject: [Moses-support] Adding dictionary
To: Matthias Huck <mhuck@cis.lmu.de>, moses-support@mit.edu
Message-ID:
<CAAc_kp5s9w7eajuaF2dw+J-3EiUMtG0MLDr6BneBMoLpdcisZw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

I have some doubts. while creating a new phrase-table for
dictionary ,should i give scores as all 1's?.

Incase of ambiguous words. how to give the scores?

Can I train glossary alone independently, and add the path of
phrase-table to moses.ini? Or,

should I train glossary alongside with parallel data only?

Please guide me which way is better.

--
Thanks and regards,

Sanjanasri J.P
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170707/9c743554/attachment-0001.html

------------------------------

Message: 4
Date: Fri, 07 Jul 2017 14:43:44 +0200
From: Matthias Huck <mhuck@cis.lmu.de>
Subject: Re: [Moses-support] Adding Dictionary
To: Sanjanashree Palanivel <sanjanashree@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <1499431424.2344.819.camel@cis.lmu.de>
Content-Type: text/plain; charset="UTF-8"

Hi,

On Fri, 2017-07-07 at 17:47 +0530, Sanjanashree Palanivel wrote:
> Hi,
>
> ????????I have some doubts. while creating phrase-table ,should i give
> scores as all 1's. In case of ambigous words. how to give the scores?

You can provide word alignments for the dictionary entries and then run
the dictionary through the Moses phrase extraction pipeline, just like
any other corpus. It should calculate all the scores for you.

> ????????Can I train glossary alone independently and the path of
> phrase-table to moses.ini?

Basically, yes. You can add a second phrase table.?Or use a script to
combine multiple phrase tables into one, such as:?
contrib/combine-ptables/combine-ptables.pl

> ????????should I train glossary alongside with parallel data only?
>
> ???????Please guide me which way is better.

You'll typically have to investigate on your own what's working best
for your use case.

Also, I'm sure that there would be a couple of other ways of harnessing
a dictionary in Moses.

Cheers,
Matthias



> > On Fri, Jul 7, 2017 at 4:26 PM, Matthias Huck <mhuck@cis.lmu.de> wrote:
>
> >
> > Hi,
> >
> > A simple solution would be to just append your dictionary to the
> > parallel training data. Or create a second phrase table from the
> > dictionary and do phrase table fillup or something similar.
> >
> > Cheers,
> > Matthias
> >
> >
> > On Fri, 2017-07-07 at 15:02 +0530, Sanjanashree Palanivel wrote:
> > >
> > > HI all,
> > >
> > > ? What are the possibilities to??add dictionary to moses. It would be
> > great
> > >
> > > if I could get an earnest reply.
> > >
> > > _______________________________________________
> > > Moses-support mailing list
> > > Moses-support@mit.edu
> > > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
>
>
>


------------------------------

Message: 5
Date: Fri, 7 Jul 2017 14:00:04 +0100
From: "Mikel L. Forcada" <mlf@dlsi.ua.es>
Subject: [Moses-support] Registration open: MT Summit XVI Nagoya Sep.
18?22, 2017
To: "mt-list@eamt.org" <mt-list@eamt.org>,
"apertium-stuff@lists.sourceforge.net"
<apertium-stuff@lists.sourceforge.net>, moses-support@mit.edu
Message-ID: <29d53aa5-0232-98bb-8da3-4936471b30bf@dlsi.ua.es>
Content-Type: text/plain; charset="utf-8"

[apologies for multiple posting]

The 16th Machine Translation Summit, organized by the Asia-Pacific
Association for Machine Translation (AAMT), will be held at Nagoya
University, Japan, from September 18 through 22, 2017:
http://aamt.info/app-def/S-102/mtsummit/2017

*Registration* is now open:
http://aamt.info/app-def/S-102/mtsummit/2017/registration/

Machine Translation (MT) Summit is an international conference, which
brings together people from the academic and commercial world developing
MT and users of MT systems. The conference overviews state-of-the-art
technologies in MT, its major contemporary trends and practical
applications.

The programme of the conference will soon be published in the website.
It will include oral presentations and posters in both the user and
research tracks, a number of pre- and post-conference workshops
(http://aamt.info/app-def/S-102/mtsummit/2017/workshops/) and tutorials
(http://aamt.info/app-def/S-102/mtsummit/2017/tutorials/).

Details will soon be published in the website
http://aamt.info/app-def/S-102/mtsummit/2017/.

I look forward to meeting you in Nagoya!

Mikel Forcada
EAMT President


--

Mikel L. Forcada http://www.dlsi.ua.es/~mlf/
Departament de Llenguatges i Sistemes Inform?tics
Universitat d'Alacant
E-03690 Sant Vicent del Raspeig
Spain
Office: +34 96 590 9776

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170707/a8a5686b/attachment-0001.html

------------------------------

Message: 6
Date: Fri, 7 Jul 2017 17:21:16 +0300
From: Despina Mouratidi <dmouratidi@gmail.com>
Subject: [Moses-support] EMS - EVALUATION_test_apply-filter
To: moses-support <Moses-support@mit.edu>
Message-ID:
<CAJJG54nJRWLJ3bH5iSoqe14LV5LPOtVAx-e3K2=Kji5UZZepEQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello guys,

When i am typing from ~/mosesdecoder/scripts/ems directoyry

$ nohup nice ~/mosesdecoder/scripts/ems/experiment.perl -config config.toy
-exec OUT.[RUN] &

I came with this error in EVALUATION_test_apply-filter.STDERR

filteredPath=/home/despina/working/experiments/evaluation/test.filtered.11/moses.ini

origPath=/home/despina/working/experiments/model/moses.ini.11
tunedPath=/home/despina/working/experiments/tuning/moses.tuned.ini.11
outPath=/home/despina/working/experiments/evaluation/test.filtered.ini.13
tempPath=/tmp/moses.ini.8735
cmd=/home/despina/mosesdecoder/scripts/ems/support/substitute-filtered-tables.perl
/home/despina/working/experiments/evaluation/test.filtered.11/moses.ini <
/home/despina/working/experiments/model/moses.ini.11 > /tmp/moses.ini.8735
ERROR: could not find pseudo-config with filtered tables at
/home/despina/mosesdecoder/scripts/ems/support/substitute-filtered-tables.perl
line 12.
cmd=/home/despina/mosesdecoder/scripts/ems/support/substitute-weights.perl
/tmp/moses.ini.8735
/home/despina/working/experiments/tuning/moses.tuned.ini.11
/home/despina/working/experiments/evaluation/test.filtered.ini.13

Any idea about this error?

Thanks
Despina
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170707/5190f144/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 129, Issue 8
*********************************************

0 Response to "Moses-support Digest, Vol 129, Issue 8"

Post a Comment