Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Confidence weights for parallel corpus (Anoop (?????))
2. Kendall's tau metric (Arefeh Kazemi Najafabadi)
3. Compact Phrase Table (Sanjanashree Palanivel)
4. OD: Compact Phrase Table (Marcin Junczys-Dowmunt)
5. Re: Confidence weights for parallel corpus (Rajen Chatterjee)
----------------------------------------------------------------------
Message: 1
Date: Sat, 19 Sep 2015 00:05:55 +0530
From: Anoop (?????) <anoop.kunchukuttan@gmail.com>
Subject: [Moses-support] Confidence weights for parallel corpus
To: moses-support <moses-support@mit.edu>
Message-ID:
<CADXxMYebMPXq_ff0yhH8sFy0UtNrrs7p5wG9-xnBtHfCEvqyCw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi,
Suppose in a parallel corpus, multiple translations of varying quality are
available for every sentence along with a quality score. Is there any way
to incorporate these quality scores during Moses training? Pointers to any
papers which have discussed such ideas of weighting sentences in a parallel
corpus would be useful.
Regards,
Anoop.
--
I claim to be a simple individual liable to err like any other fellow
mortal. I own, however, that I have humility enough to confess my errors
and to retrace my steps.
http://flightsofthought.blogspot.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150918/a90e024e/attachment-0001.html
------------------------------
Message: 2
Date: Sat, 19 Sep 2015 12:41:57 +0430
From: Arefeh Kazemi Najafabadi <arefeh.kazeminajafabadi@dcu.ie>
Subject: [Moses-support] Kendall's tau metric
To: moses-support@mit.edu
Message-ID:
<CAB2b+QWgrbu65E2zF6VS6fgw5SaZD1jToQz88mqdZtZF3cfVcw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi everyone
I'm testing a reordering model for hierarchical moses. I want to
interpolate bleu with kendall's tau permutation distance and use it as my
tuning metric. can anyone help me how to do this?
Regards
--
*Email Disclaimer"This e-mail and any files transmitted with it are confidential and are intended solely for use by the addressee. Any unauthorised dissemination, distribution or copying of this message and any attachments is strictly prohibited. If you have received this e-mail in error, please notify the sender and delete the message. Any views or opinions presented in this e-mail may solely be the views of the author and cannot be relied upon as being those of Dublin City University. E-mail communications such as this cannot be guaranteed to be virus-free, timely, secure or error-free and Dublin City University does not accept liability for any such matters or their consequences. Please consider the environment before printing this e-mail."S?anadh R?omhphoist"T? an r?omhphost seo agus aon chomhad a sheoltar leis faoi r?n agus is lena ?s?id ag an seola? agus sin amh?in ?. T? cosc ioml?n ar scaipeadh, dh?ileadh n? ch?ipe?il neamh?daraithe ar an teachtaireacht seo agus ar ao!
n cheangalt?n at? ag dul leis. M? t? an r?omhphost seo faighte agat tr? dhearmad cuir sin in i?l le do thoil don seolt?ir agus scrios an teachtaireacht. D?fh?adfadh s? gurb iad tuairim? an ?dair agus sin amh?in at? in aon tuairim? no dearctha? at? curtha i l?thair sa r?omhphost seo agus n?or ch?ir glacadh leo mar thuairim? n? dhearctha? Ollscoil Chathair Bhaile ?tha Cliath. N? ghlactar leis go bhfuil cumars?id r?omhphoist den s?rt seo saor ? v?reas, in am, sl?n, n? saor ? earr?id agus n? ghlacann Ollscoil Chathair Bhaile ?tha Cliath le dliteanas in aon ch?s den s?rt sin n? as aon iarmhairt a d?eascr?dh astu. Cuimhnigh ar an timpeallacht le do thoil sula gcuireann t? an r?omhphost seo i gcl?."*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150919/e468d2fa/attachment-0001.html
------------------------------
Message: 3
Date: Sat, 19 Sep 2015 14:10:27 +0530
From: Sanjanashree Palanivel <sanjanashree@gmail.com>
Subject: [Moses-support] Compact Phrase Table
To: moses-support@mit.edu
Message-ID:
<CAAc_kp7MRw0JJ4oTPW-T8+1qbU-OVSkaXi4TQMFm2qvDKuUiQg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Dear all,
I also tried to binarize the phrase table following this
http://www.statmt.org/moses/?n=Advanced.RuleTables#ntoc3, and compilation
with moses is done succesfully. But. when i run
processPhraseTableMin -threads 3 -in train/model/phrase-table.gz
-nscores 4 -out binarised-model/phrase-table
I am getting segmentation fault. I dont know what is worng. Is there
something todo with threads
Also how to binarize nplm model
--
Thanks and regards,
Sanjanasri J.P
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150919/b6f37fc5/attachment-0001.html
------------------------------
Message: 4
Date: Sat, 19 Sep 2015 10:02:16 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: [Moses-support] OD: Compact Phrase Table
To: Sanjanashree Palanivel <sanjanashree@gmail.com>,
moses-support@mit.edu
Message-ID: <20150919090222.BAEFEABAB0@pp.amu.edu.pl>
Content-Type: text/plain; charset="us-ascii"
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150919/ef44bd94/attachment-0001.html
------------------------------
Message: 5
Date: Sat, 19 Sep 2015 14:45:13 +0200
From: Rajen Chatterjee <rajen.k.chatterjee@gmail.com>
Subject: Re: [Moses-support] Confidence weights for parallel corpus
To: Anoop (?????) <anoop.kunchukuttan@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAC4-+NwJmGybetmjwXu9ApQWtfr01zGQuJDqWmMTkzVpYokjeQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi Anoop,
I am not aware of how to incorporate quality score of parallel sentence
during SMT training.
But, you may think to create 2 parallel corpus (PC):
PC1: Select all source sentence with their best translated sentence (let's
say in-domain)
PC2: Rest of the translation with their source sentences (let's say
out-domain)
Then you can combine translation models (obtained by training SMT over the
2 parallel corpus) using different approaches (
http://www.statmt.org/moses/?n=Advanced.Domain#ntoc1)
Another way to incorporate quality score can be to create dense features.
You may have a look at our recent paper (
http://www.statmt.org/wmt15/pdf/WMT25.pdf) on APE at WMT 2015. We have
discussed different feature, if it is of any help to you.
On Fri, Sep 18, 2015 at 8:35 PM, Anoop (?????) <anoop.kunchukuttan@gmail.com
> wrote:
> Hi,
>
> Suppose in a parallel corpus, multiple translations of varying quality are
> available for every sentence along with a quality score. Is there any way
> to incorporate these quality scores during Moses training? Pointers to any
> papers which have discussed such ideas of weighting sentences in a parallel
> corpus would be useful.
>
> Regards,
> Anoop.
>
> --
> I claim to be a simple individual liable to err like any other fellow
> mortal. I own, however, that I have humility enough to confess my errors
> and to retrace my steps.
>
> http://flightsofthought.blogspot.com
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
--
-Regards,
Rajen Chatterjee.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150919/caf7ddc9/attachment.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 107, Issue 46
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 107, Issue 46"
Post a Comment