Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Transliteration Support in Moses (karan singla)
2. Re: Transliteration Support in Moses (Nadir Durrani)
3. Problem with mkcls Linux x32 (????????? ?????)
4. Re: Tools for Post-Editing that Preserve Alignments?
(Philipp Koehn)
5. Re: Mert-moses XML files (Philipp Koehn)
----------------------------------------------------------------------
Message: 1
Date: Sun, 8 Jun 2014 22:42:34 +0530
From: karan singla <ksingla025@gmail.com>
Subject: Re: [Moses-support] Transliteration Support in Moses
To: Shahid Khan <tension.khan@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAFesLv7TB5UE4eY+ixUUjT-mBrUxty7ii0dvS0CS0YpqshViNw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
I made an implementation of a transliteration package from English-2-Indian
Languages(including Hindi). I guess there are other packages also available.
link to package : https://github.com/ksingla025/Motech_Transliterate/
you can use it as a post-processing tool, for words which are OOV or
un-translated.
Regrds,
Karan
On Sun, Jun 8, 2014 at 7:49 PM, Shahid Khan <tension.khan@gmail.com> wrote:
> Hi,
>
> Is there a module to transliterate OOV words in Moses? Or any standalone
> transliteration toolkit to do this?
>
> I am trying to translate some English data into Hindi. Our system is based
> on the data provided for WMT this year and some additional in-domain data.
> But the number of OOVs is still massive. However, at least half of these
> could be transliterated.
>
> Regards,
> Shahid
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140608/63fc4d7e/attachment-0001.htm
------------------------------
Message: 2
Date: Sun, 8 Jun 2014 18:15:54 +0100
From: Nadir Durrani <nadir.durrani@nu.edu.pk>
Subject: Re: [Moses-support] Transliteration Support in Moses
To: moses-support@mit.edu
Message-ID:
<CAFDj2Q0TChhTYoBv_A9S3fR22i-MtAfJ7ViK+iB0Dvx73g+V+A@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
Hi,
We have recently added a transliteration module in Moses. Here's how to use it:
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc5
When enabled the model will try to mine transliteration pairs from the
word-aligned parallel corpus and build a transliteration model over
the resulting transliteration training data. It is totally
unsupervised and language independent. You can find more details in
this paper.
http://aclweb.org/anthology//E/E14/E14-4029.pdf
Cheers,
Nadir
On Sun, Jun 8, 2014 at 5:31 PM, <moses-support-request@mit.edu> wrote:
> Send Moses-support mailing list submissions to
> moses-support@mit.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.mit.edu/mailman/listinfo/moses-support
> or, via email, send a message with subject or body 'help' to
> moses-support-request@mit.edu
>
> You can reach the person managing the list at
> moses-support-owner@mit.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Moses-support digest..."
>
>
> Today's Topics:
>
> 1. Error in Phrase-Table-Triangulation (Megha Jhunjhunwala)
> 2. Re: Error in Phrase-Table-Triangulation (Hieu Hoang)
> 3. Transliteration Support in Moses (Shahid Khan)
> 4. Mert-moses XML files (Cyrine NASRI)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Sun, 8 Jun 2014 17:07:23 +0530
> From: Megha Jhunjhunwala <jjw.megha@gmail.com>
> Subject: [Moses-support] Error in Phrase-Table-Triangulation
> To: moses-support@mit.edu
> Message-ID:
> <CAJM7Lf40zDiBqwhea=8qHeW7aU-a_ohzaNRikL3T5uwaf9zAXg@mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Hello,
>
> I am trying to do phrase-table triangulation to generate a new
> phrase-table. But I am not being able to figure what the last 3 values in
> the phrase-table signify. ?????
> for ex :
> ???????? ????? ||| ????????? ????? ||| 0.00864127194755 8.337659958e-08
> 0.00432064057394 1.13306222125e-06 2.718 ||| 0-0 1-1 1-2 2-3 ||| 1 2 1
>
>
> What do the values 1 2 1 are for ?
>
> Also does moses use the alignments 0-0 and 1-1 etc to give translations.
>
> Thanks
> Megha
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140608/31b3b653/attachment-0001.htm
>
> ------------------------------
>
> Message: 2
> Date: Sun, 8 Jun 2014 12:47:15 +0100
> From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
> Subject: Re: [Moses-support] Error in Phrase-Table-Triangulation
> To: Megha Jhunjhunwala <jjw.megha@gmail.com>
> Cc: moses-support <moses-support@mit.edu>
> Message-ID:
> <CAEKMkbgBFnZrDXU=wuhBcEbECK7xXm_+5ykO1K9dWGpQMFpi4w@mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> the 1 2 1 are the counts. They are used for debug and can be ignored, they
> aren't used for decoder.
>
> the word alignments 0-0 and 1-1 are used by some new feature functions but
> not by the basic feature functions. If you don't want to create them, then
> leave them out
>
>
> On 8 June 2014 12:37, Megha Jhunjhunwala <jjw.megha@gmail.com> wrote:
>
>> Hello,
>>
>> I am trying to do phrase-table triangulation to generate a new
>> phrase-table. But I am not being able to figure what the last 3 values in
>> the phrase-table signify. ?????
>> for ex :
>> ???????? ????? ||| ????????? ????? ||| 0.00864127194755 8.337659958e-08
>> 0.00432064057394 1.13306222125e-06 2.718 ||| 0-0 1-1 1-2 2-3 ||| 1 2 1
>>
>>
>> What do the values 1 2 1 are for ?
>>
>> Also does moses use the alignments 0-0 and 1-1 etc to give translations.
>>
>> Thanks
>> Megha
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140608/8e3d39b9/attachment-0001.htm
>
> ------------------------------
>
> Message: 3
> Date: Sun, 8 Jun 2014 15:19:03 +0100
> From: Shahid Khan <tension.khan@gmail.com>
> Subject: [Moses-support] Transliteration Support in Moses
> To: moses-support@mit.edu
> Message-ID:
> <CACUPstu_XP80pccsbVELtiOWTK-PkwfwaueurKz_NOTqNcOujA@mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Hi,
>
> Is there a module to transliterate OOV words in Moses? Or any standalone
> transliteration toolkit to do this?
>
> I am trying to translate some English data into Hindi. Our system is based
> on the data provided for WMT this year and some additional in-domain data.
> But the number of OOVs is still massive. However, at least half of these
> could be transliterated.
>
> Regards,
> Shahid
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140608/4be9eecd/attachment-0001.htm
>
> ------------------------------
>
> Message: 4
> Date: Sun, 8 Jun 2014 18:19:34 +0200
> From: Cyrine NASRI <cyrine.nasri@univ-lorraine.fr>
> Subject: [Moses-support] Mert-moses XML files
> To: "moses-support@mit.edu" <moses-support@mit.edu>
> Message-ID:
> <CAPg_V0gwy2nrnADQPAvjBqUMSskVRsTcC+mEuQb=kS_fTRFuEg@mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Hello,
>
> I have a question concern Mert-moses: Is it possible in Moses to do Mert on
> XML files?
> Is there any option to do this, or should i delete the XML tags manually
> before doing MERT?
>
> Thank you in advance
>
> Bests
>
> Cyrine
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140608/717c1e8c/attachment-0001.htm
>
> ------------------------------
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> End of Moses-support Digest, Vol 92, Issue 19
> *********************************************
------------------------------
Message: 3
Date: Mon, 09 Jun 2014 12:38:36 +0400
From: ????????? ????? <a.komin@bk.ru>
Subject: [Moses-support] Problem with mkcls Linux x32
To: moses-support@mit.edu
Message-ID: <1402303116.253545701@f350.i.mail.ru>
Content-Type: text/plain; charset="utf-8"
I'm trying to run? on Linux (x32)
./mkcls -c50 -n2 -p./corpus/euro.de -V./corpus/de.vcb.classes opt
I have problems:
user-R560 training # ./mkcls -c50 -n2 -p./corpus/euro.de -V./corpus/de.vcb.classes opt
mkcls: /home/hieu/workspace/mgizapp/mgizapp/src/mkcls/StatVar.cpp:116: double StatVar::quantil(double): Assertion `index>=0&&index<n' failed.
Aborted
Can you help me?
--
????????? ?????
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140609/6d2d80db/attachment-0001.htm
------------------------------
Message: 4
Date: Mon, 9 Jun 2014 09:41:14 -0400
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] Tools for Post-Editing that Preserve
Alignments?
To: Graham Neubig <neubig@is.naist.jp>
Cc: "<moses-support@mit.edu>" <moses-support@mit.edu>
Message-ID:
<CAAFADDBQZgNDtPjo2XBFX4dVhRhEvXS_ZMNREq40g3M02keeNw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi,
the CASMACAT variant of the Matecat/Casmacat CAT workbench would enable you
to track the changes, since it comes with logging of all the editing
events, so you can
see how the text was changed during post-editing.
http://www.casmacat.eu/index.php?n=Workbench.Workbench
You can check out the field trial data for an example for this:
http://www.casmacat.eu/index.php?n=Main.Downloads
-phi
On Thu, Jun 5, 2014 at 10:54 PM, Graham Neubig <neubig@is.naist.jp> wrote:
> Dear Moses Mailing List,
>
> I apologize in advance for the somewhat off-topic post, but I was hoping
> that someone might have an answer:
>
> We're looking to do some post-editing experiments where we need both the
> post-editing output and accurate alignments between the original system
> output and the post-edited text indicating which words/phrases were
> corrected into what. I have heard rumors that the NIST HTER tool was able
> to do this, but I don't have access to the tool, and I wasn't able to find
> any other available software that had this capability. Is anyone aware of a
> good UI that makes it possible to do this?
>
> Thanks in advance!
> Graham
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140609/87fb7f52/attachment-0001.htm
------------------------------
Message: 5
Date: Mon, 9 Jun 2014 09:44:14 -0400
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] Mert-moses XML files
To: Cyrine NASRI <cyrine.nasri@univ-lorraine.fr>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDD-pdNrvORo1O8+Bh7f9LQSVx-hTe_3VpUwBd+OjsQRUg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi,
it is probably best to remove XML markup during tuning.
-phi
On Sun, Jun 8, 2014 at 12:19 PM, Cyrine NASRI <cyrine.nasri@univ-lorraine.fr
> wrote:
> Hello,
>
> I have a question concern Mert-moses: Is it possible in Moses to do Mert
> on XML files?
> Is there any option to do this, or should i delete the XML tags manually
> before doing MERT?
>
> Thank you in advance
>
> Bests
>
> Cyrine
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140609/e02a31ba/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 92, Issue 20
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 92, Issue 20"
Post a Comment