Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Preparing for a presentation (Pranjal Das)
2. Ensemble Decoding in Moses (Megha Jhunjhunwala)
3. Re: Ensemble Decoding in Moses (Philipp Koehn)
4. Tokenizer script (Cyrine NASRI)
5. Re: Tokenizer script (Tom Hoar)
----------------------------------------------------------------------
Message: 1
Date: Wed, 18 Jun 2014 10:55:04 +0530
From: Pranjal Das <pranjal4456@gmail.com>
Subject: [Moses-support] Preparing for a presentation
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAAGh44wFaykZzyTVRE87Y2e-7ARbbwnAhAaHEktZiYhc3_Y_Rg@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Hello everyone, I am preparing for a presentation for my final year
project titled "Comparative study of Statistical and Rule-Based
Machine Translation for Assamese to English". Translations from both
the systems are quite satisfactory, but more improvements are to be
made in the future. Please suggest me what contents should I give.
Just want to gather some ideas. Thanks a lot !!
--
Regards,
*Pranjal Das*
Department of Information Technology,
Gauhati University Institute of Science and Technology,
Phone- +91-8399879454
------------------------------
Message: 2
Date: Wed, 18 Jun 2014 14:53:50 +0530
From: Megha Jhunjhunwala <jjw.megha@gmail.com>
Subject: [Moses-support] Ensemble Decoding in Moses
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAJM7Lf559aHsQm-rPUkZT0EH8_v_hO3zCXzC0WRs1yBzXA4+bQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hello,
I am trying to implement ensemble decoding to combine different models I
have obtained after triangulation using different pivots. I want to know if
there is any predefined function in moses which can be used so that at the
time of decoding I can dynamically combine different models. If there is no
predefined function then please suggest some alternate methods to implement
it.
Thanks,
Megha
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140618/aa9c6884/attachment-0001.htm
------------------------------
Message: 3
Date: Wed, 18 Jun 2014 10:00:56 -0400
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] Ensemble Decoding in Moses
To: Megha Jhunjhunwala <jjw.megha@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAAFADDDvu_KOXGEUH6FFvjSXBb3NfQUiaeZL2kN-EiAcNZEaoA@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
Hi,
this is commonly referred to as "system combination" and is carried
out on the output when translating with different models.
See for instance:
http://kheafield.com/code/memt/
http://www-lium.univ-lemans.fr/~barrault/MANY
-phi
On Wed, Jun 18, 2014 at 5:23 AM, Megha Jhunjhunwala <jjw.megha@gmail.com> wrote:
> Hello,
>
> I am trying to implement ensemble decoding to combine different models I
> have obtained after triangulation using different pivots. I want to know if
> there is any predefined function in moses which can be used so that at the
> time of decoding I can dynamically combine different models. If there is no
> predefined function then please suggest some alternate methods to implement
> it.
>
> Thanks,
>
> Megha
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
------------------------------
Message: 4
Date: Wed, 18 Jun 2014 16:04:30 +0200
From: Cyrine NASRI <cyrine.nasri@univ-lorraine.fr>
Subject: [Moses-support] Tokenizer script
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAPg_V0iJfc7q0SA2Hy5y-DHom8O6aDQbEjmz5A60fuR4UmuTEg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hello
I have concern the tonkenizer script,
When i so the tokenization, i got some """ and "'".. wHen i let
them in the training process i think it damage the translation quality?
So should i really let them or transform them to " and ' after training.
Thank you in advance for your reply
Best Cyrine
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140618/e344d915/attachment-0001.htm
------------------------------
Message: 5
Date: Wed, 18 Jun 2014 21:15:06 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] Tokenizer script
To: moses-support@mit.edu
Message-ID: <53A19EEA.1080107@precisiontranslationtools.com>
Content-Type: text/plain; charset="iso-8859-1"
Hi Cyrine,
The tokenizer.perl escapes some reserved characters so they don't cause
problems with the Moses decoder. You should use tokenizer.perl on your
source and target training data. During translation runtime use the
tokenizer.perl on your source input and detokenizer.perl on your
translated output. The detokenizer.perl script un-escapes the codes and
you finish with the correct characters.
Tom
On 06/18/2014 09:04 PM, Cyrine NASRI wrote:
> Hello
> I have concern the tonkenizer script,
>
> When i so the tokenization, i got some """ and "'".. wHen i
> let them in the training process i think it damage the translation
> quality?
> So should i really let them or transform them to " and ' after training.
>
> Thank you in advance for your reply
>
> Best Cyrine
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140618/b0be458c/attachment-0001.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 92, Issue 36
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 92, Issue 36"
Post a Comment