Moses-support Digest, Vol 94, Issue 4

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: problem with translation output (Barry Haddow)


----------------------------------------------------------------------

Message: 1
Date: Sat, 02 Aug 2014 15:29:51 +0100
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] problem with translation output
To: "ULStudent:GIOVANNI.GALLO" <12064866@studentmail.ul.ie>, Philipp
Koehn <pkoehn@inf.ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <53DCF5DF.6000200@staffmail.ed.ac.uk>
Content-Type: text/plain; charset="iso-8859-1"

Hi

Before decoding, you need to apply the same preprocessing steps to the
input sentence as were applied during training. Normally this would mean
tokenisation and either lowercasing and truecasing.

During decoding, Moses will split the sentence on whitespace only, so it
will see "personas," as different to "personas", and if it has not seen
the former in training (because the training data was tokenised) then it
will pass it through,

cheers - Barry


On 02/08/14 12:12, ULStudent:GIOVANNI.GALLO wrote:
>
> Hi Philipp,
>
>
> Thank you for your reply. Here is an example:
>
>
> *Source sentence in Spanish*
>
> Es un local climatizado con capacidad para 150 personas, con una
> terraza para 30 personas y rodeado de una zona ajardinada.
>
>
> *Translated sentence into Italian*
>
> Es un locale climatizzato capienza 150 personas,|UNK|UNK|UNK con
> terrazza per 30 persone e circondato una zona ajardinada. |UNK|UNK|UNK
>
>
> The strange thing is that if I remove the comma and the period from
> the source sentence, the |UNK|UNK|UNK disappear and /personas/
> and/ajardinada/ get translated:
>
>
> Es un locale climatizzato capienza 150 persone con terrazza per 30
> persone e circondato una giardino
>
>
> Any idea? Does it have to do with the fact that my model in unfactored?
>
> Thank you in advance.
>
>
> GG
>
>
> ------------------------------------------------------------------------
> *Da:* phkoehn@gmail.com <phkoehn@gmail.com> per conto di Philipp Koehn
> <pkoehn@inf.ed.ac.uk>
> *Inviato:* venerd? 1 agosto 2014 16.59
> *A:* ULStudent:GIOVANNI.GALLO
> *Cc:* moses-support@mit.edu
> *Oggetto:* Re: [Moses-support] problem with translation output
> Hi,
>
> this should not happen - are they really identically
> (uppercase/lowercase etc.)?
>
> You can run the decoder with more verbose output (-v 2 or even -v 3)
> and the
> trace options (-t) to dig a bit deeper on what is going on.
>
> -phi
>
>
>
> On Fri, Aug 1, 2014 at 7:24 AM, ULStudent:GIOVANNI.GALLO
> <12064866@studentmail.ul.ie <mailto:12064866@studentmail.ul.ie>> wrote:
>
> Hi everyone,
>
>
> I'm running some experiments with Moses and I noticed that in
> translated sentences there are always one or two words/phrases
> that don't get translated (they appear as in the source sentence).
> I checked the phrase table and there are many entries
> corresponding to those words/phrases that might be used during
> decoding. Do you have any idea what's happening here? Maybe
> something I need to modify in the moses.ini file?
>
> Thank you in advance for your help.
>
>
> Regards,
>
> Giovanni Gallo.
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140802/7c5aa85f/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 94, Issue 4
********************************************

Tweet