Moses-support Digest, Vol 97, Issue 34

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Multiple reordering models in moses (Raj Dabre)
2. Re: Multiple reordering models in moses (Philipp Koehn)
3. Re: Multiple reordering models in moses (Raj Dabre)
4. Re: Basline systeme (Cyrine NASRI)


----------------------------------------------------------------------

Message: 1
Date: Sat, 15 Nov 2014 11:06:38 +0900
From: Raj Dabre <prajdabre@gmail.com>
Subject: Re: [Moses-support] Multiple reordering models in moses
To: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAB3gfjB_SO89c2pVG6Zt4LdM1957g89_JJPMQ7JEuRBtthjSVw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thank you for your guidance Sir.

Just a question though: Will the selective choice of reordering tables be
incorporated in moses decoder in the future ?

Regards.

On Sat, Nov 15, 2014 at 4:21 AM, Philipp Koehn <pkoehn@inf.ed.ac.uk> wrote:

> Hi,
>
> it is not possible to make selective use of reordering tables. If two
> reordering tables, then each translation option is scored with both of
> them.
>
> Be aware that if there is no entry in a reordering table for a phrase
> pair, then there is no reordering cost, which is probably not what you
> want. To prevent this, you can specify default scores by adding the
> parameter "default-scores" to the reordering table specification, as
> in the following example:
>
> LexicalReordering name=LexicalReordering1 num-features=8
> type=hier-mslr-bidirectional-fe-allff input-factor=0 output-factor=0
> path=... default-scores=0.5,0.3,0.1,0.1,0.5,0.3,0.1,0.1
>
> -phi
>
> On Fri, Nov 14, 2014 at 4:11 AM, Raj Dabre <prajdabre@gmail.com> wrote:
> > Hello all,
> >
> > I know that there is a provision for multiple decoding paths which can
> use
> > multiple phrase tables.
> > For example if I have 2 phrase tables for en-fr:
> > 0 T 0
> > 1 T 1
> > This specifies 2 decoding paths.
> >
> > What about when I have multiple reordering tables ?
> > How can I specify something like:
> > 0 R 0
> > 1 R 1
> >
> > Does my question make sense ?
> >
> > Or do I just resort to interpolation and merge both reordering tables ?
> >
> > Any help will be appreciated.
> >
> > Regards.
> >
> > --
> > Raj Dabre.
> > Research Student,
> > Graduate School of Informatics,
> > Kyoto University.
> > CSE MTech, IITB., 2011-2014
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
>



--
Raj Dabre.
Research Student,
Graduate School of Informatics,
Kyoto University.
CSE MTech, IITB., 2011-2014
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141115/9e2c60cf/attachment-0001.htm

------------------------------

Message: 2
Date: Fri, 14 Nov 2014 21:09:00 -0500
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] Multiple reordering models in moses
To: Raj Dabre <prajdabre@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDC3mgzi4yNOxLU7YicWsmDk9hRN8UJJJSG5GQkq57Cnsw@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

Hi,

there is no plan for this - if you think this would be a good feature,
you can look at the code how to implement it.

-phi

On Fri, Nov 14, 2014 at 9:06 PM, Raj Dabre <prajdabre@gmail.com> wrote:
> Thank you for your guidance Sir.
>
> Just a question though: Will the selective choice of reordering tables be
> incorporated in moses decoder in the future ?
>
> Regards.
>
> On Sat, Nov 15, 2014 at 4:21 AM, Philipp Koehn <pkoehn@inf.ed.ac.uk> wrote:
>>
>> Hi,
>>
>> it is not possible to make selective use of reordering tables. If two
>> reordering tables, then each translation option is scored with both of
>> them.
>>
>> Be aware that if there is no entry in a reordering table for a phrase
>> pair, then there is no reordering cost, which is probably not what you
>> want. To prevent this, you can specify default scores by adding the
>> parameter "default-scores" to the reordering table specification, as
>> in the following example:
>>
>> LexicalReordering name=LexicalReordering1 num-features=8
>> type=hier-mslr-bidirectional-fe-allff input-factor=0 output-factor=0
>> path=... default-scores=0.5,0.3,0.1,0.1,0.5,0.3,0.1,0.1
>>
>> -phi
>>
>> On Fri, Nov 14, 2014 at 4:11 AM, Raj Dabre <prajdabre@gmail.com> wrote:
>> > Hello all,
>> >
>> > I know that there is a provision for multiple decoding paths which can
>> > use
>> > multiple phrase tables.
>> > For example if I have 2 phrase tables for en-fr:
>> > 0 T 0
>> > 1 T 1
>> > This specifies 2 decoding paths.
>> >
>> > What about when I have multiple reordering tables ?
>> > How can I specify something like:
>> > 0 R 0
>> > 1 R 1
>> >
>> > Does my question make sense ?
>> >
>> > Or do I just resort to interpolation and merge both reordering tables ?
>> >
>> > Any help will be appreciated.
>> >
>> > Regards.
>> >
>> > --
>> > Raj Dabre.
>> > Research Student,
>> > Graduate School of Informatics,
>> > Kyoto University.
>> > CSE MTech, IITB., 2011-2014
>> >
>> >
>> > _______________________________________________
>> > Moses-support mailing list
>> > Moses-support@mit.edu
>> > http://mailman.mit.edu/mailman/listinfo/moses-support
>> >
>
>
>
>
> --
> Raj Dabre.
> Research Student,
> Graduate School of Informatics,
> Kyoto University.
> CSE MTech, IITB., 2011-2014
>


------------------------------

Message: 3
Date: Sat, 15 Nov 2014 11:11:06 +0900
From: Raj Dabre <prajdabre@gmail.com>
Subject: Re: [Moses-support] Multiple reordering models in moses
To: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAB3gfjAGM6aY8RcRLxqGd1pu=aGnWyr4rep+JnfgR9s0oh8FOQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello,

I would be interested to try this out.
After I go through the code I think I will try to incorporate this.

Regards.

On Sat, Nov 15, 2014 at 11:09 AM, Philipp Koehn <pkoehn@inf.ed.ac.uk> wrote:

> Hi,
>
> there is no plan for this - if you think this would be a good feature,
> you can look at the code how to implement it.
>
> -phi
>
> On Fri, Nov 14, 2014 at 9:06 PM, Raj Dabre <prajdabre@gmail.com> wrote:
> > Thank you for your guidance Sir.
> >
> > Just a question though: Will the selective choice of reordering tables be
> > incorporated in moses decoder in the future ?
> >
> > Regards.
> >
> > On Sat, Nov 15, 2014 at 4:21 AM, Philipp Koehn <pkoehn@inf.ed.ac.uk>
> wrote:
> >>
> >> Hi,
> >>
> >> it is not possible to make selective use of reordering tables. If two
> >> reordering tables, then each translation option is scored with both of
> >> them.
> >>
> >> Be aware that if there is no entry in a reordering table for a phrase
> >> pair, then there is no reordering cost, which is probably not what you
> >> want. To prevent this, you can specify default scores by adding the
> >> parameter "default-scores" to the reordering table specification, as
> >> in the following example:
> >>
> >> LexicalReordering name=LexicalReordering1 num-features=8
> >> type=hier-mslr-bidirectional-fe-allff input-factor=0 output-factor=0
> >> path=... default-scores=0.5,0.3,0.1,0.1,0.5,0.3,0.1,0.1
> >>
> >> -phi
> >>
> >> On Fri, Nov 14, 2014 at 4:11 AM, Raj Dabre <prajdabre@gmail.com> wrote:
> >> > Hello all,
> >> >
> >> > I know that there is a provision for multiple decoding paths which can
> >> > use
> >> > multiple phrase tables.
> >> > For example if I have 2 phrase tables for en-fr:
> >> > 0 T 0
> >> > 1 T 1
> >> > This specifies 2 decoding paths.
> >> >
> >> > What about when I have multiple reordering tables ?
> >> > How can I specify something like:
> >> > 0 R 0
> >> > 1 R 1
> >> >
> >> > Does my question make sense ?
> >> >
> >> > Or do I just resort to interpolation and merge both reordering tables
> ?
> >> >
> >> > Any help will be appreciated.
> >> >
> >> > Regards.
> >> >
> >> > --
> >> > Raj Dabre.
> >> > Research Student,
> >> > Graduate School of Informatics,
> >> > Kyoto University.
> >> > CSE MTech, IITB., 2011-2014
> >> >
> >> >
> >> > _______________________________________________
> >> > Moses-support mailing list
> >> > Moses-support@mit.edu
> >> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >> >
> >
> >
> >
> >
> > --
> > Raj Dabre.
> > Research Student,
> > Graduate School of Informatics,
> > Kyoto University.
> > CSE MTech, IITB., 2011-2014
> >
>



--
Raj Dabre.
Research Student,
Graduate School of Informatics,
Kyoto University.
CSE MTech, IITB., 2011-2014
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141115/a8820475/attachment-0001.htm

------------------------------

Message: 4
Date: Sat, 15 Nov 2014 11:09:36 +0100
From: Cyrine NASRI <cyrine.nasri@univ-lorraine.fr>
Subject: Re: [Moses-support] Basline systeme
To: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAPg_V0icBFyYRrZxTEKmebqePYTKa+y7Wky=kiHExB6j+4Xj+Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thank you for your reply

Best rergards

2014-11-14 0:54 GMT+01:00 Philipp Koehn <pkoehn@inf.ed.ac.uk>:

> Hi,
>
> if the tuning and test set are sampled from the same data, you should
> expect
> similar scores. You could swap the two sets and see what happens - maybe
> it is just that they are of different difficulty.
>
> Phrase-based models have some deficiencies when it comes to German, such as
> translation of compounds, and long distance reordering. We are having
> more success with syntax-based models for this language pair.
>
> -phi
>
>
> On Thu, Nov 13, 2014 at 5:58 PM, Cyrine NASRI
> <cyrine.nasri@univ-lorraine.fr> wrote:
> > Hello,
> > I'am trying to build the baseline SMT for english to german language.
> I've
> > got a "strange" problem because i work for the 1st time on german
> language
> > and i've got a score Bleu on Dev corpus = 16 and on the test corpus = 9
> !
> > i prepared the corpus before training and mert as usual like this:
> > tokenization + cleaning + lowercase
> >
> > Is there somthing special for german language?
> > PS: training, dev and test corpus are in the same domain (Europarl)
> >
> > Thank you in advance
> >
> > Best regards
> >
> > Cyrine
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141115/61dc4df7/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 97, Issue 34
*********************************************

Tweet