Moses-support Digest, Vol 102, Issue 34

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: [decoding-graph-backoff] (Matthias Huck)
2. Re: [decoding-graph-backoff] (Hieu Hoang)
3. Re: [decoding-graph-backoff] (Matthias Huck)
4. Re: [decoding-graph-backoff] (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 16 Apr 2015 18:04:12 +0100
From: Matthias Huck <mhuck@inf.ed.ac.uk>
Subject: Re: [Moses-support] [decoding-graph-backoff]
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <1429203852.30904.11.camel@portedgar>
Content-Type: text/plain; charset="UTF-8"

Hi Hieu,

It seems that [decoding-graph-backoff] doesn't quite behave like last
year any more. Can you briefly explain how its behaviour has changed,
i.e. what it did before and what it does now? Can you please also let me
know whether there's a way to reproduce the old behaviour via
configuration options?

Cheers,
Matthias



On Fri, 2015-01-09 at 15:20 +0000, Hieu Hoang wrote:
> >From the git history, I think it was slightly broken, then I broke it even
> more in May 2014.
>
> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
>
> It was
> endPos-startPos+1 >= backoff
> then
> endPos-startPos+1 <= backoff
> I think it should be
> endPos-startPos+1 > backoff
>
> I'll change it if it's ok with everyone
>
>
> On 9 January 2015 at 15:11, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
> wrote:
>
> > Hm, we have been using it at WIPO, but I have to admit I never checked
> > it _actually_ does anything useful. We sorta believe it does.
> >
> > W dniu 09.01.2015 o 16:08, Hieu Hoang pisze:
> >
> > Hi All
> >
> > Does anyone use this functionality in Moses when you have multiple
> > phrase-tables?
> >
> > From the code, it doesn't look like it works as described in
> > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures
> >
> > Maybe I'm missing something
> >
> > --
> > Hieu Hoang
> > Research Associate
> > University of Edinburgh
> > http://www.hoang.co.uk/hieu
> >
> >
> >
> > _______________________________________________
> > Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
> >
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> >
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.



--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

Message: 2
Date: Thu, 16 Apr 2015 21:34:48 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] [decoding-graph-backoff]
To: Matthias Huck <mhuck@inf.ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>, Hieu Hoang
<hieu.hoang@ed.ac.uk>
Message-ID:
<CAEKMkbh+Lfv8u3WtPJoNfaZ=LQv80_rmU6H20FQz3PJwCHdc8g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Didn't know it has changed. How should it behave and how does it actually
behave?
On 16 Apr 2015 21:04, "Matthias Huck" <mhuck@inf.ed.ac.uk> wrote:

> Hi Hieu,
>
> It seems that [decoding-graph-backoff] doesn't quite behave like last
> year any more. Can you briefly explain how its behaviour has changed,
> i.e. what it did before and what it does now? Can you please also let me
> know whether there's a way to reproduce the old behaviour via
> configuration options?
>
> Cheers,
> Matthias
>
>
>
> On Fri, 2015-01-09 at 15:20 +0000, Hieu Hoang wrote:
> > >From the git history, I think it was slightly broken, then I broke it
> even
> > more in May 2014.
> >
> >
> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
> >
> > It was
> > endPos-startPos+1 >= backoff
> > then
> > endPos-startPos+1 <= backoff
> > I think it should be
> > endPos-startPos+1 > backoff
> >
> > I'll change it if it's ok with everyone
> >
> >
> > On 9 January 2015 at 15:11, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
> > wrote:
> >
> > > Hm, we have been using it at WIPO, but I have to admit I never checked
> > > it _actually_ does anything useful. We sorta believe it does.
> > >
> > > W dniu 09.01.2015 o 16:08, Hieu Hoang pisze:
> > >
> > > Hi All
> > >
> > > Does anyone use this functionality in Moses when you have multiple
> > > phrase-tables?
> > >
> > > From the code, it doesn't look like it works as described in
> > > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures
> > >
> > > Maybe I'm missing something
> > >
> > > --
> > > Hieu Hoang
> > > Research Associate
> > > University of Edinburgh
> > > http://www.hoang.co.uk/hieu
> > >
> > >
> > >
> > > _______________________________________________
> > > Moses-support mailing listMoses-support@mit.eduhttp://
> mailman.mit.edu/mailman/listinfo/moses-support
> > >
> > >
> > >
> > > _______________________________________________
> > > Moses-support mailing list
> > > Moses-support@mit.edu
> > > http://mailman.mit.edu/mailman/listinfo/moses-support
> > >
> > >
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> > The University of Edinburgh is a charitable body, registered in
> > Scotland, with registration number SC005336.
>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150416/5f4ece09/attachment-0001.htm

------------------------------

Message: 3
Date: Thu, 16 Apr 2015 19:16:15 +0100
From: Matthias Huck <mhuck@inf.ed.ac.uk>
Subject: Re: [Moses-support] [decoding-graph-backoff]
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>, Hieu Hoang
<hieu.hoang@ed.ac.uk>
Message-ID: <1429208175.30904.31.camel@portedgar>
Content-Type: text/plain; charset="UTF-8"

Well, what's that business mentioned in your mail from January (quoted
below), with the backoff being broken, then being broken more, then
possibly been fixed - or not?

https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19


I set up a system that was supposed to do backoff with factored
generation steps, more or less in the manner of what's described in this
paper: Interpolated Backoff for Factored Translation Models, Philipp
Koehn and Barry Haddow, AMTA 2012.

MIRA tunes all the weights of the backoff models to 0. With exactly the
same configuration, this did not happen last year (February 2014). Maybe
the [decoding-graph-backoff] setting didn't have any effect prior to
some of your code modifications, and the models were actually competing
in older setups? Or it's buggy now. I can't really tell.

I can show you the two setups if you want.



On Thu, 2015-04-16 at 21:34 +0400, Hieu Hoang wrote:
> Didn't know it has changed. How should it behave and how does it
> actually behave?
>
> On 16 Apr 2015 21:04, "Matthias Huck" <mhuck@inf.ed.ac.uk> wrote:
> Hi Hieu,
>
> It seems that [decoding-graph-backoff] doesn't quite behave
> like last
> year any more. Can you briefly explain how its behaviour has
> changed,
> i.e. what it did before and what it does now? Can you please
> also let me
> know whether there's a way to reproduce the old behaviour via
> configuration options?
>
> Cheers,
> Matthias
>
>
>
> On Fri, 2015-01-09 at 15:20 +0000, Hieu Hoang wrote:
> > >From the git history, I think it was slightly broken, then
> I broke it even
> > more in May 2014.
> >
> >
> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
> >
> > It was
> > endPos-startPos+1 >= backoff
> > then
> > endPos-startPos+1 <= backoff
> > I think it should be
> > endPos-startPos+1 > backoff
> >
> > I'll change it if it's ok with everyone
> >
> >
> > On 9 January 2015 at 15:11, Marcin Junczys-Dowmunt
> <junczys@amu.edu.pl>
> > wrote:
> >
> > > Hm, we have been using it at WIPO, but I have to admit I
> never checked
> > > it _actually_ does anything useful. We sorta believe it
> does.
> > >
> > > W dniu 09.01.2015 o 16:08, Hieu Hoang pisze:
> > >
> > > Hi All
> > >
> > > Does anyone use this functionality in Moses when you have
> multiple
> > > phrase-tables?
> > >
> > > From the code, it doesn't look like it works as described
> in
> > > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures
> > >
> > > Maybe I'm missing something
> > >
> > > --
> > > Hieu Hoang
> > > Research Associate
> > > University of Edinburgh
> > > http://www.hoang.co.uk/hieu
> > >
> > >
> > >
> > > _______________________________________________
> > > Moses-support mailing
> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
> > >
> > >
> > >
> > > _______________________________________________
> > > Moses-support mailing list
> > > Moses-support@mit.edu
> > > http://mailman.mit.edu/mailman/listinfo/moses-support
> > >
> > >
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> > The University of Edinburgh is a charitable body, registered
> in
> > Scotland, with registration number SC005336.
>
>
>
> --
> The University of Edinburgh is a charitable body, registered
> in
> Scotland, with registration number SC005336.
>
>



--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

Message: 4
Date: Thu, 16 Apr 2015 23:57:22 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] [decoding-graph-backoff]
To: Matthias Huck <mhuck@inf.ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>, Hieu Hoang
<hieu.hoang@ed.ac.uk>
Message-ID: <55301422.4040907@gmail.com>
Content-Type: text/plain; charset=utf-8; format=flowed

ah yes, I thought the backoff was doing the opposite to what it's
supposed to do so I changed the comparison around. I checked that it
backed off, but i didn't run it through tuning.

it may still be wrong, or there may be strange interaction with the tuning.


On 16/04/2015 22:16, Matthias Huck wrote:
> Well, what's that business mentioned in your mail from January (quoted
> below), with the backoff being broken, then being broken more, then
> possibly been fixed - or not?
>
> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
>
>
> I set up a system that was supposed to do backoff with factored
> generation steps, more or less in the manner of what's described in this
> paper: Interpolated Backoff for Factored Translation Models, Philipp
> Koehn and Barry Haddow, AMTA 2012.
>
> MIRA tunes all the weights of the backoff models to 0. With exactly the
> same configuration, this did not happen last year (February 2014). Maybe
> the [decoding-graph-backoff] setting didn't have any effect prior to
> some of your code modifications, and the models were actually competing
> in older setups? Or it's buggy now. I can't really tell.
>
> I can show you the two setups if you want.
>
>
>
> On Thu, 2015-04-16 at 21:34 +0400, Hieu Hoang wrote:
>> Didn't know it has changed. How should it behave and how does it
>> actually behave?
>>
>> On 16 Apr 2015 21:04, "Matthias Huck" <mhuck@inf.ed.ac.uk> wrote:
>> Hi Hieu,
>>
>> It seems that [decoding-graph-backoff] doesn't quite behave
>> like last
>> year any more. Can you briefly explain how its behaviour has
>> changed,
>> i.e. what it did before and what it does now? Can you please
>> also let me
>> know whether there's a way to reproduce the old behaviour via
>> configuration options?
>>
>> Cheers,
>> Matthias
>>
>>
>>
>> On Fri, 2015-01-09 at 15:20 +0000, Hieu Hoang wrote:
>> > >From the git history, I think it was slightly broken, then
>> I broke it even
>> > more in May 2014.
>> >
>> >
>> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
>> >
>> > It was
>> > endPos-startPos+1 >= backoff
>> > then
>> > endPos-startPos+1 <= backoff
>> > I think it should be
>> > endPos-startPos+1 > backoff
>> >
>> > I'll change it if it's ok with everyone
>> >
>> >
>> > On 9 January 2015 at 15:11, Marcin Junczys-Dowmunt
>> <junczys@amu.edu.pl>
>> > wrote:
>> >
>> > > Hm, we have been using it at WIPO, but I have to admit I
>> never checked
>> > > it _actually_ does anything useful. We sorta believe it
>> does.
>> > >
>> > > W dniu 09.01.2015 o 16:08, Hieu Hoang pisze:
>> > >
>> > > Hi All
>> > >
>> > > Does anyone use this functionality in Moses when you have
>> multiple
>> > > phrase-tables?
>> > >
>> > > From the code, it doesn't look like it works as described
>> in
>> > > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures
>> > >
>> > > Maybe I'm missing something
>> > >
>> > > --
>> > > Hieu Hoang
>> > > Research Associate
>> > > University of Edinburgh
>> > > http://www.hoang.co.uk/hieu
>> > >
>> > >
>> > >
>> > > _______________________________________________
>> > > Moses-support mailing
>> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>> > >
>> > >
>> > >
>> > > _______________________________________________
>> > > Moses-support mailing list
>> > > Moses-support@mit.edu
>> > > http://mailman.mit.edu/mailman/listinfo/moses-support
>> > >
>> > >
>> >
>> >
>> > _______________________________________________
>> > Moses-support mailing list
>> > Moses-support@mit.edu
>> > http://mailman.mit.edu/mailman/listinfo/moses-support
>> > The University of Edinburgh is a charitable body, registered
>> in
>> > Scotland, with registration number SC005336.
>>
>>
>>
>> --
>> The University of Edinburgh is a charitable body, registered
>> in
>> Scotland, with registration number SC005336.
>>
>>
>
>

--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 102, Issue 34
**********************************************

Tweet