Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: [decoding-graph-backoff] (Matthias Huck)
2. Re: [decoding-graph-backoff] (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Sun, 19 Apr 2015 12:49:48 +0100
From: Matthias Huck <mhuck@inf.ed.ac.uk>
Subject: Re: [Moses-support] [decoding-graph-backoff]
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <1429444188.2635.7.camel@inf.ed.ac.uk>
Content-Type: text/plain; charset="UTF-8"
Okay fine. So the backoff apparently works even though the code seemed
to suggest something different to me. Got it wrong I guess.
Maybe there's some other problem in my setup, for instance with factored
generation steps.
Thanks anyway for looking into this.
On Sun, 2015-04-19 at 12:52 +0400, Hieu Hoang wrote:
> i used the following simple moses.ini file. the decoder seems to be
> doing what is expected. Models, input and & output attached.
> [input-factors]
> 0
>
> [mapping]
> 0 T 0
> 1 T 1
>
>
> [feature]
> UnknownWordPenalty
> PhraseDictionaryCompact name=pt input-factor=0 output-factor=0
> path=pt.compact num-features=1
> PhraseDictionaryCompact name=pt2 input-factor=0 output-factor=0
> path=pt2.compact num-features=1
>
> [weight]
> pt= 1
> pt2= 1
>
> [decoding-graph-backoff]
> 0
> 1
>
>
>
>
> Hieu Hoang
> Researcher
>
> New York University, Abu Dhabi
>
> http://www.hoang.co.uk/hieu
>
>
> On 17 April 2015 at 01:26, Matthias Huck <mhuck@inf.ed.ac.uk> wrote:
> I think your remark in the mail from January was correct, it
> has to be
> ePos-sPos+1 > backoff
> but currently still is
> ePos-sPos+1 <= backoff
>
> Are you able to somehow test this?
>
>
> On Thu, 2015-04-16 at 23:57 +0400, Hieu Hoang wrote:
> > ah yes, I thought the backoff was doing the opposite to what
> it's
> > supposed to do so I changed the comparison around. I checked
> that it
> > backed off, but i didn't run it through tuning.
> >
> > it may still be wrong, or there may be strange interaction
> with the tuning.
> >
> >
> > On 16/04/2015 22:16, Matthias Huck wrote:
> > > Well, what's that business mentioned in your mail from
> January (quoted
> > > below), with the backoff being broken, then being broken
> more, then
> > > possibly been fixed - or not?
> > >
> > >
> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
> > >
> > >
> > > I set up a system that was supposed to do backoff with
> factored
> > > generation steps, more or less in the manner of what's
> described in this
> > > paper: Interpolated Backoff for Factored Translation
> Models, Philipp
> > > Koehn and Barry Haddow, AMTA 2012.
> > >
> > > MIRA tunes all the weights of the backoff models to 0.
> With exactly the
> > > same configuration, this did not happen last year
> (February 2014). Maybe
> > > the [decoding-graph-backoff] setting didn't have any
> effect prior to
> > > some of your code modifications, and the models were
> actually competing
> > > in older setups? Or it's buggy now. I can't really tell.
> > >
> > > I can show you the two setups if you want.
> > >
> > >
> > >
> > > On Thu, 2015-04-16 at 21:34 +0400, Hieu Hoang wrote:
> > >> Didn't know it has changed. How should it behave and how
> does it
> > >> actually behave?
> > >>
> > >> On 16 Apr 2015 21:04, "Matthias Huck"
> <mhuck@inf.ed.ac.uk> wrote:
> > >> Hi Hieu,
> > >>
> > >> It seems that [decoding-graph-backoff] doesn't
> quite behave
> > >> like last
> > >> year any more. Can you briefly explain how its
> behaviour has
> > >> changed,
> > >> i.e. what it did before and what it does now?
> Can you please
> > >> also let me
> > >> know whether there's a way to reproduce the old
> behaviour via
> > >> configuration options?
> > >>
> > >> Cheers,
> > >> Matthias
> > >>
> > >>
> > >>
> > >> On Fri, 2015-01-09 at 15:20 +0000, Hieu Hoang
> wrote:
> > >> > >From the git history, I think it was slightly
> broken, then
> > >> I broke it even
> > >> > more in May 2014.
> > >> >
> > >> >
> > >>
> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
> > >> >
> > >> > It was
> > >> > endPos-startPos+1 >= backoff
> > >> > then
> > >> > endPos-startPos+1 <= backoff
> > >> > I think it should be
> > >> > endPos-startPos+1 > backoff
> > >> >
> > >> > I'll change it if it's ok with everyone
> > >> >
> > >> >
> > >> > On 9 January 2015 at 15:11, Marcin
> Junczys-Dowmunt
> > >> <junczys@amu.edu.pl>
> > >> > wrote:
> > >> >
> > >> > > Hm, we have been using it at WIPO, but I
> have to admit I
> > >> never checked
> > >> > > it _actually_ does anything useful. We sorta
> believe it
> > >> does.
> > >> > >
> > >> > > W dniu 09.01.2015 o 16:08, Hieu Hoang pisze:
> > >> > >
> > >> > > Hi All
> > >> > >
> > >> > > Does anyone use this functionality in Moses
> when you have
> > >> multiple
> > >> > > phrase-tables?
> > >> > >
> > >> > > From the code, it doesn't look like it
> works as described
> > >> in
> > >> > >
> http://www.statmt.org/moses/?n=Moses.AdvancedFeatures
> > >> > >
> > >> > > Maybe I'm missing something
> > >> > >
> > >> > > --
> > >> > > Hieu Hoang
> > >> > > Research Associate
> > >> > > University of Edinburgh
> > >> > > http://www.hoang.co.uk/hieu
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> _______________________________________________
> > >> > > Moses-support mailing
> > >>
> listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> _______________________________________________
> > >> > > Moses-support mailing list
> > >> > > Moses-support@mit.edu
> > >> > >
> http://mailman.mit.edu/mailman/listinfo/moses-support
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >> >
> _______________________________________________
> > >> > Moses-support mailing list
> > >> > Moses-support@mit.edu
> > >> >
> http://mailman.mit.edu/mailman/listinfo/moses-support
> > >> > The University of Edinburgh is a charitable
> body, registered
> > >> in
> > >> > Scotland, with registration number SC005336.
> > >>
> > >>
> > >>
> > >> --
> > >> The University of Edinburgh is a charitable
> body, registered
> > >> in
> > >> Scotland, with registration number SC005336.
> > >>
> > >>
> > >
> > >
> >
>
>
>
> --
> The University of Edinburgh is a charitable body, registered
> in
> Scotland, with registration number SC005336.
>
>
>
>
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
------------------------------
Message: 2
Date: Sun, 19 Apr 2015 17:17:23 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] [decoding-graph-backoff]
To: Matthias Huck <mhuck@inf.ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbg-enALuzFaZsK+QuKn_FX7M7Y2xnN1KnNtp3=+X4F4_g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
there may be problems when using factors.
Whether to use the backoff pt now decided by looking at whether there were
TRANSLATION RULES from the phrase-table. Previously, it was based on
whether there were TRANSLATION OPTIONS
I didn't check the edge cases for backoff. If you can put together a simple
example, i can take a look.
Attaching my simple factored example, seems to work ok
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu
On 19 April 2015 at 15:49, Matthias Huck <mhuck@inf.ed.ac.uk> wrote:
> Okay fine. So the backoff apparently works even though the code seemed
> to suggest something different to me. Got it wrong I guess.
>
> Maybe there's some other problem in my setup, for instance with factored
> generation steps.
>
> Thanks anyway for looking into this.
>
>
> On Sun, 2015-04-19 at 12:52 +0400, Hieu Hoang wrote:
> > i used the following simple moses.ini file. the decoder seems to be
> > doing what is expected. Models, input and & output attached.
> > [input-factors]
> > 0
> >
> > [mapping]
> > 0 T 0
> > 1 T 1
> >
> >
> > [feature]
> > UnknownWordPenalty
> > PhraseDictionaryCompact name=pt input-factor=0 output-factor=0
> > path=pt.compact num-features=1
> > PhraseDictionaryCompact name=pt2 input-factor=0 output-factor=0
> > path=pt2.compact num-features=1
> >
> > [weight]
> > pt= 1
> > pt2= 1
> >
> > [decoding-graph-backoff]
> > 0
> > 1
> >
> >
> >
> >
> > Hieu Hoang
> > Researcher
> >
> > New York University, Abu Dhabi
> >
> > http://www.hoang.co.uk/hieu
> >
> >
> > On 17 April 2015 at 01:26, Matthias Huck <mhuck@inf.ed.ac.uk> wrote:
> > I think your remark in the mail from January was correct, it
> > has to be
> > ePos-sPos+1 > backoff
> > but currently still is
> > ePos-sPos+1 <= backoff
> >
> > Are you able to somehow test this?
> >
> >
> > On Thu, 2015-04-16 at 23:57 +0400, Hieu Hoang wrote:
> > > ah yes, I thought the backoff was doing the opposite to what
> > it's
> > > supposed to do so I changed the comparison around. I checked
> > that it
> > > backed off, but i didn't run it through tuning.
> > >
> > > it may still be wrong, or there may be strange interaction
> > with the tuning.
> > >
> > >
> > > On 16/04/2015 22:16, Matthias Huck wrote:
> > > > Well, what's that business mentioned in your mail from
> > January (quoted
> > > > below), with the backoff being broken, then being broken
> > more, then
> > > > possibly been fixed - or not?
> > > >
> > > >
> >
> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
> > > >
> > > >
> > > > I set up a system that was supposed to do backoff with
> > factored
> > > > generation steps, more or less in the manner of what's
> > described in this
> > > > paper: Interpolated Backoff for Factored Translation
> > Models, Philipp
> > > > Koehn and Barry Haddow, AMTA 2012.
> > > >
> > > > MIRA tunes all the weights of the backoff models to 0.
> > With exactly the
> > > > same configuration, this did not happen last year
> > (February 2014). Maybe
> > > > the [decoding-graph-backoff] setting didn't have any
> > effect prior to
> > > > some of your code modifications, and the models were
> > actually competing
> > > > in older setups? Or it's buggy now. I can't really tell.
> > > >
> > > > I can show you the two setups if you want.
> > > >
> > > >
> > > >
> > > > On Thu, 2015-04-16 at 21:34 +0400, Hieu Hoang wrote:
> > > >> Didn't know it has changed. How should it behave and how
> > does it
> > > >> actually behave?
> > > >>
> > > >> On 16 Apr 2015 21:04, "Matthias Huck"
> > <mhuck@inf.ed.ac.uk> wrote:
> > > >> Hi Hieu,
> > > >>
> > > >> It seems that [decoding-graph-backoff] doesn't
> > quite behave
> > > >> like last
> > > >> year any more. Can you briefly explain how its
> > behaviour has
> > > >> changed,
> > > >> i.e. what it did before and what it does now?
> > Can you please
> > > >> also let me
> > > >> know whether there's a way to reproduce the old
> > behaviour via
> > > >> configuration options?
> > > >>
> > > >> Cheers,
> > > >> Matthias
> > > >>
> > > >>
> > > >>
> > > >> On Fri, 2015-01-09 at 15:20 +0000, Hieu Hoang
> > wrote:
> > > >> > >From the git history, I think it was slightly
> > broken, then
> > > >> I broke it even
> > > >> > more in May 2014.
> > > >> >
> > > >> >
> > > >>
> >
> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
> > > >> >
> > > >> > It was
> > > >> > endPos-startPos+1 >= backoff
> > > >> > then
> > > >> > endPos-startPos+1 <= backoff
> > > >> > I think it should be
> > > >> > endPos-startPos+1 > backoff
> > > >> >
> > > >> > I'll change it if it's ok with everyone
> > > >> >
> > > >> >
> > > >> > On 9 January 2015 at 15:11, Marcin
> > Junczys-Dowmunt
> > > >> <junczys@amu.edu.pl>
> > > >> > wrote:
> > > >> >
> > > >> > > Hm, we have been using it at WIPO, but I
> > have to admit I
> > > >> never checked
> > > >> > > it _actually_ does anything useful. We sorta
> > believe it
> > > >> does.
> > > >> > >
> > > >> > > W dniu 09.01.2015 o 16:08, Hieu Hoang pisze:
> > > >> > >
> > > >> > > Hi All
> > > >> > >
> > > >> > > Does anyone use this functionality in Moses
> > when you have
> > > >> multiple
> > > >> > > phrase-tables?
> > > >> > >
> > > >> > > From the code, it doesn't look like it
> > works as described
> > > >> in
> > > >> > >
> > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures
> > > >> > >
> > > >> > > Maybe I'm missing something
> > > >> > >
> > > >> > > --
> > > >> > > Hieu Hoang
> > > >> > > Research Associate
> > > >> > > University of Edinburgh
> > > >> > > http://www.hoang.co.uk/hieu
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> > >
> > _______________________________________________
> > > >> > > Moses-support mailing
> > > >>
> > listMoses-support@mit.eduhttp://
> mailman.mit.edu/mailman/listinfo/moses-support
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> > >
> > _______________________________________________
> > > >> > > Moses-support mailing list
> > > >> > > Moses-support@mit.edu
> > > >> > >
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> > > >> > >
> > > >> > >
> > > >> >
> > > >> >
> > > >> >
> > _______________________________________________
> > > >> > Moses-support mailing list
> > > >> > Moses-support@mit.edu
> > > >> >
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> > > >> > The University of Edinburgh is a charitable
> > body, registered
> > > >> in
> > > >> > Scotland, with registration number SC005336.
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> The University of Edinburgh is a charitable
> > body, registered
> > > >> in
> > > >> Scotland, with registration number SC005336.
> > > >>
> > > >>
> > > >
> > > >
> > >
> >
> >
> >
> > --
> > The University of Edinburgh is a charitable body, registered
> > in
> > Scotland, with registration number SC005336.
> >
> >
> >
> >
>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150419/bb8cbbb9/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: backoff.zip
Type: application/zip
Size: 3029 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150419/bb8cbbb9/attachment.zip
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 102, Issue 40
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 102, Issue 40"
Post a Comment