Moses-support Digest, Vol 102, Issue 61

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Question About matrix.stamt.org WMT 2014 Test Set
(Philipp Koehn)
2. Re: mert-moses.pl -continue (liling tan)
3. Re: mert-moses.pl -continue (liling tan)


----------------------------------------------------------------------

Message: 1
Date: Mon, 27 Apr 2015 12:37:31 -0400
From: Philipp Koehn <phi@jhu.edu>
Subject: Re: [Moses-support] Question About matrix.stamt.org WMT 2014
Test Set
To: Graham Neubig <neubig@is.naist.jp>
Cc: "<moses-support@mit.edu>" <moses-support@mit.edu>
Message-ID:
<CAAFADDCTY0ok+=PYyvCTuQXD4_Q7QU4Su+EPb9OswMTPB-D8kQ@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

Hi,

I fixed the link ;)

But Matthias is right: The WMT web pages are the best place to look
for links to corpora / test sets.

-phi

On Mon, Apr 27, 2015 at 10:56 AM, Graham Neubig <neubig@is.naist.jp> wrote:
> Hi Matthias,
>
> Thank you, that's exactly what I was looking for!
> And also thanks for sending the WMT mailing list, I'll send any further
> questions about the evaluation matrix to there from now on.
>
> Graham
>
> On Mon, Apr 27, 2015 at 11:31 PM, Matthias Huck <mhuck@inf.ed.ac.uk> wrote:
>>
>> Hi Graham,
>>
>> Did you have a look at the tarballs that were distributed last year?
>> http://www.statmt.org/wmt14/translation-task.html
>>
>> There are three different version:
>>
>> - Test sets (5.2 MB) These are the source sgm files with extra "filler"
>> sentences. They were the actual files released for the campaign.
>> http://www.statmt.org/wmt14/test.tgz
>>
>> - Filtered Test sets (3.2 MB) These are the source and reference sgm
>> files used to evaluate, i.e. the Test sets without the "filler"
>> sentences. If you want to reproduce results from the campaign, use
>> these.
>> http://www.statmt.org/wmt14/test-filtered.tgz
>>
>> - Cleaned Test sets (3.2 MB) These include fixes to minor encoding
>> errors, and reinstate around 10% of the en-de data which was excluded
>> from the evaluation. For further research, use these.
>> http://www.statmt.org/wmt14/test-full.tgz
>>
>> WMT has a Google Group:
>> https://groups.google.com/forum/#!forum/wmt-tasks
>>
>> Cheers,
>> Matthias
>>
>>
>> On Mon, 2015-04-27 at 22:14 +0900, Graham Neubig wrote:
>> > Hi Moses List,
>> >
>> > Sorry about this being a bit off topic, but I have a question about the
>> > files on matrix.statmt.org, and couldn't find any information about who
>> > to
>> > contact on the site and assumed that here would be the next-best place
>> > to
>> > ask.
>> >
>> > Specifically, I'm looking for the SGM files for newstest2014 in the same
>> > order as the system outputs on matrix.statmt.org. On the "test sets"
>> > page,
>> > in the place where there should be a link to newstest2014, it seems like
>> > the link actually points to newstest2013:
>> > http://matrix.statmt.org/test_sets/list
>> >
>> > And the ones downloadable from the WMT 2015 site seem to be in a
>> > different
>> > order, and it'd be a bit of a pain (although possible) to match the
>> > lines
>> > properly:
>> > http://www.statmt.org/wmt15/translation-task.html
>> >
>> > If possible, could someone help out with this, or tell me who's in
>> > charge
>> > of the evaluation matrix so I can contact them directly?
>> >
>> > Graham
>> > _______________________________________________
>> > Moses-support mailing list
>> > Moses-support@mit.edu
>> > http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> --
>> The University of Edinburgh is a charitable body, registered in
>> Scotland, with registration number SC005336.
>>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

Message: 2
Date: Mon, 27 Apr 2015 19:09:07 +0200
From: liling tan <alvations@gmail.com>
Subject: Re: [Moses-support] mert-moses.pl -continue
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAKzPaJJW3fMx+DAyj-h1VRECcZxe55Q4W5VCw=ZYoREDm6Qw_Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

@Marcin, I've just made a merge from my branch into the master.

Could you point me to the fix and maybe i can try to merge it?

Regards,
Liling

On Mon, Apr 27, 2015 at 6:16 PM, <moses-support-request@mit.edu> wrote:

> Send Moses-support mailing list submissions to
> moses-support@mit.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.mit.edu/mailman/listinfo/moses-support
> or, via email, send a message with subject or body 'help' to
> moses-support-request@mit.edu
>
> You can reach the person managing the list at
> moses-support-owner@mit.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Moses-support digest..."
>
>
> Today's Topics:
>
> 1. mert-moses.pl -continue (Matthias Huck)
> 2. Re: mert-moses.pl -continue (Hieu Hoang)
> 3. Re: mert-moses.pl -continue (Marcin Junczys-Dowmunt)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 27 Apr 2015 16:03:58 +0100
> From: Matthias Huck <mhuck@inf.ed.ac.uk>
> Subject: [Moses-support] mert-moses.pl -continue
> To: Moses-support <moses-support@mit.edu>
> Message-ID: <1430147038.30904.233.camel@portedgar>
> Content-Type: text/plain; charset="UTF-8"
>
> Hi,
>
> Is there possibly a problem when continuing interrupted tuning runs with
> sparse features?
>
> It seems to me that mert-moses.pl doesn't add the [weight-file] section
> to the run*.moses.ini it creates right after resuming the tuning. That
> would imply that no sparse weights are used in the next decoding
> iteration.
>
> Am I doing something wrong, or does anyone know a workaround?
>
> Cheers,
> Matthias
>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
>
> ------------------------------
>
> Message: 2
> Date: Mon, 27 Apr 2015 19:07:42 +0400
> From: Hieu Hoang <hieuhoang@gmail.com>
> Subject: Re: [Moses-support] mert-moses.pl -continue
> To: Matthias Huck <mhuck@inf.ed.ac.uk>
> Cc: Moses-support <moses-support@mit.edu>
> Message-ID:
> <
> CAEKMkbg2imhT-Pubvw_vgKWfnfLwoV8+YL61A9eEytxQDPCErg@mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> i know -continue works ok with dense features. I can't tell you about
> sparse features
>
> Hieu Hoang
> Researcher
> New York University, Abu Dhabi
> http://www.hoang.co.uk/hieu
>
> On 27 April 2015 at 19:03, Matthias Huck <mhuck@inf.ed.ac.uk> wrote:
>
> > Hi,
> >
> > Is there possibly a problem when continuing interrupted tuning runs with
> > sparse features?
> >
> > It seems to me that mert-moses.pl doesn't add the [weight-file] section
> > to the run*.moses.ini it creates right after resuming the tuning. That
> > would imply that no sparse weights are used in the next decoding
> > iteration.
> >
> > Am I doing something wrong, or does anyone know a workaround?
> >
> > Cheers,
> > Matthias
> >
> >
> >
> > --
> > The University of Edinburgh is a charitable body, registered in
> > Scotland, with registration number SC005336.
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL:
> http://mailman.mit.edu/mailman/private/moses-support/attachments/20150427/4c0e841c/attachment-0001.htm
>
> ------------------------------
>
> Message: 3
> Date: Mon, 27 Apr 2015 17:25:30 +0200
> From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
> Subject: Re: [Moses-support] mert-moses.pl -continue
> To: moses-support@mit.edu
> Message-ID: <553E54EA.2020409@amu.edu.pl>
> Content-Type: text/plain; charset="windows-1252"
>
> Hi,
> I can confirm it's not working, if I am not wrong it does not collect
> the sparse features. I fixed that in a branch of mine, but the script
> has diverged a lot between both branches, so I did not commit.
>
> W dniu 27.04.2015 o 17:07, Hieu Hoang pisze:
> > i know -continue works ok with dense features. I can't tell you about
> > sparse features
> >
> > Hieu Hoang
> > Researcher
> > New York University, Abu Dhabi
> > http://www.hoang.co.uk/hieu
> >
> > On 27 April 2015 at 19:03, Matthias Huck <mhuck@inf.ed.ac.uk
> > <mailto:mhuck@inf.ed.ac.uk>> wrote:
> >
> > Hi,
> >
> > Is there possibly a problem when continuing interrupted tuning
> > runs with
> > sparse features?
> >
> > It seems to me that mert-moses.pl <http://mert-moses.pl> doesn't
> > add the [weight-file] section
> > to the run*.moses.ini it creates right after resuming the tuning.
> That
> > would imply that no sparse weights are used in the next decoding
> > iteration.
> >
> > Am I doing something wrong, or does anyone know a workaround?
> >
> > Cheers,
> > Matthias
> >
> >
> >
> > --
> > The University of Edinburgh is a charitable body, registered in
> > Scotland, with registration number SC005336.
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> >
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL:
> http://mailman.mit.edu/mailman/private/moses-support/attachments/20150427/0e41e614/attachment-0001.htm
>
> ------------------------------
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> End of Moses-support Digest, Vol 102, Issue 60
> **********************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150427/f1ba6277/attachment-0001.htm

------------------------------

Message: 3
Date: Mon, 27 Apr 2015 19:35:39 +0200
From: liling tan <alvations@gmail.com>
Subject: Re: [Moses-support] mert-moses.pl -continue
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAKzPaJJ3sa10NK6YgaZAcroihdq03ZOKSKp6J77XJqz9G927uQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

@Marcin, oops wrong script file. Sorry about my previous post. Someone
else more appropriate should patch from your branch. I wasn't commiting
the mert-perl. it was the filter script before mert.

On Mon, Apr 27, 2015 at 7:09 PM, liling tan <alvations@gmail.com> wrote:

>
> @Marcin, I've just made a merge from my branch into the master.
>
> Could you point me to the fix and maybe i can try to merge it?
>
> Regards,
> Liling
>
> On Mon, Apr 27, 2015 at 6:16 PM, <moses-support-request@mit.edu> wrote:
>
>> Send Moses-support mailing list submissions to
>> moses-support@mit.edu
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>> or, via email, send a message with subject or body 'help' to
>> moses-support-request@mit.edu
>>
>> You can reach the person managing the list at
>> moses-support-owner@mit.edu
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of Moses-support digest..."
>>
>>
>> Today's Topics:
>>
>> 1. mert-moses.pl -continue (Matthias Huck)
>> 2. Re: mert-moses.pl -continue (Hieu Hoang)
>> 3. Re: mert-moses.pl -continue (Marcin Junczys-Dowmunt)
>>
>>
>> ----------------------------------------------------------------------
>>
>> Message: 1
>> Date: Mon, 27 Apr 2015 16:03:58 +0100
>> From: Matthias Huck <mhuck@inf.ed.ac.uk>
>> Subject: [Moses-support] mert-moses.pl -continue
>> To: Moses-support <moses-support@mit.edu>
>> Message-ID: <1430147038.30904.233.camel@portedgar>
>> Content-Type: text/plain; charset="UTF-8"
>>
>> Hi,
>>
>> Is there possibly a problem when continuing interrupted tuning runs with
>> sparse features?
>>
>> It seems to me that mert-moses.pl doesn't add the [weight-file] section
>> to the run*.moses.ini it creates right after resuming the tuning. That
>> would imply that no sparse weights are used in the next decoding
>> iteration.
>>
>> Am I doing something wrong, or does anyone know a workaround?
>>
>> Cheers,
>> Matthias
>>
>>
>>
>> --
>> The University of Edinburgh is a charitable body, registered in
>> Scotland, with registration number SC005336.
>>
>>
>>
>> ------------------------------
>>
>> Message: 2
>> Date: Mon, 27 Apr 2015 19:07:42 +0400
>> From: Hieu Hoang <hieuhoang@gmail.com>
>> Subject: Re: [Moses-support] mert-moses.pl -continue
>> To: Matthias Huck <mhuck@inf.ed.ac.uk>
>> Cc: Moses-support <moses-support@mit.edu>
>> Message-ID:
>> <
>> CAEKMkbg2imhT-Pubvw_vgKWfnfLwoV8+YL61A9eEytxQDPCErg@mail.gmail.com>
>> Content-Type: text/plain; charset="utf-8"
>>
>> i know -continue works ok with dense features. I can't tell you about
>> sparse features
>>
>> Hieu Hoang
>> Researcher
>> New York University, Abu Dhabi
>> http://www.hoang.co.uk/hieu
>>
>> On 27 April 2015 at 19:03, Matthias Huck <mhuck@inf.ed.ac.uk> wrote:
>>
>> > Hi,
>> >
>> > Is there possibly a problem when continuing interrupted tuning runs with
>> > sparse features?
>> >
>> > It seems to me that mert-moses.pl doesn't add the [weight-file] section
>> > to the run*.moses.ini it creates right after resuming the tuning. That
>> > would imply that no sparse weights are used in the next decoding
>> > iteration.
>> >
>> > Am I doing something wrong, or does anyone know a workaround?
>> >
>> > Cheers,
>> > Matthias
>> >
>> >
>> >
>> > --
>> > The University of Edinburgh is a charitable body, registered in
>> > Scotland, with registration number SC005336.
>> >
>> > _______________________________________________
>> > Moses-support mailing list
>> > Moses-support@mit.edu
>> > http://mailman.mit.edu/mailman/listinfo/moses-support
>> >
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL:
>> http://mailman.mit.edu/mailman/private/moses-support/attachments/20150427/4c0e841c/attachment-0001.htm
>>
>> ------------------------------
>>
>> Message: 3
>> Date: Mon, 27 Apr 2015 17:25:30 +0200
>> From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
>> Subject: Re: [Moses-support] mert-moses.pl -continue
>> To: moses-support@mit.edu
>> Message-ID: <553E54EA.2020409@amu.edu.pl>
>> Content-Type: text/plain; charset="windows-1252"
>>
>> Hi,
>> I can confirm it's not working, if I am not wrong it does not collect
>> the sparse features. I fixed that in a branch of mine, but the script
>> has diverged a lot between both branches, so I did not commit.
>>
>> W dniu 27.04.2015 o 17:07, Hieu Hoang pisze:
>> > i know -continue works ok with dense features. I can't tell you about
>> > sparse features
>> >
>> > Hieu Hoang
>> > Researcher
>> > New York University, Abu Dhabi
>> > http://www.hoang.co.uk/hieu
>> >
>> > On 27 April 2015 at 19:03, Matthias Huck <mhuck@inf.ed.ac.uk
>> > <mailto:mhuck@inf.ed.ac.uk>> wrote:
>> >
>> > Hi,
>> >
>> > Is there possibly a problem when continuing interrupted tuning
>> > runs with
>> > sparse features?
>> >
>> > It seems to me that mert-moses.pl <http://mert-moses.pl> doesn't
>> > add the [weight-file] section
>> > to the run*.moses.ini it creates right after resuming the tuning.
>> That
>> > would imply that no sparse weights are used in the next decoding
>> > iteration.
>> >
>> > Am I doing something wrong, or does anyone know a workaround?
>> >
>> > Cheers,
>> > Matthias
>> >
>> >
>> >
>> > --
>> > The University of Edinburgh is a charitable body, registered in
>> > Scotland, with registration number SC005336.
>> >
>> > _______________________________________________
>> > Moses-support mailing list
>> > Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> > http://mailman.mit.edu/mailman/listinfo/moses-support
>> >
>> >
>> >
>> >
>> > _______________________________________________
>> > Moses-support mailing list
>> > Moses-support@mit.edu
>> > http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL:
>> http://mailman.mit.edu/mailman/private/moses-support/attachments/20150427/0e41e614/attachment-0001.htm
>>
>> ------------------------------
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>> End of Moses-support Digest, Vol 102, Issue 60
>> **********************************************
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150427/5f63ece5/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 102, Issue 61
**********************************************

Tweet