Moses-support Digest, Vol 102, Issue 3

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Binarize phrase table with domain feature throws "Already
saved" exception (Hieu Hoang)
2. Re: ProbingPT tests not building (Jeroen Vermeulen)
3. Re: ProbingPT tests not building (Nikolay Bogoychev)


----------------------------------------------------------------------

Message: 1
Date: Wed, 1 Apr 2015 19:47:00 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Binarize phrase table with domain feature
throws "Already saved" exception
To: jian zhang <zhangj@computing.dcu.ie>, moses-support
<moses-support@mit.edu>
Message-ID:
<CAEKMkbgK9rTBemSwPjn-N2s1HCG+rXWnp1quB5nwO73aBEaTQw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

the domain-adaptation routine has added more scores to the phrase-table.
You need to tell the binarizer that. This works for me

MOSES_DIR=/Users/hieu/workspace/github/mosesdecoder

$MOSES_DIR/bin/CreateOnDiskPt 1 1 7 100 2 test-phrase-table
test-phrase-table.bin


Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu

On 1 April 2015 at 19:41, jian zhang <zhangj@computing.dcu.ie> wrote:

> Hi Hieu:
>
> Attached is a 10-line phrase table to generate the error.
>
> I am using command:
>
> /system/mosesdecoder-master/bin/CreateOnDiskPt 1 1 4 100 2
> /experiments/de-en/domains-30-03-2015/domain-indicator/steps/1/test-phrase-table
> /experiments/de-en/domains-30-03-2015/domain-indicator/steps/1/test-phrase-table.bin
> terminate called after throwing an instance of 'util::Exception'
> what(): OnDiskPt/PhraseNode.cpp:97 in void
> OnDiskPt::PhraseNode::Save(OnDiskPt::OnDiskWrapper&, size_t, size_t) threw
> util::Exception because `m_saved'.
> Already saved
> Aborted (core dumped)
>
> Regards,
>
> Jian
>
>
> On Wed, Apr 1, 2015 at 4:32 PM, jian zhang <zhangj@computing.dcu.ie>
> wrote:
>
>> H
>>
>> On Wed, Apr 1, 2015 at 4:20 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>
>>> strange. is it possible you can make the text phrase-table available for
>>> download
>>>
>>> Hieu Hoang
>>> Research Associate
>>> New York University, Abu Dhabi
>>> http://www.hoang.co.uk/hieu
>>>
>>> On 1 April 2015 at 14:27, jian zhang <zhangj@computing.dcu.ie> wrote:
>>>
>>>> Hi,
>>>>
>>>> When I am binarizing phrase table with domain sparse features, I got
>>>> exception:
>>>>
>>>> Executing: /system/mosesdecoder-master/bin/CreateOnDiskPt 1 1 4 100 2
>>>> /experiments/de-en/domains-30-03-2015/domain-indicator/tuning/filtered.1/phrase-table.0-0.1.1
>>>> /experiments/de-en/domains-30-03-2015/domain-indicator/tuning/filtered.1/phrase-table.0-0.1.1.bin
>>>> terminate called after throwing an instance of 'util::Exception'
>>>> what(): OnDiskPt/PhraseNode.cpp:97 in void
>>>> OnDiskPt::PhraseNode::Save(OnDiskPt::OnDiskWrapper&, size_t, size_t) threw
>>>> util::Exception because `m_saved'.
>>>> Already saved
>>>>
>>>> I am using ems on moses version 3.0, and the configuration for domain
>>>> feature is
>>>> domain-features = "subset"
>>>>
>>>> The phrase table entries look like:
>>>> ! ! ! ! ! ! ! ||| ! ! ! ! ! ! ! ||| 0.41129 0.0415342 0.344595
>>>> 9.9589e-05 2.718 1 1 ||| 0-0 1-1 2-2 3-3 4-4 5-5 6-6 ||| 124 148 51 ||| |||
>>>> ! ! ! ! ! ! ! ||| ! ! ! ! ! ! ||| 0.00574516 0.0415342 0.00590043
>>>> 0.000371446 2.718 1 1 ||| 1-0 0-1 2-1 3-2 4-3 5-4 6-5 ||| 152 148 2 ||| |||
>>>> ! ! ! ! ! ! ! ||| ! ! ! ! ! ||| 0.000320174 0.0415342 0.00044132
>>>> 0.00138541 2.718 1 1 ||| 0-0 1-0 1-1 2-1 3-1 2-2 4-2 3-3 5-3 4-4 6-4 |||
>>>> 204 148 1 ||| |||
>>>>
>>>> Did I miss anything?
>>>>
>>>> Thanks,
>>>>
>>>> Jian
>>>>
>>>> --
>>>> Jian Zhang
>>>> Centre for Next Generation Localisation (CNGL)
>>>> <http://www.cngl.ie/index.html>
>>>> Dublin City University <http://www.dcu.ie/>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>
>>
>>
>> --
>> Jian Zhang
>> Centre for Next Generation Localisation (CNGL)
>> <http://www.cngl.ie/index.html>
>> Dublin City University <http://www.dcu.ie/>
>>
>
>
>
> --
> Jian Zhang
> Centre for Next Generation Localisation (CNGL)
> <http://www.cngl.ie/index.html>
> Dublin City University <http://www.dcu.ie/>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150401/a88abe98/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 01 Apr 2015 22:49:38 +0700
From: Jeroen Vermeulen <jtv@precisiontranslationtools.com>
Subject: Re: [Moses-support] ProbingPT tests not building
To: Nikolay Bogoychev <nheart@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <551C1392.3010906@precisiontranslationtools.com>
Content-Type: text/plain; charset=utf-8

On 01/04/15 22:29, Nikolay Bogoychev wrote:

> Those tests are indeed obsolete, I used them to test some behavior when
> I was building probingPT but the function in question became part of the
> HuffmanDecoder class as getTargetWordFromID
> You don't need to build or worry about those tests (there isn't a
> Jamfile in that directory) I still don't have __proper__ tests for
> probingPT.

Thanks for the quick response!

If they're not being built, maybe it's better to delete both the tests
in ProbingPT/tess/ then, so that they don't give people a false sense of
security?

They'll still be in revision control if you want to refer to them for
writing new tests. Somebody else who wants to write tests won't know
that, but in my experience, it's often better for people to start from
scratch in that situation anyway.


Jeroen


------------------------------

Message: 3
Date: Wed, 1 Apr 2015 17:00:39 +0100
From: Nikolay Bogoychev <nheart@gmail.com>
Subject: Re: [Moses-support] ProbingPT tests not building
To: Jeroen Vermeulen <jtv@precisiontranslationtools.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAJzPUEz=Up9nkcx_SYUbRjLvrsffcG7g5yH0gDAJA-vimrbjFA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Done.

Thanks for spotting it.

On Wed, Apr 1, 2015 at 4:49 PM, Jeroen Vermeulen <
jtv@precisiontranslationtools.com> wrote:

> On 01/04/15 22:29, Nikolay Bogoychev wrote:
>
> > Those tests are indeed obsolete, I used them to test some behavior when
> > I was building probingPT but the function in question became part of the
> > HuffmanDecoder class as getTargetWordFromID
> > You don't need to build or worry about those tests (there isn't a
> > Jamfile in that directory) I still don't have __proper__ tests for
> > probingPT.
>
> Thanks for the quick response!
>
> If they're not being built, maybe it's better to delete both the tests
> in ProbingPT/tess/ then, so that they don't give people a false sense of
> security?
>
> They'll still be in revision control if you want to refer to them for
> writing new tests. Somebody else who wants to write tests won't know
> that, but in my experience, it's often better for people to start from
> scratch in that situation anyway.
>
>
> Jeroen
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150401/201517ad/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 102, Issue 3
*********************************************

Tweet