Moses-support Digest, Vol 95, Issue 11

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Incremental retraining (Sandipan Dandapat)
2. Re: Incremental retraining (Hieu Hoang)
3. Re: Incremental retraining (Sandipan Dandapat)


----------------------------------------------------------------------

Message: 1
Date: Sun, 7 Sep 2014 14:59:41 +0100
From: Sandipan Dandapat <sandipandandapat@gmail.com>
Subject: Re: [Moses-support] Incremental retraining
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>, ulrich.germann@gmail.com
Message-ID:
<CAGr2oZR94CkJ7b0RPuuY4mtoszDn5SoWRrXjUz=iQwQcD9oCbw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Hieu,
I also tried the same but generates the error below:

Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void
Moses::Mmsapt::Load() threw util::Exception because
`this->m_feature_names.size() != this->m_numScoreComponents'.
At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values
provided by Phrase table (7) does not match number specified in Moses
config file (4)!

Thanks and regards,
sandipan


On 6 September 2014 09:50, Hieu Hoang <hieuhoang@gmail.com> wrote:

> I'm not sure how many scores there are in the phrase table
> PhraseDictionaryBitextSampling
> It may be 4. In which case you must specify
>
> [feature]
> PhraseDictionaryBitextSampling name=PT0 num-features=4 ...
>
> [weight]
> PT0= 0.1 0.2 0.3 0.4
>
>
> On 05/09/14 14:12, Sandipan Dandapat wrote:
>
> Hi,
> During incremental retraining I specified the following line in moses .ini
> PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9
> path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl
> pfwd=g pbwd=g smooth=0 sample=1000 workers=1
>
> this generates the error:
> Feature function PT0 specified 9 dense scores or weights. Actually has 0.
>
> which is solved when num-features is changed to '0'
> but generates the error below:
>
> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void
> Moses::Mmsapt::Load() threw util::Exception because
> `this->m_feature_names.size() != this->m_numScoreComponents'.
> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values
> provided by Phrase table (7) does not match number specified in Moses
> config file (0)!
> Changing it to 7 also does not help.
>
> I have tried with
> Mmsapt name=PT0 output-factor=0 num-features=0
> base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl
>
> but does not work.
> What I need to do at this stage of retraining using moses?
>
> Thanks and regards,
> sandipan
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140907/059aeb53/attachment-0001.htm

------------------------------

Message: 2
Date: Sun, 7 Sep 2014 15:46:28 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Incremental retraining
To: sandipandandapat@mail.com
Cc: moses-support <moses-support@mit.edu>, Ulrich Germann
<ulrich.germann@gmail.com>
Message-ID:
<CAEKMkbj_hW8fJdOGuCMQY6edz=j8my3YjkVoZq7xQS03YjGQuQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

maybe's it's 7 scores


On 7 September 2014 14:59, Sandipan Dandapat <sandipandandapat@gmail.com>
wrote:

> Hi Hieu,
> I also tried the same but generates the error below:
>
> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void
> Moses::Mmsapt::Load() threw util::Exception because
> `this->m_feature_names.size() != this->m_numScoreComponents'.
> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values
> provided by Phrase table (7) does not match number specified in Moses
> config file (4)!
>
> Thanks and regards,
> sandipan
>
>
> On 6 September 2014 09:50, Hieu Hoang <hieuhoang@gmail.com> wrote:
>
>> I'm not sure how many scores there are in the phrase table
>> PhraseDictionaryBitextSampling
>> It may be 4. In which case you must specify
>>
>> [feature]
>> PhraseDictionaryBitextSampling name=PT0 num-features=4 ...
>>
>> [weight]
>> PT0= 0.1 0.2 0.3 0.4
>>
>>
>> On 05/09/14 14:12, Sandipan Dandapat wrote:
>>
>> Hi,
>> During incremental retraining I specified the following line in moses
>> .ini
>> PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9
>> path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl
>> pfwd=g pbwd=g smooth=0 sample=1000 workers=1
>>
>> this generates the error:
>> Feature function PT0 specified 9 dense scores or weights. Actually has 0.
>>
>> which is solved when num-features is changed to '0'
>> but generates the error below:
>>
>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void
>> Moses::Mmsapt::Load() threw util::Exception because
>> `this->m_feature_names.size() != this->m_numScoreComponents'.
>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values
>> provided by Phrase table (7) does not match number specified in Moses
>> config file (0)!
>> Changing it to 7 also does not help.
>>
>> I have tried with
>> Mmsapt name=PT0 output-factor=0 num-features=0
>> base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl
>>
>> but does not work.
>> What I need to do at this stage of retraining using moses?
>>
>> Thanks and regards,
>> sandipan
>>
>>
>> _______________________________________________
>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140907/a5ef5bd1/attachment-0001.htm

------------------------------

Message: 3
Date: Sun, 7 Sep 2014 16:06:35 +0100
From: Sandipan Dandapat <sandipandandapat@gmail.com>
Subject: Re: [Moses-support] Incremental retraining
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>, Ulrich Germann
<ulrich.germann@gmail.com>
Message-ID:
<CAGr2oZSYiNpj=Hi-5b=3G+1OATALFno69ZHCwiS4sWwjs7kh7A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Hieu,
Even I tried with '7' and it fails with the error message

Exception: moses/ScoreComponentCollection.cpp:248 in void
Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*,
const std::vector<float>&) threw util::Exception'.
Feature function PT0 specified 7 dense scores or weights. Actually has 4

In contrast, when I am using binarised pharse table, I use num-features=4
and this works fine. I am attaching the Moses.ini file in case I am doing
anything wrong there.

Thanks and regards,
sandipan


On 7 September 2014 15:46, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:

> maybe's it's 7 scores
>
>
> On 7 September 2014 14:59, Sandipan Dandapat <sandipandandapat@gmail.com>
> wrote:
>
>> Hi Hieu,
>> I also tried the same but generates the error below:
>>
>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void
>> Moses::Mmsapt::Load() threw util::Exception because
>> `this->m_feature_names.size() != this->m_numScoreComponents'.
>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values
>> provided by Phrase table (7) does not match number specified in Moses
>> config file (4)!
>>
>> Thanks and regards,
>> sandipan
>>
>>
>> On 6 September 2014 09:50, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>
>>> I'm not sure how many scores there are in the phrase table
>>> PhraseDictionaryBitextSampling
>>> It may be 4. In which case you must specify
>>>
>>> [feature]
>>> PhraseDictionaryBitextSampling name=PT0 num-features=4 ...
>>>
>>> [weight]
>>> PT0= 0.1 0.2 0.3 0.4
>>>
>>>
>>> On 05/09/14 14:12, Sandipan Dandapat wrote:
>>>
>>> Hi,
>>> During incremental retraining I specified the following line in moses
>>> .ini
>>> PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9
>>> path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl
>>> pfwd=g pbwd=g smooth=0 sample=1000 workers=1
>>>
>>> this generates the error:
>>> Feature function PT0 specified 9 dense scores or weights. Actually has 0.
>>>
>>> which is solved when num-features is changed to '0'
>>> but generates the error below:
>>>
>>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void
>>> Moses::Mmsapt::Load() threw util::Exception because
>>> `this->m_feature_names.size() != this->m_numScoreComponents'.
>>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values
>>> provided by Phrase table (7) does not match number specified in Moses
>>> config file (0)!
>>> Changing it to 7 also does not help.
>>>
>>> I have tried with
>>> Mmsapt name=PT0 output-factor=0 num-features=0
>>> base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl
>>>
>>> but does not work.
>>> What I need to do at this stage of retraining using moses?
>>>
>>> Thanks and regards,
>>> sandipan
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140907/85b028e4/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: moses.ini
Type: application/octet-stream
Size: 1597 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140907/85b028e4/attachment.obj

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 95, Issue 11
*********************************************

Tweet