Moses-support Digest, Vol 95, Issue 12

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Incremental retraining (Hieu Hoang)
2. Re: Incremental retraining (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Sun, 7 Sep 2014 16:08:44 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Incremental retraining
To: sandipandandapat@mail.com
Cc: moses-support <moses-support@mit.edu>, Ulrich Germann
<ulrich.germann@gmail.com>
Message-ID:
<CAEKMkbj+ofdr75ZekA8ax5G-324c1_ckn5HD6DpM2zKd6U5S_g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

you HAVE to change both
num-features=4
AND
[weight]
PT0= 0.1 0.2 0.3 0.4 0.5 0.6 0.7


On 7 September 2014 16:06, Sandipan Dandapat <sandipandandapat@gmail.com>
wrote:

> Hi Hieu,
> Even I tried with '7' and it fails with the error message
>
> Exception: moses/ScoreComponentCollection.cpp:248 in void
> Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*,
> const std::vector<float>&) threw util::Exception'.
> Feature function PT0 specified 7 dense scores or weights. Actually has 4
>
> In contrast, when I am using binarised pharse table, I use num-features=4
> and this works fine. I am attaching the Moses.ini file in case I am doing
> anything wrong there.
>
> Thanks and regards,
> sandipan
>
>
> On 7 September 2014 15:46, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:
>
>> maybe's it's 7 scores
>>
>>
>> On 7 September 2014 14:59, Sandipan Dandapat <sandipandandapat@gmail.com>
>> wrote:
>>
>>> Hi Hieu,
>>> I also tried the same but generates the error below:
>>>
>>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void
>>> Moses::Mmsapt::Load() threw util::Exception because
>>> `this->m_feature_names.size() != this->m_numScoreComponents'.
>>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values
>>> provided by Phrase table (7) does not match number specified in Moses
>>> config file (4)!
>>>
>>> Thanks and regards,
>>> sandipan
>>>
>>>
>>> On 6 September 2014 09:50, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>>
>>>> I'm not sure how many scores there are in the phrase table
>>>> PhraseDictionaryBitextSampling
>>>> It may be 4. In which case you must specify
>>>>
>>>> [feature]
>>>> PhraseDictionaryBitextSampling name=PT0 num-features=4 ...
>>>>
>>>> [weight]
>>>> PT0= 0.1 0.2 0.3 0.4
>>>>
>>>>
>>>> On 05/09/14 14:12, Sandipan Dandapat wrote:
>>>>
>>>> Hi,
>>>> During incremental retraining I specified the following line in moses
>>>> .ini
>>>> PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9
>>>> path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl
>>>> pfwd=g pbwd=g smooth=0 sample=1000 workers=1
>>>>
>>>> this generates the error:
>>>> Feature function PT0 specified 9 dense scores or weights. Actually has
>>>> 0.
>>>>
>>>> which is solved when num-features is changed to '0'
>>>> but generates the error below:
>>>>
>>>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void
>>>> Moses::Mmsapt::Load() threw util::Exception because
>>>> `this->m_feature_names.size() != this->m_numScoreComponents'.
>>>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values
>>>> provided by Phrase table (7) does not match number specified in Moses
>>>> config file (0)!
>>>> Changing it to 7 also does not help.
>>>>
>>>> I have tried with
>>>> Mmsapt name=PT0 output-factor=0 num-features=0
>>>> base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl
>>>>
>>>> but does not work.
>>>> What I need to do at this stage of retraining using moses?
>>>>
>>>> Thanks and regards,
>>>> sandipan
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>
>>
>>
>> --
>> Hieu Hoang
>> Research Associate
>> University of Edinburgh
>> http://www.hoang.co.uk/hieu
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140907/d0bbba6d/attachment-0001.htm

------------------------------

Message: 2
Date: Sun, 7 Sep 2014 16:09:04 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Incremental retraining
To: sandipandandapat@mail.com
Cc: moses-support <moses-support@mit.edu>, Ulrich Germann
<ulrich.germann@gmail.com>
Message-ID:
<CAEKMkbibYtL1Rom9BEfT_LM79yorZQNV8MSJuhVyUKa2HQ6KDQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

sorry, i meant


On 7 September 2014 16:08, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:

> you HAVE to change both
> num-features=7
> AND
> [weight]
> PT0= 0.1 0.2 0.3 0.4 0.5 0.6 0.7
>
>
> On 7 September 2014 16:06, Sandipan Dandapat <sandipandandapat@gmail.com>
> wrote:
>
>> Hi Hieu,
>> Even I tried with '7' and it fails with the error message
>>
>> Exception: moses/ScoreComponentCollection.cpp:248 in void
>> Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*,
>> const std::vector<float>&) threw util::Exception'.
>> Feature function PT0 specified 7 dense scores or weights. Actually has 4
>>
>> In contrast, when I am using binarised pharse table, I use num-features=4
>> and this works fine. I am attaching the Moses.ini file in case I am doing
>> anything wrong there.
>>
>> Thanks and regards,
>> sandipan
>>
>>
>> On 7 September 2014 15:46, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:
>>
>>> maybe's it's 7 scores
>>>
>>>
>>> On 7 September 2014 14:59, Sandipan Dandapat <sandipandandapat@gmail.com
>>> > wrote:
>>>
>>>> Hi Hieu,
>>>> I also tried the same but generates the error below:
>>>>
>>>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void
>>>> Moses::Mmsapt::Load() threw util::Exception because
>>>> `this->m_feature_names.size() != this->m_numScoreComponents'.
>>>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values
>>>> provided by Phrase table (7) does not match number specified in Moses
>>>> config file (4)!
>>>>
>>>> Thanks and regards,
>>>> sandipan
>>>>
>>>>
>>>> On 6 September 2014 09:50, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>>>
>>>>> I'm not sure how many scores there are in the phrase table
>>>>> PhraseDictionaryBitextSampling
>>>>> It may be 4. In which case you must specify
>>>>>
>>>>> [feature]
>>>>> PhraseDictionaryBitextSampling name=PT0 num-features=4 ...
>>>>>
>>>>> [weight]
>>>>> PT0= 0.1 0.2 0.3 0.4
>>>>>
>>>>>
>>>>> On 05/09/14 14:12, Sandipan Dandapat wrote:
>>>>>
>>>>> Hi,
>>>>> During incremental retraining I specified the following line in moses
>>>>> .ini
>>>>> PhraseDictionaryBitextSampling name=PT0 output-factor=0 num-features=9
>>>>> path=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl
>>>>> pfwd=g pbwd=g smooth=0 sample=1000 workers=1
>>>>>
>>>>> this generates the error:
>>>>> Feature function PT0 specified 9 dense scores or weights. Actually has
>>>>> 0.
>>>>>
>>>>> which is solved when num-features is changed to '0'
>>>>> but generates the error below:
>>>>>
>>>>> Exception: moses/TranslationModel/UG/mmsapt.cpp:381 in virtual void
>>>>> Moses::Mmsapt::Load() threw util::Exception because
>>>>> `this->m_feature_names.size() != this->m_numScoreComponents'.
>>>>> At moses/TranslationModel/UG/mmsapt.cpp:381: number of feature values
>>>>> provided by Phrase table (7) does not match number specified in Moses
>>>>> config file (0)!
>>>>> Changing it to 7 also does not help.
>>>>>
>>>>> I have tried with
>>>>> Mmsapt name=PT0 output-factor=0 num-features=0
>>>>> base=/home/sandipan/inc_retrain/MT_sys/EnPl/mtdata_pro/train. L1=en L2=pl
>>>>>
>>>>> but does not work.
>>>>> What I need to do at this stage of retraining using moses?
>>>>>
>>>>> Thanks and regards,
>>>>> sandipan
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>>
>>>
>>>
>>> --
>>> Hieu Hoang
>>> Research Associate
>>> University of Edinburgh
>>> http://www.hoang.co.uk/hieu
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140907/436bd9fb/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 95, Issue 12
*********************************************

Tweet