Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Using factor in the hierarchical model (Hieu Hoang)
2. Re: Unusual parsing of equal signs in [weight] section
(Hieu Hoang)
3. Re: Moses R-3 fails with Exception: vector::_M_range_check
(Tom Hoar)
4. Re: Moses R-3 fails with Exception: vector::_M_range_check
(Marcin Junczys-Dowmunt)
----------------------------------------------------------------------
Message: 1
Date: Wed, 4 Feb 2015 12:07:22 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Using factor in the hierarchical model
To: Lisa Kim <ekkim214@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbgkNzqo57TnuiwMu18-Atd6B6djFXCNhvsGV2F+F1_CGw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
try using the latest version of moses from github.
If it still fails, please make your model files available for download so I
can replicate the problem
Hieu Hoang
Research Associate (until March 2015)
** searching for interesting commercial MT position **
University of Edinburgh
http://www.hoang.co.uk/hieu
On 4 February 2015 at 06:54, Lisa Kim <ekkim214@gmail.com> wrote:
>
> Thank you.
> It is successful to change the LM name without "=" symbol.
>
> However, decoding still fails with following message.
> Could you check the error message?
>
> --------------------
> Start loading text phrase table. Moses format : [0.038] seconds
> terminate called recursively
> terminate called after throwing an instance of 'util::Exception'
> what(): Aborted (core dumped)
> Exit code: 134
> The decoder died. CONFIG WAS -weight-overwrite 'LM1= 0.125000
> PhrasePenalty0= 0.050000 WordPenalty0= -0.250000 TranslationModel0=
> 0.050000 0.050000 0.050000 0.050000 TranslationModel1= 0.250000 LM0=
> 0.125000'
> 2015. 2. 3. ?? 8:12? "Hieu Hoang" <hieuhoang@gmail.com>?? ??:
>
> as ken mentioned, don't use the = sign in the name of your LM file. I
>> think it's fixed in the latest version of moses. Which version do you have,
>> from when ago?
>>
>> moses_chart should handle factors. Again, if you version is from long
>> ago, I suggest your update
>>
>> On 02/02/15 10:06, ekkim214 wrote:
>>
>>
>> I want to use some factor (class) in the hierarchical model.
>> I am using the ems script and using KenLM for surface and factor both.
>> The building of LM is successful with settings "-discount_fallback" but
>> I got an error during tuning phase like this.
>>
>> Exception: moses/LM/Ken.cpp:399 in Moses::LanguageModel*
>> Moses::ConstructKenLM(const string&) threw util::Exception because
>> `args.size() != 2'.
>> Incorrect format of KenLM property:
>> path=/home3/ekkim/working/E2K_1501/hierarchical_class/lm/travel22=mkcls.binlm.5
>> Exit code: 1
>>
>> Does not "moses_chart" decoder which is distributed in the package
>> support factored training?
>>
>>
>> _______________________________________________
>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/ff360b94/attachment-0001.htm
------------------------------
Message: 2
Date: Wed, 4 Feb 2015 12:07:51 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Unusual parsing of equal signs in
[weight] section
To: Tom Hoar <tahoar@precisiontranslationtools.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbhg49+X13fz+PX5iBe4-8ZzvQJrEGM9tpZeZwEkEcCRGA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
yes, that's intentional
Hieu Hoang
Research Associate (until March 2015)
** searching for interesting commercial MT position **
University of Edinburgh
http://www.hoang.co.uk/hieu
On 4 February 2015 at 12:05, Tom Hoar <tahoar@precisiontranslationtools.com>
wrote:
> The attached moses.ini/log set shows moses fails to load when the equal
> sign in the [weight] section is NOT followed by a space.
>
> This succeeds:
> [weight]
> UnknownWordPenalty0= 1
>
> Whereas these fail, and with different errors (other related examples
> attached:
>
> [weight]
> UnknownWordPenalty0=1
> (run0.moses.3.ini.log)
>
> [weight]
> UnknownWordPenalty0 = 1
> (run0.moses.3a.ini.log)
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/6ad93a6c/attachment-0001.htm
------------------------------
Message: 3
Date: Wed, 04 Feb 2015 20:18:00 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] Moses R-3 fails with Exception:
vector::_M_range_check
To: moses-support@mit.edu
Message-ID: <54D21C08.8070508@precisiontranslationtools.com>
Content-Type: text/plain; charset="utf-8"
Hi, Marcin,
1) comment out the reordering model (both, feature and weights): works.
Exception disappears.
2) Remove file extension ".minlexr" from path= reference: works. file
loads and model works
Additional test:
3) Remove file extension ".minphr" from compact phrase table's path=
reference: works.
Is it possible this exception has to do with the filename buffer vice
algorithm?
FYI, I'm using the build-in boost library from Ubuntu 14.04 libboost 1.54
apt-get install libboost-all-dev
On 02/04/2015 07:04 PM, Marcin Junczys-Dowmunt wrote:
>
> Hi,
>
> urgh, I saw this sometimes, could you comment out the reordering model
> (both, feature and weights) and check if you still get that? If not,
> uncomment and try to remove the file suffix "minlexr" for the
> reordering model. If it still happens, update boost :) (someone had
> the same problem and updating boost fixed it miraculously, no idea why
> though)
>
> W dniu 2015-02-04 12:44, Tom Hoar napisa?(a):
>
>> Hi everyone,
>>
>> I just build the new R-3. I'm also in the middle of updating our environment. I had a problem preparing for mert-moses.pl. So, I cut back to basics... manual edits to the moses.ini file and command line.
>>
>> I attached the moses.ini file and its output log. I edited the moses.ini file to use compact phrase and reordering files, and KenLM with lazy option. It fails with "Exception: vector::_M_range_check".
>>
>> Is something wrong or missing with my edits?
>>
>> Also, more results addressed separately in another.
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/5c39a6a2/attachment-0001.htm
------------------------------
Message: 4
Date: Wed, 04 Feb 2015 14:29:57 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Moses R-3 fails with Exception:
vector::_M_range_check
To: Tom Hoar <tahoar@precisiontranslationtools.com>
Cc: moses-support@mit.edu
Message-ID: <6653955b5c1f31ac996e3322e559ba5c@amu.edu.pl>
Content-Type: text/plain; charset="utf-8"
The problem is that Reordering models have a base class that manages and
delegates loading. If I remember correctly there is some kind of
preference hard coded, if something exists that has the minlexr suffix,
take if before *.binphr and *.gz. Some time ago the compact phrase table
would not work with the suffix, so this was at least consistent. That
changed in the meantime and now we have this current mess.
What would be the best solution?
A) fix suffix handling,
B) define a ReorderingCompact feature
C) both
W dniu 2015-02-04 14:18, Tom Hoar napisa?(a):
> Hi, Marcin,
>
> 1) comment out the reordering model (both, feature and weights): works. Exception disappears.
> 2) Remove file extension ".minlexr" from path= reference: works. file loads and model works
>
> Additional test:
> 3) Remove file extension ".minphr" from compact phrase table's path= reference: works.
>
> Is it possible this exception has to do with the filename buffer vice algorithm?
>
> FYI, I'm using the build-in boost library from Ubuntu 14.04 libboost 1.54
> apt-get install libboost-all-dev
>
> On 02/04/2015 07:04 PM, Marcin Junczys-Dowmunt wrote:
>
> Hi,
>
> urgh, I saw this sometimes, could you comment out the reordering model (both, feature and weights) and check if you still get that? If not, uncomment and try to remove the file suffix "minlexr" for the reordering model. If it still happens, update boost :) (someone had the same problem and updating boost fixed it miraculously, no idea why though)
>
> W dniu 2015-02-04 12:44, Tom Hoar napisa?(a):
>
> Hi everyone,
>
> I just build the new R-3. I'm also in the middle of updating our environment. I had a problem preparing for mert-moses.pl. So, I cut back to basics... manual edits to the moses.ini file and command line.
>
> I attached the moses.ini file and its output log. I edited the moses.ini file to use compact phrase and reordering files, and KenLM with lazy option. It fails with "Exception: vector::_M_range_check".
>
> Is something wrong or missing with my edits?
>
> Also, more results addressed separately in another.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support [1]
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support [1]
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support [1]
Links:
------
[1] http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/b5cafad3/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 100, Issue 14
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 100, Issue 14"
Post a Comment