Moses-support Digest, Vol 100, Issue 13

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Moses R-3 fails with Exception: vector::_M_range_check
(Marcin Junczys-Dowmunt)
2. Re: equal sign (=) in LM path (Hieu Hoang)
3. Unusual parsing of equal signs in [weight] section (Tom Hoar)


----------------------------------------------------------------------

Message: 1
Date: Wed, 04 Feb 2015 13:04:14 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Moses R-3 fails with Exception:
vector::_M_range_check
To: Tom Hoar <tahoar@precisiontranslationtools.com>
Cc: moses-support@mit.edu
Message-ID: <f325f9800a3f176c7907e29563c851e0@amu.edu.pl>
Content-Type: text/plain; charset="utf-8"



Hi,

urgh, I saw this sometimes, could you comment out the reordering model
(both, feature and weights) and check if you still get that? If not,
uncomment and try to remove the file suffix "minlexr" for the reordering
model. If it still happens, update boost :) (someone had the same
problem and updating boost fixed it miraculously, no idea why though)

W dniu 2015-02-04 12:44, Tom Hoar napisa?(a):

> Hi everyone,
>
> I just build the new R-3. I'm also in the middle of updating our environment. I had a problem preparing for mert-moses.pl. So, I cut back to basics... manual edits to the moses.ini file and command line.
>
> I attached the moses.ini file and its output log. I edited the moses.ini file to use compact phrase and reordering files, and KenLM with lazy option. It fails with "Exception: vector::_M_range_check".
>
> Is something wrong or missing with my edits?
>
> Also, more results addressed separately in another.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support [1]



Links:
------
[1] http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/3c5cf17d/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 4 Feb 2015 12:05:19 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] equal sign (=) in LM path
To: Tom Hoar <tahoar@precisiontranslationtools.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbh1ASDy6X_x8M7xxjueNH002qSwGQ4938RaZDsBar0AXg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

it's fixed in master, but not in the release.

https://github.com/moses-smt/mosesdecoder/commit/ee881734fe2d9176e001b1c92a71a51d61183697
I'm not gonna put it into the release 'cos its too late. And the fix itself
had to be fix!

Hieu Hoang
Research Associate (until March 2015)
** searching for interesting commercial MT position **
University of Edinburgh
http://www.hoang.co.uk/hieu


On 4 February 2015 at 11:57, Tom Hoar <tahoar@precisiontranslationtools.com>
wrote:

> Using R-3 and I got the same equal sign exception as below. I attached
> two moses.ini/moses.log file sets. The first example successfully loads the
> phrase & reordering tables with paths with equal signs. and a KENLM path
> without an equal sign.
>
> The second example fails to load after simply changing the KENLM path to a
> location with an equal sign.
>
> So Hieu, your comment "I think it's fixed" looks true for the
> phrase/reordering references, but not true for the LM references.
>
> Tom
>
>
>
> On 02/04/2015 01:54 PM, Lisa Kim wrote:
>
>
> Thank you.
> It is successful to change the LM name without "=" symbol.
>
> However, decoding still fails with following message.
> Could you check the error message?
>
> --------------------
> Start loading text phrase table. Moses format : [0.038] seconds
> terminate called recursively
> terminate called after throwing an instance of 'util::Exception'
> what(): Aborted (core dumped)
> Exit code: 134
> The decoder died. CONFIG WAS -weight-overwrite 'LM1= 0.125000
> PhrasePenalty0= 0.050000 WordPenalty0= -0.250000 TranslationModel0=
> 0.050000 0.050000 0.050000 0.050000 TranslationModel1= 0.250000 LM0=
> 0.125000'
> 2015. 2. 3. ?? 8:12? "Hieu Hoang" <hieuhoang@gmail.com> ?? ??:
>
>> as ken mentioned, don't use the = sign in the name of your LM file. I
>> think it's fixed in the latest version of moses. Which version do you have,
>> from when ago?
>>
>> moses_chart should handle factors. Again, if you version is from long
>> ago, I suggest your update
>>
>> On 02/02/15 10:06, ekkim214 wrote:
>>
>>
>> I want to use some factor (class) in the hierarchical model.
>> I am using the ems script and using KenLM for surface and factor both.
>> The building of LM is successful with settings "-discount_fallback" but
>> I got an error during tuning phase like this.
>>
>> Exception: moses/LM/Ken.cpp:399 in Moses::LanguageModel*
>> Moses::ConstructKenLM(const string&) threw util::Exception because
>> `args.size() != 2'.
>> Incorrect format of KenLM property:
>> path=/home3/ekkim/working/E2K_1501/hierarchical_class/lm/travel22=mkcls.binlm.5
>> Exit code: 1
>>
>> Does not "moses_chart" decoder which is distributed in the package
>> support factored training?
>>
>>
>> _______________________________________________
>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/74c728a1/attachment-0001.htm

------------------------------

Message: 3
Date: Wed, 04 Feb 2015 19:05:49 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: [Moses-support] Unusual parsing of equal signs in [weight]
section
To: moses-support@mit.edu
Message-ID: <54D20B1D.7050600@precisiontranslationtools.com>
Content-Type: text/plain; charset="utf-8"

The attached moses.ini/log set shows moses fails to load when the equal
sign in the [weight] section is NOT followed by a space.

This succeeds:
[weight]
UnknownWordPenalty0= 1

Whereas these fail, and with different errors (other related examples
attached:

[weight]
UnknownWordPenalty0=1
(run0.moses.3.ini.log)

[weight]
UnknownWordPenalty0 = 1
(run0.moses.3a.ini.log)

-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.3.ini.log
Type: text/x-log
Size: 1163 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/17073e28/attachment.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.3.ini
Type: application/x-wine-extension-ini
Size: 1069 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/17073e28/attachment-0001.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.3a.ini.log
Type: text/x-log
Size: 2750 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/17073e28/attachment-0002.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.3c.ini.log
Type: text/x-log
Size: 1163 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/17073e28/attachment-0003.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.3b.ini.log
Type: text/x-log
Size: 1378 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/17073e28/attachment-0004.bin

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 100, Issue 13
**********************************************

Tweet