Moses-support Digest, Vol 100, Issue 12

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Moses v 3.0 (Hieu Hoang)
2. Moses R-3 fails with Exception: vector::_M_range_check (Tom Hoar)
3. equal sign (=) in LM path (Tom Hoar)


----------------------------------------------------------------------

Message: 1
Date: Wed, 4 Feb 2015 11:34:56 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Moses v 3.0
To: Tom Hoar <tahoar@precisiontranslationtools.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbjZeyqCnYTGiwvtG28u8DCSKJg8feRcnKMX9ozDTSd9Pw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

cheers. fixed

Hieu Hoang
Research Associate (until March 2015)
** searching for interesting commercial MT position **
University of Edinburgh
http://www.hoang.co.uk/hieu


On 4 February 2015 at 11:18, Tom Hoar <tahoar@precisiontranslationtools.com>
wrote:

> Congratulations team.
>
> Please note that the hyperlinks in the Mosesv3.0releasenotes.pdf file
> point to invalid URL's for RELEASE-1.
>
>
>
> On 02/03/2015 10:30 PM, Hieu Hoang wrote:
>
> Hi Everyone
>
> We are proud to release the next version of Moses. It's been another busy
> year with lots of contributions from far and wide. Thanks for everyone who
> contributed code and time, or even just answered a few questions or
> suggestions.
>
> This is a list of the main development over the past year:
>
> 1.
>
> Faster decoder when using sparse features by Matthias Huck.
> 2.
>
> Faster, more memory efficient synchronous context-free grammar (SCFG)
> decoding (Sennrich, 2014) by Rico Sennrich.
> 3.
>
> Merging moses and moses_chart by Hieu Hoang.
> 4.
>
> Synchronous Forest and Tree Substitution Grammar (STSG) models by Phil
> Williams.
> 5.
>
> Smaller phrase-table by pruning according translation model scores
> only by Philipp Koehn.
> 6.
>
> Simulated post editing tools by Ulrich Germann.
> 7.
>
> Hypergraph batch-mira by Barry Haddow.
> 8.
>
> Dynamic Suffix-Array phrase-table by Ulrich Germann.
> 9.
>
> OxLM, a log-bilinear language model, by (Baltescu et al, 2014).
> 10.
>
> Bilingual language model (Devlin et al, 2014) by Nikolay Bogoychev,
> Paul Baltescu, Rico Sennrich, and others.
> 11.
>
> VW Classifier-based feature function by Ales Tamchyna and Marcin
> Junczys-Dowmunt.
> 12.
>
> Cache-based Translation Model and Language Model by Nicola Bertoldi
> (Bertoldi, 2014).
> 13. Daily speed testing framework by Nikolay Bogoychev.
>
>
>
> As in previous versions, this release was forked about a month ago, tested
> to make sure it compiles on a number of platforms, and run end-to-end on
> Linux (Ubuntu 12.04 64-bit). We then distribute
> 1. source code for Moses, IRSTLM, MGIZA
> 2. binaries for Moses, IRSTLM, MGIZA, for the following platform: Linux
> (32 and 64-bit), OSX Yosemite, Windows/Cygwin (32 and 64-bit)
> 3. ready-made tuned models from the end-to-end tests
> 4. Linux-based virtual machines for VirtualBox
>
> More details in the release notes
> http://www.statmt.org/moses/RELEASE-3.0/Mosesv3.0releasenotes.pdf
>
> As ever, if you have any queries or problems, email the mailing list.
> Thank you all for using Moses
>
> --
> Hieu Hoang
> Research Associate (until March 2015)
> ** searching for interesting commercial MT position **
> University of Edinburghhttp://www.hoang.co.uk/hieu
>
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/df8e1003/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 04 Feb 2015 18:44:36 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: [Moses-support] Moses R-3 fails with Exception:
vector::_M_range_check
To: moses-support@mit.edu
Message-ID: <54D20624.2060203@precisiontranslationtools.com>
Content-Type: text/plain; charset="utf-8"

Hi everyone,

I just build the new R-3. I'm also in the middle of updating our
environment. I had a problem preparing for mert-moses.pl. So, I cut back
to basics... manual edits to the moses.ini file and command line.

I attached the moses.ini file and its output log. I edited the moses.ini
file to use compact phrase and reordering files, and KenLM with lazy
option. It fails with "Exception: vector::_M_range_check".

Is something wrong or missing with my edits?

Also, more results addressed separately in another.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.ini.log
Type: text/x-log
Size: 1949 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/eb85882c/attachment-0002.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.ini
Type: application/x-wine-extension-ini
Size: 979 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/eb85882c/attachment-0003.bin

------------------------------

Message: 3
Date: Wed, 04 Feb 2015 18:57:03 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: [Moses-support] equal sign (=) in LM path
To: moses-support@mit.edu
Message-ID: <54D2090F.4000302@precisiontranslationtools.com>
Content-Type: text/plain; charset="utf-8"

Using R-3 and I got the same equal sign exception as below. I attached
two moses.ini/moses.log file sets. The first example successfully loads
the phrase & reordering tables with paths with equal signs. and a KENLM
path without an equal sign.

The second example fails to load after simply changing the KENLM path to
a location with an equal sign.

So Hieu, your comment "I think it's fixed" looks true for the
phrase/reordering references, but not true for the LM references.

Tom



On 02/04/2015 01:54 PM, Lisa Kim wrote:
>
>
> Thank you.
> It is successful to change the LM name without "=" symbol.
>
> However, decoding still fails with following message.
> Could you check the error message?
>
> --------------------
> Start loading text phrase table. Moses format : [0.038] seconds
> terminate called recursively
> terminate called after throwing an instance of 'util::Exception'
> what(): Aborted (core dumped)
> Exit code: 134
> The decoder died. CONFIG WAS -weight-overwrite 'LM1= 0.125000
> PhrasePenalty0= 0.050000 WordPenalty0= -0.250000 TranslationModel0=
> 0.050000 0.050000 0.050000 0.050000 TranslationModel1= 0.250000 LM0=
> 0.125000'
>
> 2015. 2. 3. ?? 8:12? "Hieu Hoang" <hieuhoang@gmail.com
> <mailto:hieuhoang@gmail.com>> ?? ??:
>
> as ken mentioned, don't use the = sign in the name of your LM
> file. I think it's fixed in the latest version of moses. Which
> version do you have, from when ago?
>
> moses_chart should handle factors. Again, if you version is from
> long ago, I suggest your update
>
> On 02/02/15 10:06, ekkim214 wrote:
>>
>> I want to use some factor (class) in the hierarchical model.
>> I am using the ems script and using KenLM for surface and factor
>> both.
>> The building of LM is successful with settings
>> "-discount_fallback" but
>> I got an error during tuning phase like this.
>>
>> Exception: moses/LM/Ken.cpp:399 in Moses::LanguageModel*
>> Moses::ConstructKenLM(const string&) threw util::Exception
>> because `args.size() != 2'.
>> Incorrect format of KenLM property:
>> path=/home3/ekkim/working/E2K_1501/hierarchical_class/lm/travel22=mkcls.binlm.5
>> Exit code: 1
>>
>> Does not "moses_chart" decoder which is distributed in the
>> package support factored training?
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/995014f8/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.2.ini.log
Type: text/x-log
Size: 2473 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/995014f8/attachment.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.2.ini
Type: application/x-wine-extension-ini
Size: 1150 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/995014f8/attachment-0001.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.1.ini.log
Type: text/x-log
Size: 2676 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/995014f8/attachment-0002.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: run0.moses.1.ini
Type: application/x-wine-extension-ini
Size: 1069 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150204/995014f8/attachment-0003.bin

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 100, Issue 12
**********************************************

Tweet