Moses-support Digest, Vol 87, Issue 20

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. static build of mosesdecoder (Tak Kuya)
2. zlib bug causing Moses training to fail (Barry Haddow)
3. Re: Prereordering was: Re: Google Translate - technology &
paradigms behind it (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Fri, 10 Jan 2014 18:56:33 +0900
From: Tak Kuya <kuyatak@gmail.com>
Subject: [Moses-support] static build of mosesdecoder
To: moses-support@mit.edu
Message-ID:
<CANaijngK2Q2QpaQ4CPP7z5=WZRza48GmpHukgcVpPy2SR6gV-g@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi. How do you build mosesdecoder using static libraries like
http://www.statmt.org/moses/RELEASE-1.0/binaries/ ? To make things
simple, I use the master branch instead of Rel.1.0 and edit
mosesdecoder/Jamroot a little and build the decoder only.

I can build the normal "shared" version of moses without any problems
and usually use it (on CentOS 6.5 with boost 1.41). But I failed to
build moses with --static option. So I installed boost 1.41 to my home
directory. But I still couldn't build moses. It said "cannot find -lz
and -lrt" so I installed zlib-static and glibc-static with yum.

And... It failed again. Here are build.log and Jamroot I used. Could
anyone teach me how to solve the problem? Thank you.

Best regards,
Tak Kuya
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log
Type: application/octet-stream
Size: 2184 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140110/03806883/attachment-0002.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Jamroot
Type: application/octet-stream
Size: 6038 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140110/03806883/attachment-0003.obj

------------------------------

Message: 2
Date: Fri, 10 Jan 2014 14:13:57 +0000
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: [Moses-support] zlib bug causing Moses training to fail
To: moses-support@mit.edu
Message-ID: <52D00025.9090706@staffmail.ed.ac.uk>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

Hi

I've discovered that an apparent bug in zlib (specifically version
1.2.3.4 installed in Ubuntu 12.04) can cause the Moses training pipeline
to fail. Upgrading to the latest zlib (1.2.8) fixes the problem.

The problem appears when the extract files are being read in order to
create the reordering tables or translation tables. For the reordering
table, an error message like this

terminate called after throwing an instance of 'util::GZException'
what(): util/read_compressed.cc:163 in virtual std::size_t
util::{anonymous}::GZip::Read(void*, std::size_t, util::ReadCompressed&)
threw GZException'.
zlib encountered invalid distances set code -3

is printed, whilst for the translation table, the Moses scorer swallows
the zlib error but eventually fails in 'consolidate' like this:

ERROR: source phrase does not match in line 289: 'clean .' !=
'definitely recommend to have'

So far I haven't found any reports of this zlib bug, and it seems to be
quite intermittent.

cheers - Barry


--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

Message: 3
Date: Fri, 10 Jan 2014 15:05:45 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Prereordering was: Re: Google Translate -
technology & paradigms behind it
To: moses-support@mit.edu
Message-ID: <52D00C49.7010709@gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Not that I know of. If you create 1, please check it in.

On 09/01/2014 15:49, Per Tunedal wrote:
> Hi,
> are there any tools to do prereordering with Moses? I suppose it has
> to be done both before training and translation. And that it
> presupposes tagging.
> How much does prereordering improve translation?
> Yours,
> Per Tunedal
> On Wed, Jan 8, 2014, at 22:42, Philipp Koehn wrote:
>> Hi,
>> Google lists its research papers here:
>> http://research.google.com/pubs/MachineTranslation.html
>> --- snip---
>> maybe hierarchical, with pre-reordering.
>> ---snip ---
>> -phi
>>
>>
>> On Wed, Jan 8, 2014 at 8:47 PM, Ivan Dun?er <ivandunder@gmail.com
>> <mailto:ivandunder@gmail.com>> wrote:
>>
>> Hi everybody,
>>
>> is there any reading material (e.g. scientific articles etc.) on what
>> MT approaches Google Translate uses?
>> Sorry for off-topic.
>>
>> Regards,
>> Ivan
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>> _________________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140110/ebf90109/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 87, Issue 20
*********************************************

Tweet