Moses-support Digest, Vol 158, Issue 2

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Compact phrase table on-disk format changed (Dingyuan Wang)
2. Re: Compact phrase table on-disk format changed (Hieu Hoang)
3. Re: Compact phrase table on-disk format changed
(Marcin Junczys-Dowmunt)


----------------------------------------------------------------------

Message: 1
Date: Mon, 9 Dec 2019 01:19:30 +0800
From: Dingyuan Wang <abcdoyle888@gmail.com>
Subject: Re: [Moses-support] Compact phrase table on-disk format
changed
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <7da65c59-113e-39ff-7c57-2ef639c0716b@gmail.com>
Content-Type: text/plain; charset=utf-8

The problem is caused by the upgrade of cmph library from 2.0 to 2.0.2.
I don't know which commit of cmph changed its format.

2019/12/8 3:46, Hieu Hoang:
> That's strange, I expected that they would work all versions. Another
> problem might be the encoding
>
> Please let me know what you find
>
> On Sat, Dec 7, 2019, 9:15 AM Dingyuan Wang <abcdoyle888@gmail.com
> <mailto:abcdoyle888@gmail.com>> wrote:
>
> Dear all,
>
> After re-compiling moses binaries, moses can't find all Chinese words
> (|UNK|UNK|UNK) in the compact phrase tables built by the older binary.
> ASCII characters are not affected. If I rebuild the compact table using
> the new binaries, it works with the new binary but not the old one.
>
> The versions are below:
>
> (GCC 8.2.0)
> Moses code version (git tag or commit hash):
> ? ?mmt-mvp-v0.12.1-11198-g3545225c0-dirty
> Libraries used:
> ? ? ? Boost? version 1.62.0
> ? ?Xmlrpc-c? version 1.33.14
> ? ? ? ?CMPH (version unknown)
>
> (GCC 9.2.1)
> Moses code version (git tag or commit hash):
> ? ?mmt-mvp-v0.12.1-11270-g41b31167f-dirty
> Libraries used:
> ? ? ? Boost? version 1.71.0
> ? ?Xmlrpc-c? version 1.33.14
> ? ? ? ?CMPH (version unknown)
>
> I think the difference should be because of the Boost library. I'll get
> the old Boost library for a try.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

Message: 2
Date: Sun, 8 Dec 2019 17:16:57 -0800
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Compact phrase table on-disk format
changed
To: Dingyuan Wang <abcdoyle888@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbjTzFiQou3jxH3UMg=NFzaOi_RgpyPA+EeGeu9WLz9nbw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thanks. I'll bear it in mind for next time

On Sun, Dec 8, 2019, 9:19 AM Dingyuan Wang <abcdoyle888@gmail.com> wrote:

> The problem is caused by the upgrade of cmph library from 2.0 to 2.0.2.
> I don't know which commit of cmph changed its format.
>
> 2019/12/8 3:46, Hieu Hoang:
> > That's strange, I expected that they would work all versions. Another
> > problem might be the encoding
> >
> > Please let me know what you find
> >
> > On Sat, Dec 7, 2019, 9:15 AM Dingyuan Wang <abcdoyle888@gmail.com
> > <mailto:abcdoyle888@gmail.com>> wrote:
> >
> > Dear all,
> >
> > After re-compiling moses binaries, moses can't find all Chinese words
> > (|UNK|UNK|UNK) in the compact phrase tables built by the older
> binary.
> > ASCII characters are not affected. If I rebuild the compact table
> using
> > the new binaries, it works with the new binary but not the old one.
> >
> > The versions are below:
> >
> > (GCC 8.2.0)
> > Moses code version (git tag or commit hash):
> > mmt-mvp-v0.12.1-11198-g3545225c0-dirty
> > Libraries used:
> > Boost version 1.62.0
> > Xmlrpc-c version 1.33.14
> > CMPH (version unknown)
> >
> > (GCC 9.2.1)
> > Moses code version (git tag or commit hash):
> > mmt-mvp-v0.12.1-11270-g41b31167f-dirty
> > Libraries used:
> > Boost version 1.71.0
> > Xmlrpc-c version 1.33.14
> > CMPH (version unknown)
> >
> > I think the difference should be because of the Boost library. I'll
> get
> > the old Boost library for a try.
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20191208/8b72b6a6/attachment-0001.html

------------------------------

Message: 3
Date: Sun, 8 Dec 2019 17:27:31 -0800
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Compact phrase table on-disk format
changed
To: Hieu Hoang <hieuhoang@gmail.com>, Dingyuan Wang
<abcdoyle888@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <20191209012730.A8CC067426@pp.amu.edu.pl>
Content-Type: text/plain; charset="utf-8"

Huh, might be worth telling them about. A patch version change from 2.0.0 to 2.0.2 should not break backwards-compatibility.

From: Hieu Hoang
Sent: Sunday, December 8, 2019 5:24 PM
To: Dingyuan Wang
Cc: moses-support
Subject: Re: [Moses-support] Compact phrase table on-disk format changed

Thanks. I'll bear it in mind for next time

On Sun, Dec 8, 2019, 9:19 AM Dingyuan Wang <abcdoyle888@gmail.com> wrote:
The problem is caused by the upgrade of cmph library from 2.0 to 2.0.2.
I don't know which commit of cmph changed its format.

2019/12/8 3:46, Hieu Hoang:
> That's strange, I expected that they would work all versions. Another
> problem might be the encoding
>
> Please let me know what you find
>
> On Sat, Dec 7, 2019, 9:15 AM Dingyuan Wang <abcdoyle888@gmail.com
> <mailto:abcdoyle888@gmail.com>> wrote:
>
>? ? ?Dear all,
>
>? ? ?After re-compiling moses binaries, moses can't find all Chinese words
>? ? ?(|UNK|UNK|UNK) in the compact phrase tables built by the older binary.
>? ? ?ASCII characters are not affected. If I rebuild the compact table using
>? ? ?the new binaries, it works with the new binary but not the old one.
>
>? ? ?The versions are below:
>
>? ? ?(GCC 8.2.0)
>? ? ?Moses code version (git tag or commit hash):
>? ? ?? ?mmt-mvp-v0.12.1-11198-g3545225c0-dirty
>? ? ?Libraries used:
>? ? ?? ? ? Boost? version 1.62.0
>? ? ?? ?Xmlrpc-c? version 1.33.14
>? ? ?? ? ? ?CMPH (version unknown)
>
>? ? ?(GCC 9.2.1)
>? ? ?Moses code version (git tag or commit hash):
>? ? ?? ?mmt-mvp-v0.12.1-11270-g41b31167f-dirty
>? ? ?Libraries used:
>? ? ?? ? ? Boost? version 1.71.0
>? ? ?? ?Xmlrpc-c? version 1.33.14
>? ? ?? ? ? ?CMPH (version unknown)
>
>? ? ?I think the difference should be because of the Boost library. I'll get
>? ? ?the old Boost library for a try.
>
>? ? ?_______________________________________________
>? ? ?Moses-support mailing list
>? ? ?Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>? ? ?http://mailman.mit.edu/mailman/listinfo/moses-support
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20191208/9cf798ba/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 158, Issue 2
*********************************************

Tweet