Moses-support Digest, Vol 158, Issue 1

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Compact phrase table on-disk format changed (Dingyuan Wang)
2. Re: Compact phrase table on-disk format changed (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Sun, 8 Dec 2019 01:09:18 +0800
From: Dingyuan Wang <abcdoyle888@gmail.com>
Subject: [Moses-support] Compact phrase table on-disk format changed
To: moses-support@mit.edu
Message-ID: <49b9c4d0-0407-41ee-d7f0-a14bcf6e6e0c@gmail.com>
Content-Type: text/plain; charset=utf-8

Dear all,

After re-compiling moses binaries, moses can't find all Chinese words
(|UNK|UNK|UNK) in the compact phrase tables built by the older binary.
ASCII characters are not affected. If I rebuild the compact table using
the new binaries, it works with the new binary but not the old one.

The versions are below:

(GCC 8.2.0)
Moses code version (git tag or commit hash):
mmt-mvp-v0.12.1-11198-g3545225c0-dirty
Libraries used:
Boost version 1.62.0
Xmlrpc-c version 1.33.14
CMPH (version unknown)

(GCC 9.2.1)
Moses code version (git tag or commit hash):
mmt-mvp-v0.12.1-11270-g41b31167f-dirty
Libraries used:
Boost version 1.71.0
Xmlrpc-c version 1.33.14
CMPH (version unknown)

I think the difference should be because of the Boost library. I'll get
the old Boost library for a try.



------------------------------

Message: 2
Date: Sat, 7 Dec 2019 11:46:42 -0800
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Compact phrase table on-disk format
changed
To: Dingyuan Wang <abcdoyle888@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbhZmSTseSUm1DJ+cHdLAJ2-QjCdWoNqRy_Tn40XhjE0WQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

That's strange, I expected that they would work all versions. Another
problem might be the encoding

Please let me know what you find

On Sat, Dec 7, 2019, 9:15 AM Dingyuan Wang <abcdoyle888@gmail.com> wrote:

> Dear all,
>
> After re-compiling moses binaries, moses can't find all Chinese words
> (|UNK|UNK|UNK) in the compact phrase tables built by the older binary.
> ASCII characters are not affected. If I rebuild the compact table using
> the new binaries, it works with the new binary but not the old one.
>
> The versions are below:
>
> (GCC 8.2.0)
> Moses code version (git tag or commit hash):
> mmt-mvp-v0.12.1-11198-g3545225c0-dirty
> Libraries used:
> Boost version 1.62.0
> Xmlrpc-c version 1.33.14
> CMPH (version unknown)
>
> (GCC 9.2.1)
> Moses code version (git tag or commit hash):
> mmt-mvp-v0.12.1-11270-g41b31167f-dirty
> Libraries used:
> Boost version 1.71.0
> Xmlrpc-c version 1.33.14
> CMPH (version unknown)
>
> I think the difference should be because of the Boost library. I'll get
> the old Boost library for a try.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20191207/5dba0f15/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 158, Issue 1
*********************************************

Tweet