Home » Uncategories » Moses-support Digest, Vol 95, Issue 22

Moses-support Digest, Vol 95, Issue 22

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. On-Disk phrase table underpeforms as compared to filtered
phrase table (Eleftherios Avramidis)
2. Re: On-Disk phrase table underpeforms as compared to filtered
phrase table (Hieu Hoang)
3. linking problem trying to build on Ubuntu 12.04 (Walter Mebane)
4. Re: linking problem trying to build on Ubuntu 12.04 (Hieu Hoang)
5. Re: linking problem trying to build on Ubuntu 12.04
(Walter Mebane)


----------------------------------------------------------------------

Message: 1
Date: Mon, 15 Sep 2014 20:57:52 +0200
From: Eleftherios Avramidis <eleftherios.avramidis@dfki.de>
Subject: [Moses-support] On-Disk phrase table underpeforms as compared
to filtered phrase table
To: Moses-support <moses-support@mit.edu>
Message-ID: <541736B0.2020501@dfki.de>
Content-Type: text/plain; charset=utf-8; format=flowed

Hi,

I have trained a simple phrase-based system.
First, I filtered the phrase table based on my test-set, and then I
decoded the test-set (as typically EMS does).
Secondly, I converted the original full phrase table to an On-Disk
phrase table, and then sent the same sentences for decoding.
My problem is that the sentences decoded with the on-disk full phrase
table get different decoding than the ones from the filtered phrase table.

I have checked that the moses ini weights, the language model, the
re-ordering table, and the pre-processing scripts are the same.

Does anybody know why this is happening?

cheers
Lefteris


--
MSc. Inf. Eleftherios Avramidis
DFKI GmbH, Alt-Moabit 91c, 10559 Berlin
Tel. +49-30 238 95-1806

Fax. +49-30 238 95-1810

-------------------------------------------------------------------------------------------
Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH
Firmensitz: Trippstadter Strasse 122, D-67663 Kaiserslautern

Geschaeftsfuehrung:
Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
Dr. Walter Olthoff

Vorsitzender des Aufsichtsrats:
Prof. Dr. h.c. Hans A. Aukes

Amtsgericht Kaiserslautern, HRB 2313
-------------------------------------------------------------------------------------------



------------------------------

Message: 2
Date: Mon, 15 Sep 2014 21:14:26 +0200
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] On-Disk phrase table underpeforms as
compared to filtered phrase table
To: Eleftherios Avramidis <eleftherios.avramidis@dfki.de>,
Moses-support <moses-support@mit.edu>
Message-ID: <54173A92.1070502@gmail.com>
Content-Type: text/plain; charset=windows-1252; format=flowed

is the filtered phrase table also binarized with on-disk, or is it text,
or was it binarized with as PhraseDictionaryBinary?

On 15/09/14 20:57, Eleftherios Avramidis wrote:
> Hi,
>
> I have trained a simple phrase-based system.
> First, I filtered the phrase table based on my test-set, and then I
> decoded the test-set (as typically EMS does).
> Secondly, I converted the original full phrase table to an On-Disk
> phrase table, and then sent the same sentences for decoding.
> My problem is that the sentences decoded with the on-disk full phrase
> table get different decoding than the ones from the filtered phrase table.
>
> I have checked that the moses ini weights, the language model, the
> re-ordering table, and the pre-processing scripts are the same.
>
> Does anybody know why this is happening?
>
> cheers
> Lefteris
>
>



------------------------------

Message: 3
Date: Mon, 15 Sep 2014 19:34:24 -0400
From: Walter Mebane <wmebane@umich.edu>
Subject: [Moses-support] linking problem trying to build on Ubuntu
12.04
To: moses-support@mit.edu
Message-ID:
<CAMFh1uqgp-SimVNG6MzpwM3GqGZabM7ybu+DdwF2r3kqEzT=nQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Problems trace to messages (in build.log) like

undefined reference to `boost::thread::join_noexcept()'

I get the same problem when using either boost_1_55_0 or boost_1_56_0. To
install boost-1-55-0 I used

bootstrap.sh --with-icu --with-python=/usr/bin/python
./b2 -a --layout=tagged link=static threading=multi,single install
--with-thread --with-filesystem

It also failed in the same way when I omitted the two --with options.

The Moses build attempt command was

./bjam -a --with-boost=~/src/boost_1_55_0 -j4

It also failed in the same way when I used the boost version installed
via libboost-all-dev and used

./bjam -a -j4

I saw some similiar complaints in the Mail Archive. The attempt using
boost-1_55_0 follows what's on
http://www.statmt.org/moses/?n=Development.GetStarted

Walter
--
Walter R. Mebane, Jr. email: wmebane@umich.edu
Professor cell: 607/592-0546
Departments of Political Science and of Statistics
University of Michigan WWW: http://www.umich.edu/~wmebane

7735 Haven Hall
505 S. State St.
Ann Arbor, MI 48109-1045
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140915/f91d84f1/attachment-0001.htm

------------------------------

Message: 4
Date: Tue, 16 Sep 2014 01:48:45 +0200
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] linking problem trying to build on Ubuntu
12.04
To: Walter Mebane <wmebane@umich.edu>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbi=yjCGR+c_JPeE2mzzLZhe=uXyp0bgo7NS_xaimWRG9g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

did you do
bootstrap.sh
or
./bootstrap.sh
?
If you copy and paste the boost compiling instructions here
http://www.statmt.org/moses/?n=Development.GetStarted
it should work out of the box. No need for extra flags

On 16 September 2014 01:34, Walter Mebane <wmebane@umich.edu> wrote:

> Problems trace to messages (in build.log) like
>
> undefined reference to `boost::thread::join_noexcept()'
>
> I get the same problem when using either boost_1_55_0 or boost_1_56_0. To
> install boost-1-55-0 I used
>
> bootstrap.sh --with-icu --with-python=/usr/bin/python
> ./b2 -a --layout=tagged link=static threading=multi,single install
> --with-thread --with-filesystem
>
> It also failed in the same way when I omitted the two --with options.
>
> The Moses build attempt command was
>
> ./bjam -a --with-boost=~/src/boost_1_55_0 -j4
>
> It also failed in the same way when I used the boost version installed
> via libboost-all-dev and used
>
> ./bjam -a -j4
>
> I saw some similiar complaints in the Mail Archive. The attempt using
> boost-1_55_0 follows what's on
> http://www.statmt.org/moses/?n=Development.GetStarted
>
> Walter
> --
> Walter R. Mebane, Jr. email: wmebane@umich.edu
> Professor cell: 607/592-0546
> Departments of Political Science and of Statistics
> University of Michigan WWW: http://www.umich.edu/~wmebane
>
> 7735 Haven Hall
> 505 S. State St.
> Ann Arbor, MI 48109-1045
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140916/123ead24/attachment-0001.htm

------------------------------

Message: 5
Date: Mon, 15 Sep 2014 20:38:38 -0400
From: Walter Mebane <wmebane@umich.edu>
Subject: Re: [Moses-support] linking problem trying to build on Ubuntu
12.04
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAMFh1upKcV0YSA64k_-y-=kPvBFEvGaA29bdLsiZFhoTPFNNLg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Same failure when following GetStarted by building Boost via

./bootstrap.sh
sudo ./b2 --clean
sudo ./b2 -a --layout=tagged link=static threading=multi,single install
--with-thread --with-filesystem

and then trying to build Moses via

./bjam --with-boost=~/src/boost_1_55_0 -j4 -a

build.log.z attached.

Walter

On Mon, Sep 15, 2014 at 7:48 PM, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:

> did you do
> bootstrap.sh
> or
> ./bootstrap.sh
> ?
> If you copy and paste the boost compiling instructions here
> http://www.statmt.org/moses/?n=Development.GetStarted
> it should work out of the box. No need for extra flags
>
> On 16 September 2014 01:34, Walter Mebane <wmebane@umich.edu> wrote:
>
>> Problems trace to messages (in build.log) like
>>
>> undefined reference to `boost::thread::join_noexcept()'
>>
>> I get the same problem when using either boost_1_55_0 or boost_1_56_0.
>> To install boost-1-55-0 I used
>>
>> bootstrap.sh --with-icu --with-python=/usr/bin/python
>> ./b2 -a --layout=tagged link=static threading=multi,single install
>> --with-thread --with-filesystem
>>
>> It also failed in the same way when I omitted the two --with options.
>>
>> The Moses build attempt command was
>>
>> ./bjam -a --with-boost=~/src/boost_1_55_0 -j4
>>
>> It also failed in the same way when I used the boost version installed
>> via libboost-all-dev and used
>>
>> ./bjam -a -j4
>>
>> I saw some similiar complaints in the Mail Archive. The attempt using
>> boost-1_55_0 follows what's on
>> http://www.statmt.org/moses/?n=Development.GetStarted
>>
>> Walter
>> --
>> Walter R. Mebane, Jr. email: wmebane@umich.edu
>> Professor cell: 607/592-0546
>> Departments of Political Science and of Statistics
>> University of Michigan WWW: http://www.umich.edu/~wmebane
>>
>> 7735 Haven Hall
>> 505 S. State St.
>> Ann Arbor, MI 48109-1045
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>


--
Walter R. Mebane, Jr. email: wmebane@umich.edu
Professor cell: 607/592-0546
Departments of Political Science and of Statistics
University of Michigan WWW: http://www.umich.edu/~wmebane

7735 Haven Hall
505 S. State St.
Ann Arbor, MI 48109-1045
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140915/4fba8e49/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.gz
Type: application/x-gzip
Size: 39223 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140915/4fba8e49/attachment.bin

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 95, Issue 22
*********************************************

0 Response to "Moses-support Digest, Vol 95, Issue 22"

Post a Comment

Subscribe to: Post Comments (Atom)