Moses-support Digest, Vol 84, Issue 1

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: build failed while compiling mosesdecoder (Hieu Hoang)
2. Re: compile error with LDHT in randlm (Hoai-Thu Vuong)
3. Re: compile error with LDHT in randlm (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Mon, 30 Sep 2013 17:25:54 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] build failed while compiling mosesdecoder
To: Kunal Sachdeva <kunal.sachdeva.90@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <5249A612.8050801@gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

Please subscribe to the mailing list before you send emails to it. You
can subscribe here
http://mailman.mit.edu/mailman/listinfo/moses-support

Are you running a 32-bit Linux? I think there is an issue with the
'Backwards' language model which is causing a unit test to fail on
32-bit system.

If you don't intend to use the Backwards LM, i wouldn't worry


On 30/09/2013 12:07, Kunal Sachdeva wrote:
> Hi,
> We pulled the new git repository from
> https://github.com/moses-smt/mosesdecoder but the build failed. We
> complied it using ./bjam.The build log is attached here.
>
>
> Thanks



------------------------------

Message: 2
Date: Tue, 1 Oct 2013 09:43:46 +0700
From: Hoai-Thu Vuong <thuvh87@gmail.com>
Subject: Re: [Moses-support] compile error with LDHT in randlm
To: Miles Osborne <miles@inf.ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>, Oliver Wilson
<oliver.wilson87@gmail.com>
Message-ID:
<CABBkmgo334DZ4=zG5oqFV_00djpQM6oj8es6w6h0hB-JVWEwzQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

After searching, the problem came because some changes of gcc. I modified
source code and compile successfully. I'm not sure these modifications work
with other version.

In src/LDHT/MurmurHash3.cpp

#define FORCE_INLINE __attribute__((always_inline))
#define FORCE_INLINE __attribute__((always_inline)) inline

In src/LDHT/TransportTCP.cpp and src/LDHT/server_main.cpp add header:
#include <unistd.h>

@HieuHoang: I install boost-thread from repository of Ubuntu and
boost-thread-mt is linked to boost-thread, so that I think two libraries
are the same.



On Wed, Sep 25, 2013 at 10:10 PM, Miles Osborne <miles@inf.ed.ac.uk> wrote:

> have a look at:
>
> SearchNormalBatch.h
>
> in the source
>
> Miles
>
> On 25 September 2013 10:34, Lane Schwartz <dowobeha@gmail.com> wrote:
> > Miles,
> >
> > I heard that rumor as well. If anyone could point me to any
> > documentation that describes how to do this, I would be interested in
> > trying out this functionality.
> >
> > Cheers,
> > Lane
> >
> > On Wed, Sep 25, 2013 at 10:24 AM, Miles Osborne <miles@inf.ed.ac.uk>
> wrote:
> >> If I recall the decoder was modified to allow batching of LM requests.
> >>
> >> Miles
> >>
> >> On 25 September 2013 10:22, Hieu Hoang <hieuhoang@gmail.com> wrote:
> >>> I'm not sure how to compile LDHT but when i compiled randlm from svn,
> i had
> >>> to change 2 minor things to get it to compile on my mac:
> >>> 1. src/RandLM/Makefile.am: boost_thread --> boost_thread-mt
> >>> 2. autogen.sh: libtoolize --> glibtoolize
> >>>
> >>> Also, the distributed LM was supported in Moses v1. However, it has
> been
> >>> deleted from the current Moses in the git repository. I will try and
> re-add
> >>> it if a multi-pass, asynchronous decoding framework can be created. If
> >>> you're interested in doing this, I would be very glad to help you
> >>>
> >>> On 24/09/2013 11:51, Hoai-Thu Vuong wrote:
> >>>
> >>>
> >>> Hello
> >>>
> >>> I build LDHT in randlm and have got some errors, look like
> >>>
> >>> MurmurHash3.cpp:81:23: warning: always_inline function might not be
> >>> inlinable [-Wattributes]
> >>> MurmurHash3.cpp:68:23: warning: always_inline function might not be
> >>> inlinable [-Wattributes]
> >>> MurmurHash3.cpp:60:23: warning: always_inline function might not be
> >>> inlinable [-Wattributes]
> >>> MurmurHash3.cpp:55:23: warning: always_inline function might not be
> >>> inlinable [-Wattributes]
> >>> MurmurHash3.cpp: In function 'void MurmurHash3_x86_32(const void*, int,
> >>> uint32_t, void*)':
> >>> MurmurHash3.cpp:55:23: error: inlining failed in call to always_inline
> >>> 'uint32_t getblock(const uint32_t*, int)': function body can be
> overwritten
> >>> at link time
> >>>
> >>>
> >>> I attach full error log here. My compiler is g++ version 4.7, OS is
> Ubuntu
> >>> server 64bit 13.04, I clean install then install require package such
> as
> >>> git, build essential, libtool, autoconf, google sparse hash, boost
> thread.
> >>> With same source code I compile successful with g++ version 4.6, OS is
> >>> ubuntu 64bit 12.04.
> >>>
> >>> I google solution to fix, and one guy recommend me change line (in
> >>> MurmurHash3.cpp):
> >>>
> >>> #define FORCE_INLINE __attribute__((always_inline))
> >>>
> >>> to
> >>>
> >>> #define FORCE_INLINE inline __attribute__((always_inline))
> >>>
> >>> do this, I pass this error, however, I receive another error
> ::close(m_sd)
> >>> not found in deconstructor of ~TransportTCP()
> >>>
> >>>
> >>>
> >>>
> >>> --
> >>> Thu.
> >>>
> >>>
> >>> _______________________________________________
> >>> Moses-support mailing list
> >>> Moses-support@mit.edu
> >>> http://mailman.mit.edu/mailman/listinfo/moses-support
> >>>
> >>>
> >>
> >>
> >>
> >> --
> >> The University of Edinburgh is a charitable body, registered in
> >> Scotland, with registration number SC005336.
> >> _______________________________________________
> >> Moses-support mailing list
> >> Moses-support@mit.edu
> >> http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> >
> >
> > --
> > When a place gets crowded enough to require ID's, social collapse is not
> > far away. It is time to go elsewhere. The best thing about space travel
> > is that it made it possible to go elsewhere.
> > -- R.A. Heinlein, "Time Enough For Love"
>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>



--
Thu.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131001/5691ab66/attachment-0001.htm

------------------------------

Message: 3
Date: Tue, 1 Oct 2013 14:13:51 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] compile error with LDHT in randlm
To: Hoai-Thu Vuong <thuvh87@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>, Oliver Wilson
<oliver.wilson87@gmail.com>, Miles Osborne <miles@inf.ed.ac.uk>
Message-ID:
<CAEKMkbhxLwJ48suHh6dmf=c9KNx9JiGHTdUWXqh-XnEkgyjaAQ@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Thanks, i'll try and update the code in the repository with your changes

remember - use Moses v1, which you can get from here:
http://www.statmt.org/moses/RELEASE-1.0/
or by doing
git clone https://github.com/moses-smt/mosesdecoder.git
cd mosesdecoder
git checkout RELEASE-1.0

the current moses in github doesn't support LDHT



On 1 October 2013 03:43, Hoai-Thu Vuong <thuvh87@gmail.com> wrote:

> After searching, the problem came because some changes of gcc. I modified
> source code and compile successfully. I'm not sure these modifications work
> with other version.
>
> In src/LDHT/MurmurHash3.cpp
>
> #define FORCE_INLINE __attribute__((always_inline))
> #define FORCE_INLINE __attribute__((always_inline)) inline
>
> In src/LDHT/TransportTCP.cpp and src/LDHT/server_main.cpp add header:
> #include <unistd.h>
>
> @HieuHoang: I install boost-thread from repository of Ubuntu and
> boost-thread-mt is linked to boost-thread, so that I think two libraries
> are the same.
>
>
>
> On Wed, Sep 25, 2013 at 10:10 PM, Miles Osborne <miles@inf.ed.ac.uk>wrote:
>
>> have a look at:
>>
>> SearchNormalBatch.h
>>
>> in the source
>>
>> Miles
>>
>> On 25 September 2013 10:34, Lane Schwartz <dowobeha@gmail.com> wrote:
>> > Miles,
>> >
>> > I heard that rumor as well. If anyone could point me to any
>> > documentation that describes how to do this, I would be interested in
>> > trying out this functionality.
>> >
>> > Cheers,
>> > Lane
>> >
>> > On Wed, Sep 25, 2013 at 10:24 AM, Miles Osborne <miles@inf.ed.ac.uk>
>> wrote:
>> >> If I recall the decoder was modified to allow batching of LM requests.
>> >>
>> >> Miles
>> >>
>> >> On 25 September 2013 10:22, Hieu Hoang <hieuhoang@gmail.com> wrote:
>> >>> I'm not sure how to compile LDHT but when i compiled randlm from svn,
>> i had
>> >>> to change 2 minor things to get it to compile on my mac:
>> >>> 1. src/RandLM/Makefile.am: boost_thread --> boost_thread-mt
>> >>> 2. autogen.sh: libtoolize --> glibtoolize
>> >>>
>> >>> Also, the distributed LM was supported in Moses v1. However, it has
>> been
>> >>> deleted from the current Moses in the git repository. I will try and
>> re-add
>> >>> it if a multi-pass, asynchronous decoding framework can be created. If
>> >>> you're interested in doing this, I would be very glad to help you
>> >>>
>> >>> On 24/09/2013 11:51, Hoai-Thu Vuong wrote:
>> >>>
>> >>>
>> >>> Hello
>> >>>
>> >>> I build LDHT in randlm and have got some errors, look like
>> >>>
>> >>> MurmurHash3.cpp:81:23: warning: always_inline function might not be
>> >>> inlinable [-Wattributes]
>> >>> MurmurHash3.cpp:68:23: warning: always_inline function might not be
>> >>> inlinable [-Wattributes]
>> >>> MurmurHash3.cpp:60:23: warning: always_inline function might not be
>> >>> inlinable [-Wattributes]
>> >>> MurmurHash3.cpp:55:23: warning: always_inline function might not be
>> >>> inlinable [-Wattributes]
>> >>> MurmurHash3.cpp: In function 'void MurmurHash3_x86_32(const void*,
>> int,
>> >>> uint32_t, void*)':
>> >>> MurmurHash3.cpp:55:23: error: inlining failed in call to always_inline
>> >>> 'uint32_t getblock(const uint32_t*, int)': function body can be
>> overwritten
>> >>> at link time
>> >>>
>> >>>
>> >>> I attach full error log here. My compiler is g++ version 4.7, OS is
>> Ubuntu
>> >>> server 64bit 13.04, I clean install then install require package such
>> as
>> >>> git, build essential, libtool, autoconf, google sparse hash, boost
>> thread.
>> >>> With same source code I compile successful with g++ version 4.6, OS is
>> >>> ubuntu 64bit 12.04.
>> >>>
>> >>> I google solution to fix, and one guy recommend me change line (in
>> >>> MurmurHash3.cpp):
>> >>>
>> >>> #define FORCE_INLINE __attribute__((always_inline))
>> >>>
>> >>> to
>> >>>
>> >>> #define FORCE_INLINE inline __attribute__((always_inline))
>> >>>
>> >>> do this, I pass this error, however, I receive another error
>> ::close(m_sd)
>> >>> not found in deconstructor of ~TransportTCP()
>> >>>
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> Thu.
>> >>>
>> >>>
>> >>> _______________________________________________
>> >>> Moses-support mailing list
>> >>> Moses-support@mit.edu
>> >>> http://mailman.mit.edu/mailman/listinfo/moses-support
>> >>>
>> >>>
>> >>
>> >>
>> >>
>> >> --
>> >> The University of Edinburgh is a charitable body, registered in
>> >> Scotland, with registration number SC005336.
>> >> _______________________________________________
>> >> Moses-support mailing list
>> >> Moses-support@mit.edu
>> >> http://mailman.mit.edu/mailman/listinfo/moses-support
>> >
>> >
>> >
>> > --
>> > When a place gets crowded enough to require ID's, social collapse is not
>> > far away. It is time to go elsewhere. The best thing about space
>> travel
>> > is that it made it possible to go elsewhere.
>> > -- R.A. Heinlein, "Time Enough For Love"
>>
>>
>>
>> --
>> The University of Edinburgh is a charitable body, registered in
>> Scotland, with registration number SC005336.
>>
>
>
>
> --
> Thu.
>



--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131001/37d586ba/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 84, Issue 1
********************************************

0 Response to "Moses-support Digest, Vol 84, Issue 1"

Post a Comment