Home » Uncategories » Moses-support Digest, Vol 101, Issue 22

Moses-support Digest, Vol 101, Issue 22

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: compilation problems with the last version of moses
(Barry Haddow)
2. Re: compilation problems with the last version of moses (Tom Hoar)
3. Questions about kbmira code in Moses (Liangyou Li)
4. Linking Eigen library (Prashant Mathur)


----------------------------------------------------------------------

Message: 1
Date: Fri, 06 Mar 2015 13:59:54 +0000
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] compilation problems with the last
version of moses
To: Tom Hoar <tahoar@precisiontranslationtools.com>,
moses-support@mit.edu
Message-ID: <54F9B2DA.5060302@staffmail.ed.ac.uk>
Content-Type: text/plain; charset=windows-1252; format=flowed

Hi

The nightly Moses build
http://www.statmt.org/moses/cruise/
runs on Ubuntu 12.04 and is not reporting any problems at the moment.

The installed version of boost is 1.46.1

cheers - Barry

On 06/03/15 13:49, Tom Hoar wrote:
> Also, your Ubuntu 12.04 is quite old. Could it's old libboost libraries
> might be conflicting with your custom build? If possible, try updating
> your host to 14.04.
>
>
>
> On 03/06/2015 08:40 PM, Kenneth Heafield wrote:
>> Hi,
>>
>> Those are unit test failures. And that's worrying.
>>
>> moses/ScoreComponentCollectionTest.cpp(135): error in "sparse_feature":
>> check scc.GetScoreForProducer(&sparse,"first") == 1.3f failed [0 !=
>> 1.29999995]
>> moses/ScoreComponentCollectionTest.cpp(136): error in "sparse_feature":
>> check scc.GetScoreForProducer(&sparse,"second") == 2.1f failed [0 !=
>> 2.0999999]
>> moses/ScoreComponentCollectionTest.cpp(139): error in "sparse_feature":
>> check scc.GetScoreForProducer(&sparse,"first") == -1.9f failed [0 !=
>> -1.89999998]
>> moses/ScoreComponentCollectionTest.cpp(141): error in "sparse_feature":
>> check scc.GetScoreForProducer(&sparse,"first") == -3.8f failed [0 !=
>> -3.79999995]
>>
>> Does a fresh build with -a solve anything? This is a 64-bit x86
>> machine, right? Since you're on Ubuntu, why not try the
>> distribution-provided Boost
>>
>> sudo apt-get install build-essential libboost-all-dev zlib1g-dev
>> libbz2-dev liblzma-dev
>>
>> Kenneth
>>
>> On 03/06/2015 03:55 AM, Arezki Sadoune wrote:
>>> Hello All
>>>
>>> I have some problems compiling the last moses on Ubuntu 12.04.5.
>>>
>>> -When compiling moses alone: ./bjam the issues encountered are :
>>>
>>> ...failed testing.unit-test
>>> moses/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/moses_test.passed...
>>> testing.unit-test
>>> mert/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/bleu_scorer_test.passed
>>>
>>> ...failed testing.unit-test
>>> mert/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/vocabulary_test.passed...
>>>
>>>
>>> -when I try to compile with boost_1_55_0 et CMPH-2.0
>>> ./bjam --with-cmph=/root/tools/cmph-2.0/ --with-boost=/root/tools/boost_1_55_0
>>> the errors preventing moses compiling are in the log file attached
>>>
>>> Cheers
>>>
>>>
>>> Arezki SADOUNE
>>>
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

Message: 2
Date: Fri, 06 Mar 2015 21:01:51 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] compilation problems with the last
version of moses
To: moses-support@mit.edu
Message-ID: <54F9B34F.6020905@precisiontranslationtools.com>
Content-Type: text/plain; charset=windows-1252; format=flowed

Hmm.... Never mind :)

On 03/06/2015 08:59 PM, Barry Haddow wrote:
> Hi
>
> The nightly Moses build
> http://www.statmt.org/moses/cruise/
> runs on Ubuntu 12.04 and is not reporting any problems at the moment.
>
> The installed version of boost is 1.46.1
>
> cheers - Barry
>
> On 06/03/15 13:49, Tom Hoar wrote:
>> Also, your Ubuntu 12.04 is quite old. Could it's old libboost libraries
>> might be conflicting with your custom build? If possible, try updating
>> your host to 14.04.
>>
>>
>>
>> On 03/06/2015 08:40 PM, Kenneth Heafield wrote:
>>> Hi,
>>>
>>> Those are unit test failures. And that's worrying.
>>>
>>> moses/ScoreComponentCollectionTest.cpp(135): error in "sparse_feature":
>>> check scc.GetScoreForProducer(&sparse,"first") == 1.3f failed [0 !=
>>> 1.29999995]
>>> moses/ScoreComponentCollectionTest.cpp(136): error in "sparse_feature":
>>> check scc.GetScoreForProducer(&sparse,"second") == 2.1f failed [0 !=
>>> 2.0999999]
>>> moses/ScoreComponentCollectionTest.cpp(139): error in "sparse_feature":
>>> check scc.GetScoreForProducer(&sparse,"first") == -1.9f failed [0 !=
>>> -1.89999998]
>>> moses/ScoreComponentCollectionTest.cpp(141): error in "sparse_feature":
>>> check scc.GetScoreForProducer(&sparse,"first") == -3.8f failed [0 !=
>>> -3.79999995]
>>>
>>> Does a fresh build with -a solve anything? This is a 64-bit x86
>>> machine, right? Since you're on Ubuntu, why not try the
>>> distribution-provided Boost
>>>
>>> sudo apt-get install build-essential libboost-all-dev zlib1g-dev
>>> libbz2-dev liblzma-dev
>>>
>>> Kenneth
>>>
>>> On 03/06/2015 03:55 AM, Arezki Sadoune wrote:
>>>> Hello All
>>>>
>>>> I have some problems compiling the last moses on Ubuntu 12.04.5.
>>>>
>>>> -When compiling moses alone: ./bjam the issues encountered are :
>>>>
>>>> ...failed testing.unit-test
>>>> moses/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/moses_test.passed...
>>>>
>>>> testing.unit-test
>>>> mert/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/bleu_scorer_test.passed
>>>>
>>>>
>>>> ...failed testing.unit-test
>>>> mert/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/vocabulary_test.passed...
>>>>
>>>>
>>>>
>>>> -when I try to compile with boost_1_55_0 et CMPH-2.0
>>>> ./bjam --with-cmph=/root/tools/cmph-2.0/
>>>> --with-boost=/root/tools/boost_1_55_0
>>>> the errors preventing moses compiling are in the log file attached
>>>>
>>>> Cheers
>>>>
>>>>
>>>> Arezki SADOUNE
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>



------------------------------

Message: 3
Date: Fri, 6 Mar 2015 15:43:17 +0000
From: Liangyou Li <llysuda@gmail.com>
Subject: [Moses-support] Questions about kbmira code in Moses
To: moses-support@mit.edu
Message-ID:
<CAHeunNXbLe=AmGjNrC_PfUeZsWTw3ejJchm=YemJ=Q+POJMyLA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

I have a question about the function :
MiraWeightVector.ToSparse(SparseVector* sparse) .

It's defined as this:

void MiraWeightVector::ToSparse(SparseVector* sparse) const
{
for (size_t i = 0; i < m_weights.size(); ++i) {
if(abs(m_weights[i])>1e-8) {
sparse->set(i,m_weights[i]);
}
}
}

This means the same index i is used for both SparseVector and
MiraWeightVector.
However, according to the code in kbmira.cpp, there's a gap between the
indexes.

for dense feature: size_t id = SparseVector::encode(names[i]);
then, for sparse feature: size_t id = SparseVector::encode(name) +
initDenseSize;


?Why isn't the ToSparse function looks like this:

void MiraWeightVector::ToSparse(SparseVector* sparse, size_t denseSize)
const
{
for (size_t i = 0; i < m_weights.size(); ++i) {
if (i < denseSize) {
sparse->set(i,m_weights[i]);
} else {
if(abs(m_weights[i])>1e-8) {
sparse->set(i-denseSize,m_weights[i]);
}
}
}
}

I'm kind of confused, did I miss something ?
Many thanks.

Liangyou

--

Liangyou Li
CNGL
School of Computing
Dublin City University
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150306/43e50779/attachment-0001.htm

------------------------------

Message: 4
Date: Fri, 6 Mar 2015 17:11:41 +0100
From: Prashant Mathur <prashant@fbk.eu>
Subject: [Moses-support] Linking Eigen library
To: "moses-support@mit.edu" <moses-support@mit.edu>, Hieu Hoang
<Hieu.Hoang@ed.ac.uk>
Message-ID:
<CAK3pNhJYkvyuvbdFfqZWmcFmg_2k7a4mby-nS72-+eRxkzARzw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,


I am using some of the functions from Eigen library in a feature. If I want
to compile moses with eigen headers, so I am modifying the Jamfile but I
cannot make it work.. not familiar with it..
I did everything same as it is done for DLIB.

In moses/Jamfile I inserted this code after the dlib snippet.


with-eigen = [ option.get "with-eigen" ] ;
if $(with-eigen) {
eigen = <include>$(with-eigen) ;
} else {
eigen = ;
}

.
.
.

alias headers : ../util//kenutil $(classifier) : : : $(max-factors) $(dlib)
$(oxlm) $(eigen);

This gives me error when I compile :

./bjam --with-tcmalloc=/hltsrv1/software/GPERFTOOLS/gperftools-2.1
--with-boost=/hltsrv1/software/BOOST/boost_1_51_0
--with-eigen=/hltsrv0/prashant/MyInstallation/Eigen -j8 -a
Tip: install tcmalloc for faster threading. See BUILD-INSTRUCTIONS.txt for
more information.
mkdir: cannot create directory `bin': File exists
moses/Jamfile:34: in modules.load
*** argument error
* rule alias ( name : sources * : requirements * : default-build * :
usage-requirements * )
* called with: ( headers : ../util//kenutil : : :
<define>MAX_NUM_FACTORS=4
<dependency>/hltsrv0/prashant/mosesdecoder/moses/bin/factor.log
<include>/hltsrv0/prashant/MyInstallation/Eigen; alias ThreadPool :
ThreadPool.cpp )
* extra argument ThreadPool.cpp
/hltsrv0/prashant/mosesdecoder/jam-files/boost-build/build/alias.jam:59:see
definition of rule 'alias' being called
/hltsrv0/prashant/mosesdecoder/jam-files/boost-build/build/project.jam:317:
in load-jamfile
/hltsrv0/prashant/mosesdecoder/jam-files/boost-build/build/project.jam:62:
in load
/hltsrv0/prashant/mosesdecoder/jam-files/boost-build/build/project.jam:168:
in project.find
/hltsrv0/prashant/mosesdecoder/jam-files/boost-build/build/targets.jam:414:
in find-really
/hltsrv0/prashant/mosesdecoder/jam-files/boost-build/build/targets.jam:435:
in find
/hltsrv0/prashant/mosesdecoder/jam-files/boost-build/build/targets.jam:291:
in targets-to-build
/hltsrv0/prashant/mosesdecoder/jam-files/boost-build/build/targets.jam:256:
in class@project-target.generate
/hltsrv0/prashant/mosesdecoder/jam-files/boost-build/build-system.jam:729:
in load
./jam-files/boost-build/kernel/modules.jam:283: in import
./jam-files/boost-build/kernel/bootstrap.jam:142: in boost-build
./jam-files/boost-build/boost-build.jam:8: in module scope

what can be the problem?

Thanks,
Prashant
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150306/bc0f07e6/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 101, Issue 22
**********************************************

0 Response to "Moses-support Digest, Vol 101, Issue 22"

Post a Comment

Subscribe to: Post Comments (Atom)