Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. problem with weighting translation models using
client_multimodel.py (??????? ?????????)
2. Re: Error while compiling Moses (Christophe Servan)
----------------------------------------------------------------------
Message: 1
Date: Mon, 23 Dec 2013 13:18:28 +0400
From: ??????? ????????? <verbalab@yandex.ru>
Subject: [Moses-support] problem with weighting translation models
using client_multimodel.py
To: moses-support@mit.edu
Message-ID: <364001387790308@web13h.yandex.ru>
Content-Type: text/plain
Hi, everyone!
I have a problem with weighting two translation models using client_multimodel.py. When I function like that (with no weights):
translate(['i have a dream'],server)
it's ok - Moses responses me with translation via xmlrpc.
But when I try to add weigts like that
translate(['i have a dream'],server, '0.1,0.1')
it returns nothing, neither translation nor error report.
Can you please advice upon, what the problem can be and what is the syntax of setting weights?
My moses.inin file is the following:
[input-factors]
0
# mapping steps
[mapping]
0 T 2
[distortion-limit]
6
# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryMemory table-limit=20 tuneable=false num-features=4 path=/home/user/corpora/mem/train/model/phrase-table.gz input-factor=0 output-factor=0
PhraseDictionaryMemory table-limit=20 tuneable=false num-features=4 path=/home/user/corpora/pm/train/model/phrase-table.gz input-factor=0 output-factor=0
PhraseDictionaryMultiModel num-features=4 input-factor=0 output-factor=0 table-limit=20 mode=interpolate lambda=0.2,0.8 components=PhraseDictionaryMemory0,PhraseDictionaryMemory1
LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/home/user/corpora/mem/train/model/reordering-table.wbe-msd-bidirectional-fe.gz
Distortion
KENLM lazyken=0 name=LM0 factor=0 path=/home/user/corpora/mem/blm.ru order=5
# dense weights for feature functions
[weight]
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
PhraseDictionaryMemory0= 0 0 1 0
PhraseDictionaryMemory1= 0 0 1 0
PhraseDictionaryMultiModel0= 0.2 0.2 0.2 0.2
LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5
Many thanx! Kind regards!
Alexander Kalinin
------------------------------
Message: 2
Date: Mon, 23 Dec 2013 12:52:29 +0100
From: Christophe Servan <christophe.servan@gmail.com>
Subject: Re: [Moses-support] Error while compiling Moses
To: nakul sharma <nakul777@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAAsGDkofChKHUCqeeHTETdyY+eFufBb40gVo88FgQjQvjHqJNg@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"
Hi Nakul,
please try to install the package libbz2-dev (sudo apt-get install
libbz2-dev) and try again to compile.
If it does not work, I faced that kind of issue by adding "-lbz2" to the
environment variable LDFLAGS
Best,
Christophe
2013/12/21 nakul sharma <nakul777@gmail.com>
> Hi Christophe,
>
> Thank you for help and guidance. My system configuration is as under:-
>
> OS: Ubuntu 12.04.2 LTS(updated some 100 days ago)
> RAM: 3 GB
> HDD: 40 GB (for linux)
>
> I have already installed the bzip2 library. When I execute on terminal
> following command:-
>
> whereis bzip2
>
> is get following result:-
>
> nakul@nakul-Inspiron-1545:~$ whereis bzip2
> bzip2: /bin/bzip2 /usr/share/man/man1/bzip2.1.gz
> nakul@nakul-Inspiron-1545:~$
>
>
> This indicates that bzip2 is installed. Please tell what can be possible
> solution ?
>
>
>
>
> On Fri, Dec 20, 2013 at 2:51 PM, Christophe Servan <
> christophe.servan@gmail.com> wrote:
>
>> Dear Nakul,
>> did you install the bzip2 library (i.e. the package bzip2-dev) ?
>>
>> Best,
>>
>> Christophe
>>
>>
>> 2013/12/20 nakul sharma <nakul777@gmail.com>
>>
>>> Hi,
>>>
>>> I am trying to compile moses. But I am getting following error messages.
>>> Please help in this regard.
>>>
>>> notice: found boost-build.jam at /usr/share/boost-build/boost-build.jam
>>> notice: loading Boost.Build from /usr/share/boost-build/kernel
>>> notice: Searching /etc /home/nakul /usr/share/boost-build/kernel
>>> /usr/share/boost-build /usr/share/boost-build/kernel
>>> /usr/share/boost-build/util /usr/share/boost-build/build
>>> /usr/share/boost-build/tools /usr/share/boost-build/contrib
>>> /usr/share/boost-build/. for site-config configuration file site-config.jam
>>> .
>>> notice: Configuration file site-config.jam not found in /etc /home/nakul
>>> /usr/share/boost-build/kernel /usr/share/boost-build
>>> /usr/share/boost-build/kernel /usr/share/boost-build/util
>>> /usr/share/boost-build/build /usr/share/boost-build/tools
>>> /usr/share/boost-build/contrib /usr/share/boost-build/. .
>>> notice: Searching /home/nakul /usr/share/boost-build/kernel
>>> /usr/share/boost-build /usr/share/boost-build/kernel
>>> /usr/share/boost-build/util /usr/share/boost-build/build
>>> /usr/share/boost-build/tools /usr/share/boost-build/contrib
>>> /usr/share/boost-build/. for user-config configuration file user-config.jam
>>> .
>>> notice: Configuration file user-config.jam not found in /home/nakul
>>> /usr/share/boost-build/kernel /usr/share/boost-build
>>> /usr/share/boost-build/kernel /usr/share/boost-build/util
>>> /usr/share/boost-build/build /usr/share/boost-build/tools
>>> /usr/share/boost-build/contrib /usr/share/boost-build/. .
>>>
>>> file /home/nakul/mosesdecoder-master/previous.sh
>>> #!/bin/sh
>>> /usr/bin/bjam -j2 --debug-configuration -d2
>>>
>>>
>>> bash -c "g++ -lSegFault -x c++ - <<<'int main() {}' -o
>>> /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 0
>>> bash -c "g++ -static -lSegFault -x c++ - <<<'int main() {}' -o
>>> /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 1
>>> bash -c "g++ -lboost_program_options-1_46_1 -x c++ - <<<'int main() {}'
>>> -o /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 1
>>> bash -c "g++ -static -lboost_program_options -x c++ - <<<'int main()
>>> {}' -o /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 0
>>> bash -c "g++ -lboost_system-mt -static -x c++ - <<<'int main() {}' -o
>>> /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 0
>>> bash -c "g++ -lboost_thread-mt -static -x c++ - <<<'int main() {}' -o
>>> /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 0
>>> bash -c "g++ -lboost_program_options-mt -static -x c++ - <<<'int
>>> main() {}' -o /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null
>>> && rm /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 0
>>> bash -c "g++ -lboost_unit_test_framework-mt
>>> -DBOOST_TEST_MODULE=CompileTest -include boost/test/unit_test.hpp -static
>>> -x c++ - <<<'BOOST_AUTO_TEST_CASE(foo) {}' -o
>>> /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 0
>>> bash -c "g++ -lboost_iostreams-mt -static -x c++ - <<<'int main() {}'
>>> -o /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 0
>>> bash -c "g++ -lboost_filesystem-mt -static -x c++ - <<<'int main() {}'
>>> -o /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 0
>>> bash -c "g++ -static -lz -x c++ - <<<'int main() {}' -o
>>> /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 0
>>> bash -c "g++ -ltcmalloc_minimal -x c++ - <<<'int main() {}' -o
>>> /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 1
>>> Tip: install tcmalloc for faster threading. See BUILD-INSTRUCTIONS.txt
>>> for more information.
>>> warning: No toolsets are configured.
>>> warning: Configuring default toolset "gcc".
>>> warning: If the default is wrong, your build may not work correctly.
>>> warning: Use the "toolset=xxxxx" option to override our guess.
>>> warning: For more configuration options, please consult
>>> warning:
>>> http://boost.org/boost-build2/doc/html/bbv2/advanced/configuration.html
>>> notice: will use 'g++' for gcc, condition <toolset>gcc-4.6
>>> notice: using gcc libraries :: <toolset>gcc-4.6 :: /usr/bin /usr/lib
>>> /usr/lib32 /usr/lib64
>>> notice: using gcc archiver :: <toolset>gcc-4.6 :: /usr/bin/ar
>>> notice: using gcc ranlib :: <toolset>gcc-4.6 :: /usr/bin/ranlib
>>> warning: toolset gcc initialization: can not find tool windres
>>> warning: initialized from
>>> notice: using rc compiler :: <toolset>gcc-4.6 :: /usr/bin/as
>>> bash -c "g++ -lbz2 -x c++ - <<<'int main() {}' -o
>>> /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 1
>>> bash -c "g++ -llzma -x c++ - <<<'int main() {}' -o
>>> /home/nakul/mosesdecoder-master/dummy >/dev/null 2>/dev/null && rm
>>> /home/nakul/mosesdecoder-master/dummy 2>/dev/null"
>>> 1
>>> ...patience...
>>> ...found 3439 targets...
>>> ...updating 4 targets...
>>> gcc.link
>>> moses-cmd/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/moses
>>>
>>> "g++" -o
>>> "moses-cmd/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/moses"
>>> -Wl,--start-group
>>> "moses-cmd/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/Main.o"
>>> "moses-cmd/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/IOWrapper.o"
>>> "moses-cmd/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/mbr.o"
>>> "moses-cmd/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/LatticeMBR.o"
>>> "moses-cmd/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/TranslationAnalysis.o"
>>> "moses/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/libmoses.a"
>>> -Wl,-Bstatic -lz -lboost_filesystem-mt -lboost_iostreams-mt
>>> -lboost_thread-mt -lboost_system-mt -lz -Wl,-Bdynamic -lrt -ldl -lSegFault
>>> -lrt -Wl,--end-group -g -pthread
>>>
>>>
>>> /usr/lib/gcc/i686-linux-gnu/4.6/../../../../lib/libboost_iostreams-mt.a(bzip2.o):
>>> In function `boost::iostreams::detail::bzip2_base::do_init(bool, void*
>>> (*)(void*, int, int), void (*)(void*, void*), void*)':
>>> (.text+0x2e9): undefined reference to `BZ2_bzDecompressInit'
>>> /usr/lib/gcc/i686-linux-gnu/4.6/../../../../lib/libboost_iostreams-mt.a(bzip2.o):
>>> In function `boost::iostreams::detail::bzip2_base::do_init(bool, void*
>>> (*)(void*, int, int), void (*)(void*, void*), void*)':
>>> (.text+0x391): undefined reference to `BZ2_bzCompressInit'
>>> /usr/lib/gcc/i686-linux-gnu/4.6/../../../../lib/libboost_iostreams-mt.a(bzip2.o):
>>> In function `boost::iostreams::detail::bzip2_base::end(bool)':
>>> (.text+0x455): undefined reference to `BZ2_bzDecompressEnd'
>>> /usr/lib/gcc/i686-linux-gnu/4.6/../../../../lib/libboost_iostreams-mt.a(bzip2.o):
>>> In function `boost::iostreams::detail::bzip2_base::end(bool)':
>>> (.text+0x4d1): undefined reference to `BZ2_bzCompressEnd'
>>> /usr/lib/gcc/i686-linux-gnu/4.6/../../../../lib/libboost_iostreams-mt.a(bzip2.o):
>>> In function `boost::iostreams::detail::bzip2_base::compress(int)':
>>> (.text+0x18c): undefined reference to `BZ2_bzCompress'
>>> /usr/lib/gcc/i686-linux-gnu/4.6/../../../../lib/libboost_iostreams-mt.a(bzip2.o):
>>> In function `boost::iostreams::detail::bzip2_base::decompress()':
>>> (.text+0x19c): undefined reference to `BZ2_bzDecompress'
>>> collect2: ld returned 1 exit status
>>> ...failed gcc.link
>>> moses-cmd/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/moses...
>>> ...skipped <p/home/nakul/mosesdecoder-master/bin>moses for lack of
>>> <pmoses-cmd/bin/gcc-4.6/release/debug-symbols-on/link-static/threading-multi>moses...
>>> testing.capture-output
>>> moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.run
>>>
>>>
>>> LD_LIBRARY_PATH="/usr/bin:/usr/lib:/usr/lib32:/usr/lib64:$LD_LIBRARY_PATH"
>>> export LD_LIBRARY_PATH
>>>
>>>
>>> "moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest"
>>> "moses/LM/backward.arpa" >
>>> "moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.output"
>>> 2>&1
>>> status=$?
>>> echo >>
>>> "moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.output"
>>> echo EXIT STATUS: $status >>
>>> "moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.output"
>>> if test $status -eq 0 ; then
>>> cp
>>> "moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.output"
>>> "moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.run"
>>> fi
>>> verbose=0
>>> if test $status -ne 0 ; then
>>> verbose=1
>>> fi
>>> if test $verbose -eq 1 ; then
>>> echo ====== BEGIN OUTPUT ======
>>> cat
>>> "moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.output"
>>> echo ====== END OUTPUT ======
>>> fi
>>> exit $status
>>>
>>> ====== BEGIN OUTPUT ======
>>> Running 1 test case...
>>> moses/LM/BackwardTest.cpp(162): error in "ProbingAll": difference{100%}
>>> between static_cast<double>(TransformLMScore( 0.0 )){0} and
>>> static_cast<double>(ngramScore){1.3724476843890443e-07} exceeds 0.01%
>>>
>>> *** 1 failure detected in test suite "BackwardTest"
>>>
>>> EXIT STATUS: 201
>>> ====== END OUTPUT ======
>>> ...failed testing.capture-output
>>> moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.run...
>>> ...failed updating 2 targets...
>>> ...skipped 2 targets...
>>> The build failed with command line:
>>> /usr/bin/bjam -j2 --debug-configuration -d2
>>> If you need support, attach the full output to your e-mail.
>>> ERROR
>>>
>>> --
>>> Thanks & Regards,
>>> Nakul Sharma
>>>
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>
>
> --
> Thanks & Regards,
> Nakul Sharma
> Assistant Professor (IT)
> Sinhgad Academy of Engineering (SAE)
> Pune
> India.
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131223/91c4a316/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 86, Issue 69
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 86, Issue 69"
Post a Comment