Moses-support Digest, Vol 115, Issue 8

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. binarized reordering table error (anton_987@libero.it)
2. Failed mosesdecoder compilation with xmlrpc (Tomasz Gawryl)


----------------------------------------------------------------------

Message: 1
Date: Fri, 6 May 2016 15:40:50 +0200 (CEST)
From: "anton_987@libero.it" <anton_987@libero.it>
Subject: [Moses-support] binarized reordering table error
To: moses-support@mit.edu
Message-ID:
<81524573.13344811462542050015.JavaMail.httpd@webmail-55.iol.local>
Content-Type: text/plain; charset="utf-8"







p { margin-bottom: 0.1in; line-height: 120%; }a:link { }


Hi all,

I cannot manage to
run the Moses baseline:
http://www.statmt.org/moses/?n=Moses.Baseline



I get a M_range_check exception when I use the binarized versions of the reordering tables
...
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryCompact name=TranslationModel0 num-features=4 path=/home/antonio/working/binarised-model/phrase-table input-factor=0 output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 path=/home/antonio/working/binarised-model/reordering-table.minlexr
Initializing Lexical Reordering Feature..
FeatureFunction: LexicalReordering0 start: 7 end: 12
line=Distortion
FeatureFunction: Distortion0 start: 13 end: 13
line=KENLM name=LM0 factor=0 path=/home/antonio/lm/news-commentary-v8.fr-en.blm.en order=3
FeatureFunction: LM0 start: 14 end: 14
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading LexicalReordering0
Loading table into memory...Exception: vector::_M_range_check




I use this command
to start the moses decoder:
$ ~/mosesdecoder/bin/moses -f
~/working/binarised-model/moses.ini



The moses.ini file that I'm using is attached to this email.




This is the command
I used to install moses:
$ ./bjam
--with-cmph=cmph-2.0 --with-xmlrpc-c=xmlrpc-c-1.33.18
--with-irstlm=irstlm-5.80.08/trunk ?with-boost=boost_1_59_0



Any ideas on how to
solve this problem?



Thanks,
Antonio







-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160506/edbc3176/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: moses.ini
Type: application/octet-stream
Size: 1757 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20160506/edbc3176/attachment-0001.obj

------------------------------

Message: 2
Date: Fri, 6 May 2016 15:42:08 +0200
From: "Tomasz Gawryl" <tomasz.gawryl@skrivanek.pl>
Subject: [Moses-support] Failed mosesdecoder compilation with xmlrpc
To: <moses-support@mit.edu>
Message-ID: <009701d1a79d$158273f0$40875bd0$@skrivanek.pl>
Content-Type: text/plain; charset="us-ascii"

Hi,



I'm trying to compile mosesdecoder with xml-rpc support for mosesserver but
without success. I downloaded and installed this library in custom directory
and use this command to run compilation process:



./bjam --prefix=/home/moses/src/mosesdecoder -q
--with-irstlm=/home/moses/src/irstlm-5.80.08/trunk
--with-cmph=/home/moses/src/cmph-2.0
--with-xmlrpc-c=/home/moses/src/mosesdecoder/xmlrpc-c --with=mm
--with-probing-pt=/home/moses/src/Pr

obingPT --max-kenlm-order=10 -j$(getconf _NPROCESSORS_ONLN) $@



But it produces error and fails compilation (log below).

Compilation without xmlrpc support ends with success.

Any ideas?



Best Regards,

Tomek





/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `channelRead':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:320:
undefined reference to `SSL_read'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:325:
undefined reference to `SSL_get_error'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `channelWrite':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:285:
undefined reference to `SSL_write'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:290:
undefined reference to `SSL_get_error'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `channelDestroy':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:258:
undefined reference to `SSL_shutdown'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `sslCreate':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:121:
undefined reference to `SSL_new'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `sslSetFd':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:142:
undefined reference to `SSL_set_fd'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `sslAccept':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:191:
undefined reference to `SSL_accept'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:196:
undefined reference to `SSL_get_error'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `sslErrorMsg':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:71:
undefined reference to `ERR_get_error_line'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `getPeerAddrFromSsl':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:415:
undefined reference to `SSL_get_fd'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `createChannelFromAcceptedConn':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:671:
undefined reference to `SSL_free'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `sslErrorMsg':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:71:
undefined reference to `ERR_get_error_line'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `createSslFromAcceptedConn':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:623:
undefined reference to `SSL_free'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `sslErrorMsg':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:78:
undefined reference to `ERR_error_string'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:71:
undefined reference to `ERR_get_error_line'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:78:
undefined reference to `ERR_error_string'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:78:
undefined reference to `ERR_error_string'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `traceCipherList':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:170:
undefined reference to `SSL_get_cipher_list'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:170:
undefined reference to `SSL_get_cipher_list'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `SocketOpenSslInit':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:228:
undefined reference to `SSL_load_error_strings'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:230:
undefined reference to `SSL_library_init'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `getPeerAddrFromSsl':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:415:
undefined reference to `SSL_get_fd'

/home/moses/src/mosesdecoder/xmlrpc-c/lib/libxmlrpc_abyss.a(socket_openssl.o
): In function `SocketOpenSslTerm':

/home/moses/src/mosesdecoder/xmlrpc-c/lib/abyss/src/socket_openssl.c:240:
undefined reference to `ERR_free_strings'

collect2: error: ld returned 1 exit status



"g++" -L"/home/moses/src/cmph-2.0/lib"
-L"/home/moses/src/cmph-2.0/lib64"
-L"/home/moses/src/irstlm-5.80.08/trunk/lib"
-L"/home/moses/src/irstlm-5.80.08/trunk/lib64"
-L"/home/moses/src/mosesdecoder/xmlrpc-c/lib" -Wl,-R
-Wl,"/home/moses/src/cmph-2.0/lib" -Wl,-R
-Wl,"/home/moses/src/cmph-2.0/lib64" -Wl,-R
-Wl,"/home/moses/src/irstlm-5.80.08/trunk/lib" -Wl,-R
-Wl,"/home/moses/src/irstlm-5.80.08/trunk/lib64" -Wl,-R
-Wl,"/home/moses/src/mosesdecoder/xmlrpc-c/lib" -Wl,-rpath-link
-Wl,"/home/moses/src/cmph-2.0/lib" -Wl,-rpath-link
-Wl,"/home/moses/src/cmph-2.0/lib64" -Wl,-rpath-link
-Wl,"/home/moses/src/irstlm-5.80.08/trunk/lib" -Wl,-rpath-link
-Wl,"/home/moses/src/irstlm-5.80.08/trunk/lib64" -Wl,-rpath-link
-Wl,"/home/moses/src/mosesdecoder/xmlrpc-c/lib" -o
"moses-cmd/bin/gcc-4.8/release/link-static/threading-multi/moses"
-Wl,--start-group
"moses-cmd/bin/gcc-4.8/release/link-static/threading-multi/Main.o"
"moses/bin/gcc-4.8/release/link-static/threading-multi/libmoses.a"
-Wl,-Bstatic -lboost_iostreams -lboost_filesystem -lcmph -lirstlm -lbz2
-lxmlrpc_xmltok -lxmlrpc_xmlparse -lxmlrpc_util++ -lxmlrpc_util
-lxmlrpc_server_abyss++ -lxmlrpc_server_abyss -lxmlrpc_server++
-lxmlrpc_server -lxmlrpc_abyss++ -lxmlrpc_abyss -lxmlrpc++ -lxmlrpc
-ltcmalloc_minimal -lboost_thread -lboost_system -lboost_serialization
-lboost_program_options -lz -Wl,-Bdynamic -lSegFault -lrt -Wl,--end-group
-pthread



...failed gcc.link
moses-cmd/bin/gcc-4.8/release/link-static/threading-multi/moses...

gcc.compile.c++
mert/bin/gcc-4.8/release/link-static/threading-multi/MiraFeatureVector.o

gcc.compile.c++
mert/bin/gcc-4.8/release/link-static/threading-multi/MiraWeightVector.o

gcc.compile.c++
mert/bin/gcc-4.8/release/link-static/threading-multi/ForestRescore.o

gcc.compile.c++
mert/bin/gcc-4.8/release/link-static/threading-multi/Hypergraph.o

gcc.compile.c++
mert/bin/gcc-4.8/release/link-static/threading-multi/HopeFearDecoder.o

mert/HopeFearDecoder.cpp: In function
'std::pair<MosesTuning::MiraWeightVector*, long unsigned int>
MosesTuning::InitialiseWeights(const string&, const string&, const string&,
bool)':

mert/HopeFearDecoder.cpp:98:16: warning: unused variable 'id'
[-Wunused-variable]

size_t id = SparseVector::encode(names[i]);

^

gcc.compile.c++
mert/bin/gcc-4.8/release/link-static/threading-multi/HypPackEnumerator.o

gcc.compile.c++ mert/bin/gcc-4.8/release/link-static/threading-multi/Data.o

...failed updating 1 target...



-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160506/de99b84e/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 115, Issue 8
*********************************************

0 Response to "Moses-support Digest, Vol 115, Issue 8"

Post a Comment