Moses-support Digest, Vol 111, Issue 80

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Segmentation fault on hierarchical model with moses in
server mode (Ulrich Germann)


----------------------------------------------------------------------

Message: 1
Date: Fri, 29 Jan 2016 00:31:44 +0000
From: Ulrich Germann <ulrich.germann@gmail.com>
Subject: Re: [Moses-support] Segmentation fault on hierarchical model
with moses in server mode
To: Martin Baumg?rtner <martin.baumgaertner@star-group.net>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAHQSRUoHu_C5UBD1jBswyD7Yjk4-MGfBJ6i9fJYSeRY_+1W8QQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Confirmed on Ubuntu 12.04 as well. Hieu Hoang seems to have added this bit
to the server, so maybe he knows more than I do. I usually dabble in
phrase-based decoding only, so this is uncharted territory for me. I'll try
to look into it, but it may take a little while as I can do so only in my
spare time.

- Uli

On Wed, Jan 27, 2016 at 3:12 PM, Martin Baumg?rtner <
martin.baumgaertner@star-group.net> wrote:

> Hi all,
>
> I'm using a system with current CentOS 7, Boost 1.60.0 and moses from git
> master (SHA: 42b8b89d54a5c670f02a16426a92cc1d0fb97754).
>
> While playing with basic hierarchical models I found the following
> (probably buggy) behaviour:
>
> 1.) INITIALIZE ...
>
> % wget "http://www.statmt.org/moses/download/sample-models.tgz"
> <http://www.statmt.org/moses/download/sample-models.tgz> && tar xfz
> sample-models.tgz && cd sample-models
>
>
> 2.) TRANSLATE WITHOUT SERVER ... (ok)
>
> % echo 'dies ist ein haus' | moses -f string-to-tree/moses.ini
>
> Defined parameters (per moses.ini or switch):
> config: string-to-tree/moses.ini
> cube-pruning-pop-limit: 1000
> feature: KENLM name=LM factor=0 order=3 num-features=1
> path=lm/europarl.srilm.gz WordPenalty UnknownWordPenalty
> PhraseDictionaryMemory input-factor=0 output-factor=0
> path=string-to-tree/rule-table num-features=1 table-limit=20
> input-factors: 0
> inputtype: 3
> mapping: 0 T 0
> max-chart-span: 20 1000
> non-terminals: X S
> search-algorithm: 3
> translation-details: translation-details.log
> weight: WordPenalty0= 0 LM= 0.5 PhraseDictionaryMemory0= 0.5
> line=KENLM name=LM factor=0 order=3 num-features=1
> path=lm/europarl.srilm.gz
> Loading the LM will be faster if you build a binary file.
> Reading lm/europarl.srilm.gz
>
> ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
> **The ARPA file is missing <unk>. Substituting log10 probability -100.000.
>
> **************************************************************************************************
> FeatureFunction: LM start: 0 end: 0
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 1
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 2 end: 2
> line=PhraseDictionaryMemory input-factor=0 output-factor=0
> path=string-to-tree/rule-table num-features=1 table-limit=20
> FeatureFunction: PhraseDictionaryMemory0 start: 3 end: 3
> Loading LM
> Loading WordPenalty0
> Loading UnknownWordPenalty0
> Loading PhraseDictionaryMemory0
> Start loading text phrase table. Moses format : [0.795] seconds
> Reading string-to-tree/rule-table
>
> ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
>
> ****************************************************************************************************
> max-chart-span: 20
> Created input-output object : [0.796] seconds
> Line 0: Initialize search took 0.000 seconds total
> Translating: <s> das ist ein haus </s> ||| [0,0]=X (1) [0,1]=X (1)
> [0,2]=X (1) [0,3]=X (1) [0,4]=X (1) [0,5]=X (1) [1,1]=X (1) [1,2]=X (1)
> [1,3]=X (1) [1,4]=X (1) [1,5]=X (1) [2,2]=X (1) [2,3]=X (1) [2,4]=X (1)
> [2,5]=X (1) [3,3]=X (1) [3,4]=X (1) [3,5]=X (1) [4,4]=X (1) [4,5]=X (1)
> [5,5]=X (1)
>
> 0 1 2 3 4 5
> 0 3 2 2 1 0
> 0 0 0 2 0
> 0 0 4 0
> 0 8 0
> 0 0
> 1
> BEST TRANSLATION: 31 TOP -> <s> S </s> :1-1 : term=: nonterm=1-1 :
> c=-3.206 core=(-6.413,-2.000,0.000,0.000) [0..5] 15 [total=-12.332]
> core=(-22.361,-6.000,0.000,-2.303)
> this is a house
> Line 0: Additional reporting took 0.000 seconds total
> Line 0: Translation took 0.001 seconds total
> Translation took 0.010 seconds
> Name:moses VmPeak:79168 kB VmRSS:7392 kB RSSMax:35916 kB
> user:0.783 sys:0.022 CPU:0.805 real:0.799
>
>
> 3.) SET UP XMLRPC FILE ...
>
> % echo '<?xml version="1.0" encoding="UTF-8"?>
> <methodCall>
> <methodName>translate</methodName>
> <params><param><value>
> <struct>
> <member>
> <name>text</name>
> <value>
> <string>dies ist ein haus .</string>
> </value>
> </member>
> </struct></value></param>
> </params>
> </methodCall>
> ' > rpc.xml
>
>
> 4.) START MOSES SERVER ...
>
> % moses --server --config string-to-tree/moses.ini &
>
> Defined parameters (per moses.ini or switch):
> config: string-to-tree/moses.ini
> cube-pruning-pop-limit: 1000
> feature: KENLM name=LM factor=0 order=3 num-features=1
> path=lm/europarl.srilm.gz WordPenalty UnknownWordPenalty
> PhraseDictionaryMemory input-factor=0 output-factor=0
> path=string-to-tree/rule-table num-features=1 table-limit=20
> input-factors: 0
> inputtype: 3
> mapping: 0 T 0
> max-chart-span: 20 1000
> non-terminals: X S
> search-algorithm: 3
> server:
> translation-details: translation-details.log
> weight: WordPenalty0= 0 LM= 0.5 PhraseDictionaryMemory0= 0.5
> line=KENLM name=LM factor=0 order=3 num-features=1
> path=lm/europarl.srilm.gz
> Loading the LM will be faster if you build a binary file.
> Reading lm/europarl.srilm.gz
>
> ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
> **The ARPA file is missing <unk>. Substituting log10 probability -100.000.
>
> **************************************************************************************************
> FeatureFunction: LM start: 0 end: 0
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 1
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 2 end: 2
> line=PhraseDictionaryMemory input-factor=0 output-factor=0
> path=string-to-tree/rule-table num-features=1 table-limit=20
> FeatureFunction: PhraseDictionaryMemory0 start: 3 end: 3
> Loading LM
> Loading WordPenalty0
> Loading UnknownWordPenalty0
> Loading PhraseDictionaryMemory0
> Start loading text phrase table. Moses format : [0.817] seconds
> Reading string-to-tree/rule-table
>
> ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
>
> ****************************************************************************************************
> max-chart-span: 20
> RUN SERVER at pid 0
> [moses/server/Server.cpp:49] Listening on port 8080
>
>
> 5.) TRANSLATE WITH SERVER ... (not ok)
>
> % curl --data @rpc.xml '192.168.178.14:8080/RPC2'
>
> [moses/server/TranslationRequest.cpp:317] Input: dies ist ein haus .
> Translating: <s> dies ist ein haus . </s>
> 0 1 2 3 4 5 6
> 0 1 2 2 1 1 0
> 0 0 0 0 0 0
> 0 0 0 0 0
> 0 0 0 0
> 0 0 0
> 0 0
> 0
> *** Segmentation fault
> Register dump:
>
> RAX: 0000000000000006 RBX: 0000000000000000 RCX: 0000000000000001
> RDX: 00000000028fe000 RSI: 00007f7ae25fe5d0 RDI: 00000000025ffaa0
> RBP: 00007f7ae25fe940 R8 : 00000000028fe000 R9 : 00007f7ae4d24f90
> R10: 00007f7ae4d3f960 R11: 0000000000000000 R12: 0000000000000000
> R13: 00007f7ae25fe5d0 R14: 0000000000000000 R15: 00000000028ec268
> RSP: 00007f7ae25fe540
>
> RIP: 0000000000571c70 EFLAGS: 00010206
>
> CS: 0033 FS: 0000 GS: 0000
>
> Trap: 0000000e Error: 00000004 OldMask: 00000000 CR2: 00000000
>
> FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000
> RIP: 00000000 RDP: 00000000
>
> ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000
> ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000
> ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000
> ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000
> mxcsr: 1fa4
> XMM0: 000000000000000000000000ff0000ff XMM1:
> 000000000000000000000000ff0000ff
> XMM2: 000000000000000000000000ff0000ff XMM3:
> 000000000000000000000000ff0000ff
> XMM4: 000000000000000000000000ff0000ff XMM5:
> 000000000000000000000000ff0000ff
> XMM6: 000000000000000000000000ff0000ff XMM7:
> 000000000000000000000000ff0000ff
> XMM8: 000000000000000000000000ff0000ff XMM9:
> 000000000000000000000000ff0000ff
> XMM10: 000000000000000000000000ff0000ff XMM11:
> 000000000000000000000000ff0000ff
> XMM12: 000000000000000000000000ff0000ff XMM13:
> 000000000000000000000000ff0000ff
> XMM14: 000000000000000000000000ff0000ff XMM15:
> 000000000000000000000000ff0000ff
>
> Backtrace:
> /home/maba/bin/moses[0x571c70]
> /home/maba/bin/moses[0x503c48]
> /home/maba/bin/moses[0x504031]
> /home/maba/bin/moses[0x501a21]
> /home/maba/bin/moses[0x564309]
> /home/maba/bin/moses[0x7deec9]
> /usr/lib64/libpthread.so.0(+0x7dc5)[0x7f7ae430cdc5]
> /usr/lib64/libc.so.6(clone+0x6d)[0x7f7ae403a21d]
>
> Memory map:
>
> 00400000-00945000 r-xp 00000000 fd:02 5162546
> /home/maba/bin/moses
> 00b45000-00b46000 r--p 00545000 fd:02 5162546
> /home/maba/bin/moses
> 00b46000-00b48000 rw-p 00546000 fd:02 5162546
> /home/maba/bin/moses
> 00b48000-00b4d000 rw-p 00000000 00:00 0
> 01df3000-02bf6000 rw-p 00000000 00:00 0
> [heap]
> 7f7adadf1000-7f7adadf2000 ---p 00000000 00:00 0
> 7f7adadf2000-7f7adb5f2000 rw-p 00000000 00:00 0
> [stack:34973]
> 7f7adb5f2000-7f7adb5f3000 ---p 00000000 00:00 0
> 7f7adb5f3000-7f7adbdf3000 rw-p 00000000 00:00 0
> [stack:34972]
> 7f7adbdf3000-7f7adbdf4000 ---p 00000000 00:00 0
> 7f7adbdf4000-7f7adc5f4000 rw-p 00000000 00:00 0
> [stack:34971]
> 7f7adc5f4000-7f7adc5f5000 ---p 00000000 00:00 0
> 7f7adc5f5000-7f7adcdf5000 rw-p 00000000 00:00 0
> [stack:34970]
> 7f7adcdf5000-7f7adcdf6000 ---p 00000000 00:00 0
> 7f7adcdf6000-7f7add5f6000 rw-p 00000000 00:00 0
> [stack:34969]
> 7f7add5f6000-7f7add5f7000 ---p 00000000 00:00 0
> 7f7add5f7000-7f7adddf7000 rw-p 00000000 00:00 0
> [stack:34968]
> 7f7adddf7000-7f7adddf8000 ---p 00000000 00:00 0
> 7f7adddf8000-7f7ade5f8000 rw-p 00000000 00:00 0
> [stack:34967]
> 7f7ade5f8000-7f7ade5f9000 ---p 00000000 00:00 0
> 7f7ade5f9000-7f7adedf9000 rw-p 00000000 00:00 0
> [stack:34966]
> 7f7adedf9000-7f7adedfa000 ---p 00000000 00:00 0
> 7f7adedfa000-7f7adf5fa000 rw-p 00000000 00:00 0
> [stack:34965]
> 7f7adf5fa000-7f7adf5fb000 ---p 00000000 00:00 0
> 7f7adf5fb000-7f7adfdfb000 rw-p 00000000 00:00 0
> [stack:34964]
> 7f7adfdfb000-7f7adfdfc000 ---p 00000000 00:00 0
> 7f7adfdfc000-7f7ae05fc000 rw-p 00000000 00:00 0
> [stack:34963]
> 7f7ae05fc000-7f7ae05fd000 ---p 00000000 00:00 0
> 7f7ae05fd000-7f7ae0dfd000 rw-p 00000000 00:00 0
> [stack:34962]
> 7f7ae0dfd000-7f7ae0dfe000 ---p 00000000 00:00 0
> 7f7ae0dfe000-7f7ae15fe000 rw-p 00000000 00:00 0
> [stack:34961]
> 7f7ae15fe000-7f7ae15ff000 ---p 00000000 00:00 0
> 7f7ae15ff000-7f7ae1dff000 rw-p 00000000 00:00 0
> [stack:34960]
> 7f7ae1dff000-7f7ae1e00000 ---p 00000000 00:00 0
> 7f7ae1e00000-7f7ae2600000 rw-p 00000000 00:00 0
> [stack:34959]
> 7f7ae2600000-7f7ae3f2d000 rw-p 00000000 00:00 0
> 7f7ae3f44000-7f7ae40fa000 r-xp 00000000 fd:01 201327759
> /usr/lib64/libc-2.17.so
> 7f7ae40fa000-7f7ae42fa000 ---p 001b6000 fd:01 201327759
> /usr/lib64/libc-2.17.so
> 7f7ae42fa000-7f7ae42fe000 r--p 001b6000 fd:01 201327759
> /usr/lib64/libc-2.17.so
> 7f7ae42fe000-7f7ae4300000 rw-p 001ba000 fd:01 201327759
> /usr/lib64/libc-2.17.so
> 7f7ae4300000-7f7ae4305000 rw-p 00000000 00:00 0
> 7f7ae4305000-7f7ae431b000 r-xp 00000000 fd:01 202647953
> /usr/lib64/libpthread-2.17.so
> 7f7ae431b000-7f7ae451b000 ---p 00016000 fd:01 202647953
> /usr/lib64/libpthread-2.17.so
> 7f7ae451b000-7f7ae451c000 r--p 00016000 fd:01 202647953
> /usr/lib64/libpthread-2.17.so
> 7f7ae451c000-7f7ae451d000 rw-p 00017000 fd:01 202647953
> /usr/lib64/libpthread-2.17.so
> 7f7ae451d000-7f7ae4521000 rw-p 00000000 00:00 0
> 7f7ae4521000-7f7ae4536000 r-xp 00000000 fd:01 219147257
> /usr/lib64/libgcc_s-4.8.5-20150702.so.1
> 7f7ae4536000-7f7ae4735000 ---p 00015000 fd:01 219147257
> /usr/lib64/libgcc_s-4.8.5-20150702.so.1
> 7f7ae4735000-7f7ae4736000 r--p 00014000 fd:01 219147257
> /usr/lib64/libgcc_s-4.8.5-20150702.so.1
> 7f7ae4736000-7f7ae4737000 rw-p 00015000 fd:01 219147257
> /usr/lib64/libgcc_s-4.8.5-20150702.so.1
> 7f7ae4737000-7f7ae4838000 r-xp 00000000 fd:01 201328059
> /usr/lib64/libm-2.17.so
> 7f7ae4838000-7f7ae4a37000 ---p 00101000 fd:01 201328059
> /usr/lib64/libm-2.17.so
> 7f7ae4a37000-7f7ae4a38000 r--p 00100000 fd:01 201328059
> /usr/lib64/libm-2.17.so
> 7f7ae4a38000-7f7ae4a39000 rw-p 00101000 fd:01 201328059
> /usr/lib64/libm-2.17.so
> 7f7ae4a39000-7f7ae4b22000 r-xp 00000000 fd:01 201328136
> /usr/lib64/libstdc++.so.6.0.19
> 7f7ae4b22000-7f7ae4d22000 ---p 000e9000 fd:01 201328136
> /usr/lib64/libstdc++.so.6.0.19
> 7f7ae4d22000-7f7ae4d2a000 r--p 000e9000 fd:01 201328136
> /usr/lib64/libstdc++.so.6.0.19
> 7f7ae4d2a000-7f7ae4d2c000 rw-p 000f1000 fd:01 201328136
> /usr/lib64/libstdc++.so.6.0.19
> 7f7ae4d2c000-7f7ae4d41000 rw-p 00000000 00:00 0
> 7f7ae4d41000-7f7ae4d48000 r-xp 00000000 fd:01 202647957
> /usr/lib64/librt-2.17.so
> 7f7ae4d48000-7f7ae4f47000 ---p 00007000 fd:01 202647957
> /usr/lib64/librt-2.17.so
> 7f7ae4f47000-7f7ae4f48000 r--p 00006000 fd:01 202647957
> /usr/lib64/librt-2.17.so
> 7f7ae4f48000-7f7ae4f49000 rw-p 00007000 fd:01 202647957
> /usr/lib64/librt-2.17.so
> 7f7ae4f49000-7f7ae4f4d000 r-xp 00000000 fd:01 201327752
> /usr/lib64/libSegFault.so
> 7f7ae4f4d000-7f7ae514c000 ---p 00004000 fd:01 201327752
> /usr/lib64/libSegFault.so
> 7f7ae514c000-7f7ae514d000 r--p 00003000 fd:01 201327752
> /usr/lib64/libSegFault.so
> 7f7ae514d000-7f7ae514e000 rw-p 00004000 fd:01 201327752
> /usr/lib64/libSegFault.so
> 7f7ae514e000-7f7ae5174000 r-xp 00000000 fd:01 202808298
> /usr/lib64/libtcmalloc_minimal.so.4.2.6
> 7f7ae5174000-7f7ae5374000 ---p 00026000 fd:01 202808298
> /usr/lib64/libtcmalloc_minimal.so.4.2.6
> 7f7ae5374000-7f7ae5375000 r--p 00026000 fd:01 202808298
> /usr/lib64/libtcmalloc_minimal.so.4.2.6
> 7f7ae5375000-7f7ae5376000 rw-p 00027000 fd:01 202808298
> /usr/lib64/libtcmalloc_minimal.so.4.2.6
> 7f7ae5376000-7f7ae539c000 rw-p 00000000 00:00 0
> 7f7ae539c000-7f7ae53ab000 r-xp 00000000 fd:01 201360080
> /usr/lib64/libbz2.so.1.0.6
> 7f7ae53ab000-7f7ae55aa000 ---p 0000f000 fd:01 201360080
> /usr/lib64/libbz2.so.1.0.6
> 7f7ae55aa000-7f7ae55ab000 r--p 0000e000 fd:01 201360080
> /usr/lib64/libbz2.so.1.0.6
> 7f7ae55ab000-7f7ae55ac000 rw-p 0000f000 fd:01 201360080
> /usr/lib64/libbz2.so.1.0.6
> 7f7ae55ac000-7f7ae55c1000 r-xp 00000000 fd:01 201327745
> /usr/lib64/libz.so.1.2.7
> 7f7ae55c1000-7f7ae57c0000 ---p 00015000 fd:01 201327745
> /usr/lib64/libz.so.1.2.7
> 7f7ae57c0000-7f7ae57c1000 r--p 00014000 fd:01 201327745
> /usr/lib64/libz.so.1.2.7
> 7f7ae57c1000-7f7ae57c2000 rw-p 00015000 fd:01 201327745
> /usr/lib64/libz.so.1.2.7
> 7f7ae57c2000-7f7ae57e3000 r-xp 00000000 fd:01 201327775
> /usr/lib64/ld-2.17.so
> 7f7ae59b9000-7f7ae59ba000 ---p 00000000 00:00 0
> 7f7ae59ba000-7f7ae59e3000 rw-p 00000000 00:00 0
> [stack:36125]
> 7f7ae59e3000-7f7ae59e4000 r--p 00021000 fd:01 201327775
> /usr/lib64/ld-2.17.so
> 7f7ae59e4000-7f7ae59e5000 rw-p 00022000 fd:01 201327775
> /usr/lib64/ld-2.17.so
> 7f7ae59e5000-7f7ae59e6000 rw-p 00000000 00:00 0
> 7ffc55ee1000-7ffc55f03000 rw-p 00000000 00:00 0
> [stack]
> 7ffc55fb5000-7ffc55fb7000 r-xp 00000000 00:00 0
> [vdso]
> ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
> [vsyscall]
> [2] 34958 segmentation fault /home/maba/bin/moses --server --config
> string-to-tree/moses.ini
>
>
> Any idea what's been going wrong? Thanks in advance.
>
> Cheers,
> Martin
>
> --
>
>
> *STAR Group* <http://www.star-group.net>
> <http://www.star-group.net/>
> *Martin Baumg?rtner*
>
>
> STAR Language Technology & Solutions GmbH
> Umberto-Nobile-Stra?e 19 | 71063 Sindelfingen | Germany
> Tel. +49 70 31-4 10 92-0 <martin.baumgaertner@star-group.net>
> martin.baumgaertner@star-group.net
> Fax +49 70 31-4 10 92-70 www.star-group.net
> Gesch?ftsf?hrer: Oliver Rau, Bernd Barth
> Handelsregister Stuttgart HRB 245654 | St.-Nr. 56098/11677
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Ulrich Germann
Senior Researcher
School of Informatics
University of Edinburgh
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160128/20420d9b/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: iegfgahg.gif
Type: image/gif
Size: 8030 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20160128/20420d9b/attachment.gif

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 111, Issue 80
**********************************************

Tweet