Moses-support Digest, Vol 107, Issue 44

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Segfault when testing ./evaluator (Nicholas Ruiz)
2. Re: Segfault when testing ./evaluator (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 17 Sep 2015 18:05:16 +0200
From: Nicholas Ruiz <nicruiz@fbk.eu>
Subject: [Moses-support] Segfault when testing ./evaluator
To: moses-support@mit.edu
Message-ID:
<CAKa+0YPBfiS6Av1=AtrE6hgzEg+pzZExFAo=aDMvA7WeJqCy4Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi guys,

I'm writing a new scorer for MERT, but first I wanted to test evaluator.cpp
with BLEU before going further. I'm using the HEAD version of Moses, with
the smoke test data included in the following directory:
mosesdecoder/mert/example

Here's my dump

../evaluator --sctype BLEU --scconfig reflen:closest --nbest NBEST
--reference REF

name: reflen value: closest
*** Segmentation fault
Register dump:

RAX: 0000000000000000 RBX: 0000000000000098 RCX: 00000000004b52f0
RDX: 0000000000000000 RSI: 00007ffd3f8f5ab0 RDI: 0000000000000098
RBP: 0000000000000000 R8 : 0000000000825700 R9 : 00000000004b4da0
R10: 0000000000000006 R11: 00000031656bb350 R12: 00000000008256e0
R13: 00007ffd3f8f5b20 R14: 0000000000000001 R15: 00007ffd3f8f5ab0
RSP: 00007ffd3f8f5a30

RIP: 000000316569d4e8 EFLAGS: 00010206

CS: 0033 FS: 0000 GS: 0000

Trap: 0000000e Error: 00000004 OldMask: 00000000 CR2: 00000098

FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000
RIP: 00000000 RDP: 00000000

ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000
ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000
ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000
ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000
mxcsr: 1f80
XMM0: 00000000000000000000000000000000 XMM1:
00000000000000000000000000000000
XMM2: 00000000000000000000000000000000 XMM3:
00000000000000000000000000000000
XMM4: 00000000000000000000000000000000 XMM5:
00000000000000000000000000000000
XMM6: 00000000000000000000000000000000 XMM7:
00000000000000000000000000000000
XMM8: 00000000000000000000000000000000 XMM9:
00000000000000000000000000000000
XMM10: 00000000000000000000000000000000 XMM11:
00000000000000000000000000000000
XMM12: 00000000000000000000000000000000 XMM13:
00000000000000000000000000000000
XMM14: 00000000000000000000000000000000 XMM15:
00000000000000000000000000000000

Backtrace:
/usr/lib64/libstdc++.so.6(_ZNSs6assignERKSs+0x8)[0x316569d4e8]
../evaluator[0x409e93]
/lib64/libc.so.6(__libc_start_main+0xfd)[0x315e21ed5d]
../evaluator[0x406dc9]

Memory map:

00400000-004f3000 r-xp 00000000 08:03 26378541
/hardmnt/malet0/home/nicruiz/GitHub/mosesdecoder/mert/evaluator
006f3000-006f4000 rw-p 000f3000 08:03 26378541
/hardmnt/malet0/home/nicruiz/GitHub/mosesdecoder/mert/evaluator
006f4000-006f5000 rw-p 00000000 00:00 0
00825000-00846000 rw-p 00000000 00:00 0
[heap]
315de00000-315de20000 r-xp 00000000 08:01 261137
/lib64/ld-2.12.so
315e01f000-315e020000 r--p 0001f000 08:01 261137
/lib64/ld-2.12.so
315e020000-315e021000 rw-p 00020000 08:01 261137
/lib64/ld-2.12.so
315e021000-315e022000 rw-p 00000000 00:00 0
315e200000-315e38a000 r-xp 00000000 08:01 261148
/lib64/libc-2.12.so
315e38a000-315e58a000 ---p 0018a000 08:01 261148
/lib64/libc-2.12.so
315e58a000-315e58e000 r--p 0018a000 08:01 261148
/lib64/libc-2.12.so
315e58e000-315e58f000 rw-p 0018e000 08:01 261148
/lib64/libc-2.12.so
315e58f000-315e594000 rw-p 00000000 00:00 0
315e600000-315e617000 r-xp 00000000 08:01 261338
/lib64/libpthread-2.12.so
315e617000-315e817000 ---p 00017000 08:01 261338
/lib64/libpthread-2.12.so
315e817000-315e818000 r--p 00017000 08:01 261338
/lib64/libpthread-2.12.so
315e818000-315e819000 rw-p 00018000 08:01 261338
/lib64/libpthread-2.12.so
315e819000-315e81d000 rw-p 00000000 00:00 0
315ee00000-315ee83000 r-xp 00000000 08:01 261314
/lib64/libm-2.12.so
315ee83000-315f082000 ---p 00083000 08:01 261314
/lib64/libm-2.12.so
315f082000-315f083000 r--p 00082000 08:01 261314
/lib64/libm-2.12.so
315f083000-315f084000 rw-p 00083000 08:01 261314
/lib64/libm-2.12.so
315f200000-315f215000 r-xp 00000000 08:01 261315
/lib64/libz.so.1.2.3
315f215000-315f414000 ---p 00015000 08:01 261315
/lib64/libz.so.1.2.3
315f414000-315f415000 r--p 00014000 08:01 261315
/lib64/libz.so.1.2.3
315f415000-315f416000 rw-p 00015000 08:01 261315
/lib64/libz.so.1.2.3
315f600000-315f607000 r-xp 00000000 08:01 263269
/lib64/librt-2.12.so
315f607000-315f806000 ---p 00007000 08:01 263269
/lib64/librt-2.12.so
315f806000-315f807000 r--p 00006000 08:01 263269
/lib64/librt-2.12.so
315f807000-315f808000 rw-p 00007000 08:01 263269
/lib64/librt-2.12.so
3165200000-3165216000 r-xp 00000000 08:01 261336
/lib64/libgcc_s-4.4.7-20120601.so.1
3165216000-3165415000 ---p 00016000 08:01 261336
/lib64/libgcc_s-4.4.7-20120601.so.1
3165415000-3165416000 rw-p 00015000 08:01 261336
/lib64/libgcc_s-4.4.7-20120601.so.1
3165600000-31656e8000 r-xp 00000000 08:01 657082
/usr/lib64/libstdc++.so.6.0.13
31656e8000-31658e8000 ---p 000e8000 08:01 657082
/usr/lib64/libstdc++.so.6.0.13
31658e8000-31658ef000 r--p 000e8000 08:01 657082
/usr/lib64/libstdc++.so.6.0.13
31658ef000-31658f1000 rw-p 000ef000 08:01 657082
/usr/lib64/libstdc++.so.6.0.13
31658f1000-3165906000 rw-p 00000000 00:00 0
316be00000-316be10000 r-xp 00000000 08:01 263184
/lib64/libbz2.so.1.0.4
316be10000-316c00f000 ---p 00010000 08:01 263184
/lib64/libbz2.so.1.0.4
316c00f000-316c011000 rw-p 0000f000 08:01 263184
/lib64/libbz2.so.1.0.4
316d600000-316d620000 r-xp 00000000 08:01 663920
/usr/lib64/liblzma.so.0.0.0
316d620000-316d820000 ---p 00020000 08:01 663920
/usr/lib64/liblzma.so.0.0.0
316d820000-316d821000 rw-p 00020000 08:01 663920
/usr/lib64/liblzma.so.0.0.0
7fe3147f9000-7fe314800000 rw-p 00000000 00:00 0
7fe314800000-7fe314804000 r-xp 00000000 08:01 261305
/lib64/libSegFault.so
7fe314804000-7fe314a03000 ---p 00004000 08:01 261305
/lib64/libSegFault.so
7fe314a03000-7fe314a04000 r--p 00003000 08:01 261305
/lib64/libSegFault.so
7fe314a04000-7fe314a05000 rw-p 00004000 08:01 261305
/lib64/libSegFault.so
7fe314a05000-7fe314a06000 rw-p 00000000 00:00 0
7fe314a2c000-7fe314a2d000 rw-p 00000000 00:00 0
7ffd3f8e3000-7ffd3f8f9000 rw-p 00000000 00:00 0
[stack]
7ffd3f9c1000-7ffd3f9c2000 r-xp 00000000 00:00 0
[vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
[vsyscall]
evaluator.sh: line 13: 7235 Segmentation fault (core dumped)
$evaluator --sctype BLEU --scconfig reflen:closest --nbest NBEST
--reference REF

I don't work with this codebase very often. Do you have any suggestions
about how to resolve the issue?

I have no compilation issues with bjam. My compilation script is pretty
vanilla.
./bjam -j4 --with-boost=/home/nicruiz/software/boost_1_55_0

Thanks,
Nick Ruiz
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150917/5a7a15e0/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 18 Sep 2015 08:49:16 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Segfault when testing ./evaluator
To: Nicholas Ruiz <nicruiz@fbk.eu>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbijEfHDi4Q=fP9M70ksLzV1GbWsMjvM1wO59n1wSgHQAA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

i don't know the code for this program either, but this is how
mert-moses.perl runs the evaluator program:
.../evaluator --reference
/home/hh65/workspace/experiment/wmt15/en-fi/tuning/reference.lc.2 --sctype
BLEU --scconfig case:true --nbest run1.best100.out.gz

Hieu Hoang
http://www.hoang.co.uk/hieu

On 17 September 2015 at 17:05, Nicholas Ruiz <nicruiz@fbk.eu> wrote:

> Hi guys,
>
> I'm writing a new scorer for MERT, but first I wanted to test
> evaluator.cpp with BLEU before going further. I'm using the HEAD version of
> Moses, with the smoke test data included in the following directory:
> mosesdecoder/mert/example
>
> Here's my dump
>
> ../evaluator --sctype BLEU --scconfig reflen:closest --nbest NBEST
> --reference REF
>
> name: reflen value: closest
> *** Segmentation fault
> Register dump:
>
> RAX: 0000000000000000 RBX: 0000000000000098 RCX: 00000000004b52f0
> RDX: 0000000000000000 RSI: 00007ffd3f8f5ab0 RDI: 0000000000000098
> RBP: 0000000000000000 R8 : 0000000000825700 R9 : 00000000004b4da0
> R10: 0000000000000006 R11: 00000031656bb350 R12: 00000000008256e0
> R13: 00007ffd3f8f5b20 R14: 0000000000000001 R15: 00007ffd3f8f5ab0
> RSP: 00007ffd3f8f5a30
>
> RIP: 000000316569d4e8 EFLAGS: 00010206
>
> CS: 0033 FS: 0000 GS: 0000
>
> Trap: 0000000e Error: 00000004 OldMask: 00000000 CR2: 00000098
>
> FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000
> RIP: 00000000 RDP: 00000000
>
> ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000
> ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000
> ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000
> ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000
> mxcsr: 1f80
> XMM0: 00000000000000000000000000000000 XMM1:
> 00000000000000000000000000000000
> XMM2: 00000000000000000000000000000000 XMM3:
> 00000000000000000000000000000000
> XMM4: 00000000000000000000000000000000 XMM5:
> 00000000000000000000000000000000
> XMM6: 00000000000000000000000000000000 XMM7:
> 00000000000000000000000000000000
> XMM8: 00000000000000000000000000000000 XMM9:
> 00000000000000000000000000000000
> XMM10: 00000000000000000000000000000000 XMM11:
> 00000000000000000000000000000000
> XMM12: 00000000000000000000000000000000 XMM13:
> 00000000000000000000000000000000
> XMM14: 00000000000000000000000000000000 XMM15:
> 00000000000000000000000000000000
>
> Backtrace:
> /usr/lib64/libstdc++.so.6(_ZNSs6assignERKSs+0x8)[0x316569d4e8]
> ../evaluator[0x409e93]
> /lib64/libc.so.6(__libc_start_main+0xfd)[0x315e21ed5d]
> ../evaluator[0x406dc9]
>
> Memory map:
>
> 00400000-004f3000 r-xp 00000000 08:03 26378541
> /hardmnt/malet0/home/nicruiz/GitHub/mosesdecoder/mert/evaluator
> 006f3000-006f4000 rw-p 000f3000 08:03 26378541
> /hardmnt/malet0/home/nicruiz/GitHub/mosesdecoder/mert/evaluator
> 006f4000-006f5000 rw-p 00000000 00:00 0
> 00825000-00846000 rw-p 00000000 00:00 0
> [heap]
> 315de00000-315de20000 r-xp 00000000 08:01 261137
> /lib64/ld-2.12.so
> 315e01f000-315e020000 r--p 0001f000 08:01 261137
> /lib64/ld-2.12.so
> 315e020000-315e021000 rw-p 00020000 08:01 261137
> /lib64/ld-2.12.so
> 315e021000-315e022000 rw-p 00000000 00:00 0
> 315e200000-315e38a000 r-xp 00000000 08:01 261148
> /lib64/libc-2.12.so
> 315e38a000-315e58a000 ---p 0018a000 08:01 261148
> /lib64/libc-2.12.so
> 315e58a000-315e58e000 r--p 0018a000 08:01 261148
> /lib64/libc-2.12.so
> 315e58e000-315e58f000 rw-p 0018e000 08:01 261148
> /lib64/libc-2.12.so
> 315e58f000-315e594000 rw-p 00000000 00:00 0
> 315e600000-315e617000 r-xp 00000000 08:01 261338
> /lib64/libpthread-2.12.so
> 315e617000-315e817000 ---p 00017000 08:01 261338
> /lib64/libpthread-2.12.so
> 315e817000-315e818000 r--p 00017000 08:01 261338
> /lib64/libpthread-2.12.so
> 315e818000-315e819000 rw-p 00018000 08:01 261338
> /lib64/libpthread-2.12.so
> 315e819000-315e81d000 rw-p 00000000 00:00 0
> 315ee00000-315ee83000 r-xp 00000000 08:01 261314
> /lib64/libm-2.12.so
> 315ee83000-315f082000 ---p 00083000 08:01 261314
> /lib64/libm-2.12.so
> 315f082000-315f083000 r--p 00082000 08:01 261314
> /lib64/libm-2.12.so
> 315f083000-315f084000 rw-p 00083000 08:01 261314
> /lib64/libm-2.12.so
> 315f200000-315f215000 r-xp 00000000 08:01 261315
> /lib64/libz.so.1.2.3
> 315f215000-315f414000 ---p 00015000 08:01 261315
> /lib64/libz.so.1.2.3
> 315f414000-315f415000 r--p 00014000 08:01 261315
> /lib64/libz.so.1.2.3
> 315f415000-315f416000 rw-p 00015000 08:01 261315
> /lib64/libz.so.1.2.3
> 315f600000-315f607000 r-xp 00000000 08:01 263269
> /lib64/librt-2.12.so
> 315f607000-315f806000 ---p 00007000 08:01 263269
> /lib64/librt-2.12.so
> 315f806000-315f807000 r--p 00006000 08:01 263269
> /lib64/librt-2.12.so
> 315f807000-315f808000 rw-p 00007000 08:01 263269
> /lib64/librt-2.12.so
> 3165200000-3165216000 r-xp 00000000 08:01 261336
> /lib64/libgcc_s-4.4.7-20120601.so.1
> 3165216000-3165415000 ---p 00016000 08:01 261336
> /lib64/libgcc_s-4.4.7-20120601.so.1
> 3165415000-3165416000 rw-p 00015000 08:01 261336
> /lib64/libgcc_s-4.4.7-20120601.so.1
> 3165600000-31656e8000 r-xp 00000000 08:01 657082
> /usr/lib64/libstdc++.so.6.0.13
> 31656e8000-31658e8000 ---p 000e8000 08:01 657082
> /usr/lib64/libstdc++.so.6.0.13
> 31658e8000-31658ef000 r--p 000e8000 08:01 657082
> /usr/lib64/libstdc++.so.6.0.13
> 31658ef000-31658f1000 rw-p 000ef000 08:01 657082
> /usr/lib64/libstdc++.so.6.0.13
> 31658f1000-3165906000 rw-p 00000000 00:00 0
> 316be00000-316be10000 r-xp 00000000 08:01 263184
> /lib64/libbz2.so.1.0.4
> 316be10000-316c00f000 ---p 00010000 08:01 263184
> /lib64/libbz2.so.1.0.4
> 316c00f000-316c011000 rw-p 0000f000 08:01 263184
> /lib64/libbz2.so.1.0.4
> 316d600000-316d620000 r-xp 00000000 08:01 663920
> /usr/lib64/liblzma.so.0.0.0
> 316d620000-316d820000 ---p 00020000 08:01 663920
> /usr/lib64/liblzma.so.0.0.0
> 316d820000-316d821000 rw-p 00020000 08:01 663920
> /usr/lib64/liblzma.so.0.0.0
> 7fe3147f9000-7fe314800000 rw-p 00000000 00:00 0
> 7fe314800000-7fe314804000 r-xp 00000000 08:01 261305
> /lib64/libSegFault.so
> 7fe314804000-7fe314a03000 ---p 00004000 08:01 261305
> /lib64/libSegFault.so
> 7fe314a03000-7fe314a04000 r--p 00003000 08:01 261305
> /lib64/libSegFault.so
> 7fe314a04000-7fe314a05000 rw-p 00004000 08:01 261305
> /lib64/libSegFault.so
> 7fe314a05000-7fe314a06000 rw-p 00000000 00:00 0
> 7fe314a2c000-7fe314a2d000 rw-p 00000000 00:00 0
> 7ffd3f8e3000-7ffd3f8f9000 rw-p 00000000 00:00 0
> [stack]
> 7ffd3f9c1000-7ffd3f9c2000 r-xp 00000000 00:00 0
> [vdso]
> ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
> [vsyscall]
> evaluator.sh: line 13: 7235 Segmentation fault (core dumped)
> $evaluator --sctype BLEU --scconfig reflen:closest --nbest NBEST
> --reference REF
>
> I don't work with this codebase very often. Do you have any suggestions
> about how to resolve the issue?
>
> I have no compilation issues with bjam. My compilation script is pretty
> vanilla.
> ./bjam -j4 --with-boost=/home/nicruiz/software/boost_1_55_0
>
> Thanks,
> Nick Ruiz
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150918/cf7032d6/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 107, Issue 44
**********************************************

Related Posts :

0 Response to "Moses-support Digest, Vol 107, Issue 44"

Post a Comment