Home » Uncategories » Moses-support Digest, Vol 109, Issue 36

Moses-support Digest, Vol 109, Issue 36

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: use placeholder with mosesserver (Vito Mandorino)


----------------------------------------------------------------------

Message: 1
Date: Tue, 17 Nov 2015 17:55:19 +0100
From: Vito Mandorino <vito.mandorino@linguacustodia.com>
Subject: Re: [Moses-support] use placeholder with mosesserver
To: Vito Mandorino <vito.mandorino@linguacustodia.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CA+8mSmF5oDOMyFEeP1nUisjx4=-Nvn62W5kwdROUTnfWtfymbg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Sorry, attachment forgotten in the previous message.
----

Hi,

thanks for the fixes and modifications. Actually we have compiled the Moses
taken from the master branch but get an error with mosesserver. More
precisely,

/mosesdecoder/bin/moses -f moses.ini

works fine, but both commands

/mosesdecoder/bin/mosesserver -f moses.ini --server-port 8080
/mosesdecoder/bin/moses --server -f moses.ini --server-port 8080

give a Segmentation Fault error. More details are in the attached log.txt
file.
What could have possibly gone wrong ?

Vito

2015-11-17 17:53 GMT+01:00 Vito Mandorino <vito.mandorino@linguacustodia.com
>:

> Hi,
>
> thanks for the fixes and modifications. Actually we have compiled the
> Moses taken from the master branch but get an error with mosesserver. More
> precisely,
>
> /mosesdecoder/bin/moses -f moses.ini
>
> works fine, but both commands
>
> /mosesdecoder/bin/mosesserver -f moses.ini --server-port 8080
> /mosesdecoder/bin/moses --server -f moses.ini --server-port 8080
>
> give a Segmentation Fault error. More details are in the attached log.txt
> file.
> What could have possibly gone wrong ?
>
> Vito
>
>
> 2015-11-17 15:43 GMT+01:00 Evgeny Matusov <ematusov@apptek.com>:
>
>> Hi active Moses developers,
>>
>>
>> As promised, I am working on adding the correct placeholder output to
>> Moses in the server mode. Currently, passing the n-best size through xmlrpc
>> is commented out. Any reason why this is the case? It might be convenient
>> to run server queries with/without N-best output and with different N-best
>> sizes without having to restart the server (currently, this is the only way
>> to do it).
>>
>>
>> If there are no objections, I will put this parameter back into the code.
>>
>>
>> Best,
>>
>> Evgeny.
>>
>>
>> ------------------------------
>> *From:* Evgeny Matusov
>> *Sent:* Wednesday, November 11, 2015 10:30 AM
>> *To:* ugermann@inf.ed.ac.uk
>>
>> *Cc:* moses-support@mit.edu
>> *Subject:* Re: [Moses-support] use placeholder with mosesserver
>>
>>
>> Hi Uli,
>>
>>
>> thanks a lot! We will try to add some test cases for Mosesserver,
>> including XML input with/without placeholders.
>>
>>
>> Best,
>>
>> Evgeny.
>>
>>
>> ------------------------------
>> *From:* Ulrich Germann <ulrich.germann@gmail.com>
>> *Sent:* Wednesday, November 11, 2015 2:58 AM
>> *To:* Evgeny Matusov
>> *Cc:* moses-support@mit.edu
>> *Subject:* Re: [Moses-support] use placeholder with mosesserver
>>
>> Hi all,
>>
>> I've just pushed what I believe might address a few of the issues in this
>> thread:
>>
>> - the more fine-grained configuration options for request handling and
>> queuing, server timeouts etc. (added in August due to threading issue) have
>> been transferred to the main moses executable.
>>
>> - the server now pays attention to the xml-input option specified via
>> json; the range of accepted values is the same as when specified on the
>> command line. I have not written the xml-input handling and do not actively
>> use it, so it may or may not work. I don't think there are any regression
>> tests that test this right now. Reports from the trenches are welcome.
>>
>> - mosesserver.cpp is deprecated. It is now merely a shell around the
>> regular moses call with --server. I did not remove it from the code base
>> entirely, as I assume that there's a plethora of setups out there that rely
>> on the existence of mosesserver. What the wrapper does is add --server to
>> the options and then call run regular moses.
>>
>> - anyone adding stuff to mosesserver.cpp from now on owes me a lifetime
>> supply of the finest Laphroaig. Just send me a quarter cask every year for
>> Burns Nicht for the rest of my life if you do. If I haven't pushed anything
>> for two years, you may assume I'm dead.
>>
>>
>> - Uli
>>
>> On Tue, Nov 10, 2015 at 2:58 PM, Ulrich Germann <ulrich.germann@gmail.com
>> > wrote:
>>
>>> Hi all,
>>>
>>> mosesserver is deprecated and should not be used any more. I'll transfer
>>> the threading-related changes to the server implementation in the regular
>>> moses executable and let you know once I'm done so that other things (like
>>> passthrough) can be added. By the looks of it, the changes are fairly
>>> straightforward, so it shouldn't take long. However, I can't guarantee that
>>> the new server will do everything the old server did, (or do it the same
>>> way).
>>>
>>> It would be fantastic if a few people could design and contribute test
>>> cases so that we can do some regression testing for the server. Ideally a
>>> test case should provide:
>>>
>>> - tiny models to work with (or we may be able to recycle some that
>>> already exist)
>>> - sample input (json)
>>> - expected output (json)
>>>
>>> Cheers - Uli
>>>
>>>
>>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> *M**. Vito MANDORINO -- Chief Scientist*
>
>
> [image: Description : Description : lingua_custodia_final full logo]
>
> *The Translation Trustee*
>
> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>
> *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89
> <%2B33%206%2084%2065%2068%2089>*
>
> *Email :* *vito.mandorino@linguacustodia.com
> <massinissa.ahmim@linguacustodia.com>*
>
> *Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
> www.thetranslationtrustee.com <http://www.thetranslationtrustee.com/>*
>



--
*M**. Vito MANDORINO -- Chief Scientist*


[image: Description : Description : lingua_custodia_final full logo]

*The Translation Trustee*

*1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89*

*Email :* *vito.mandorino@linguacustodia.com
<massinissa.ahmim@linguacustodia.com>*

*Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
www.thetranslationtrustee.com <http://www.thetranslationtrustee.com/>*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151117/a09cd5ad/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20151117/a09cd5ad/attachment.jpg
-------------- next part --------------
Defined parameters (per moses.ini or switch):
config: /home/Moses/CARTOUCHES/train-cart-MDM-frit/train/model/moses.ini.BAK
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryMemory name=TranslationModel0 num-features=4 path=/home/Moses/CARTOUCHES/train-cart-MDM-frit/train/model/phrase-table.gz input-factor=0 output-factor=0 table-limit=20 Distortion
input-factors: 0
mapping: 0 T 0
server:
server-port: 8080
weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2 TranslationModel0= 0.2 0.2 0.2 0.2 Distortion0= 0.3
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryMemory name=TranslationModel0 num-features=4 path=/home/Moses/CARTOUCHES/train-cart-MDM-frit/train/model/phrase-table.gz input-factor=0 output-factor=0 table-limit=20
FeatureFunction: TranslationModel0 start: 3 end: 6
line=Distortion
FeatureFunction: Distortion0 start: 7 end: 7
Loading UnknownWordPenalty0
Loading WordPenalty0
Loading PhrasePenalty0
Loading Distortion0
Loading TranslationModel0
Start loading text phrase table. Moses format : [0.001] seconds
Reading /home/Moses/CARTOUCHES/train-cart-MDM-frit/train/model/phrase-table.gz
----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
****************************************************************************************************
*** Segmentation fault
Register dump:

RAX: 0000000000000053 RBX: 0000000070abe948 RCX: 0000000000000006
RDX: 0000000000000003 RSI: 00000000008d04f0 RDI: 0000000000000024
RBP: 0000000000000024 R8 : 0000000000000003 R9 : 0000000000000048
R10: 00007fff6d6d9a10 R11: 00007f794c2679a0 R12: 0000000000000003
R13: 0000000000000000 R14: 0000000000000024 R15: 00007fff6d6da0a8
RSP: 00007fff6d6d9c48

RIP: 00007f794b76b8c4 EFLAGS: 00010202

CS: 0033 FS: 0000 GS: 0000

Trap: 0000000e Error: 00000006 OldMask: 00000000 CR2: 00000024

FPUCW: 0000037f FPUSW: 00000000 TAG: 00000000
RIP: 00000000 RDP: 00000000

ST(0) 0000 0000000000000000 ST(1) 0000 0000000000000000
ST(2) 0000 0000000000000000 ST(3) 0000 0000000000000000
ST(4) 0000 0000000000000000 ST(5) 0000 0000000000000000
ST(6) 0000 0000000000000000 ST(7) 0000 0000000000000000
mxcsr: 1fa4
XMM0: 000000000000000000000000ffff0000 XMM1: 000000000000000000000000ffff0000
XMM2: 000000000000000000000000ffff0000 XMM3: 000000000000000000000000ffff0000
XMM4: 000000000000000000000000ffff0000 XMM5: 000000000000000000000000ffff0000
XMM6: 000000000000000000000000ffff0000 XMM7: 000000000000000000000000ffff0000
XMM8: 000000000000000000000000ffff0000 XMM9: 000000000000000000000000ffff0000
XMM10: 000000000000000000000000ffff0000 XMM11: 000000000000000000000000ffff0000
XMM12: 000000000000000000000000ffff0000 XMM13: 000000000000000000000000ffff0000
XMM14: 000000000000000000000000ffff0000 XMM15: 000000000000000000000000ffff0000

Backtrace:
/lib/x86_64-linux-gnu/libc.so.6(+0x908c4)[0x7f794b76b8c4]
/usr/lib/x86_64-linux-gnu/libstdc++.so.6(_ZNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEE10_M_replaceEmmPKcm+0xb8)[0x7f794c2d1858]
/home/Bailo/moses/mosesdecoder/bin/moses[0x6f4d5e]
/home/Bailo/moses/mosesdecoder/bin/moses[0x4a7a43]
/home/Bailo/moses/mosesdecoder/bin/moses[0x41a42f]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0x7f794b6fcb45]
/home/Bailo/moses/mosesdecoder/bin/moses[0x414237]

Memory map:

00400000-009da000 r-xp 00000000 08:05 159910732 /home/Bailo/moses/mosesdecoder/bin/moses
00bda000-00bdd000 rw-p 005da000 08:05 159910732 /home/Bailo/moses/mosesdecoder/bin/moses
00bdd000-00bdf000 rw-p 00000000 00:00 0
0174d000-8105e000 rw-p 00000000 00:00 0 [heap]
7f794b65a000-7f794b6db000 rw-p 00000000 00:00 0
7f794b6db000-7f794b87a000 r-xp 00000000 08:03 19923542 /lib/x86_64-linux-gnu/libc-2.19.so
7f794b87a000-7f794ba7a000 ---p 0019f000 08:03 19923542 /lib/x86_64-linux-gnu/libc-2.19.so
7f794ba7a000-7f794ba7e000 r--p 0019f000 08:03 19923542 /lib/x86_64-linux-gnu/libc-2.19.so
7f794ba7e000-7f794ba80000 rw-p 001a3000 08:03 19923542 /lib/x86_64-linux-gnu/libc-2.19.so
7f794ba80000-7f794ba84000 rw-p 00000000 00:00 0
7f794ba84000-7f794ba9c000 r-xp 00000000 08:03 19923409 /lib/x86_64-linux-gnu/libpthread-2.19.so
7f794ba9c000-7f794bc9b000 ---p 00018000 08:03 19923409 /lib/x86_64-linux-gnu/libpthread-2.19.so
7f794bc9b000-7f794bc9c000 r--p 00017000 08:03 19923409 /lib/x86_64-linux-gnu/libpthread-2.19.so
7f794bc9c000-7f794bc9d000 rw-p 00018000 08:03 19923409 /lib/x86_64-linux-gnu/libpthread-2.19.so
7f794bc9d000-7f794bca1000 rw-p 00000000 00:00 0
7f794bca1000-7f794bcb7000 r-xp 00000000 08:03 19922947 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f794bcb7000-7f794beb6000 ---p 00016000 08:03 19922947 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f794beb6000-7f794beb7000 rw-p 00015000 08:03 19922947 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f794beb7000-7f794bfb7000 r-xp 00000000 08:03 19923449 /lib/x86_64-linux-gnu/libm-2.19.so
7f794bfb7000-7f794c1b6000 ---p 00100000 08:03 19923449 /lib/x86_64-linux-gnu/libm-2.19.so
7f794c1b6000-7f794c1b7000 r--p 000ff000 08:03 19923449 /lib/x86_64-linux-gnu/libm-2.19.so
7f794c1b7000-7f794c1b8000 rw-p 00100000 08:03 19923449 /lib/x86_64-linux-gnu/libm-2.19.so
7f794c1b8000-7f794c323000 r-xp 00000000 08:03 2624494 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7f794c323000-7f794c523000 ---p 0016b000 08:03 2624494 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7f794c523000-7f794c52d000 r--p 0016b000 08:03 2624494 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7f794c52d000-7f794c52f000 rw-p 00175000 08:03 2624494 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7f794c52f000-7f794c533000 rw-p 00000000 00:00 0
7f794c533000-7f794c53a000 r-xp 00000000 08:03 19923410 /lib/x86_64-linux-gnu/librt-2.19.so
7f794c53a000-7f794c739000 ---p 00007000 08:03 19923410 /lib/x86_64-linux-gnu/librt-2.19.so
7f794c739000-7f794c73a000 r--p 00006000 08:03 19923410 /lib/x86_64-linux-gnu/librt-2.19.so
7f794c73a000-7f794c73b000 rw-p 00007000 08:03 19923410 /lib/x86_64-linux-gnu/librt-2.19.so
7f794c73b000-7f794c73f000 r-xp 00000000 08:03 19923357 /lib/x86_64-linux-gnu/libSegFault.so
7f794c73f000-7f794c93e000 ---p 00004000 08:03 19923357 /lib/x86_64-linux-gnu/libSegFault.so
7f794c93e000-7f794c93f000 r--p 00003000 08:03 19923357 /lib/x86_64-linux-gnu/libSegFault.so
7f794c93f000-7f794c940000 rw-p 00004000 08:03 19923357 /lib/x86_64-linux-gnu/libSegFault.so
7f794c940000-7f794c960000 r-xp 00000000 08:03 19923161 /lib/x86_64-linux-gnu/ld-2.19.so
7f794c9b8000-7f794ca39000 rw-p 00000000 00:00 0
7f794cb3b000-7f794cb41000 rw-p 00000000 00:00 0
7f794cb5e000-7f794cb60000 rw-p 00000000 00:00 0
7f794cb60000-7f794cb61000 r--p 00020000 08:03 19923161 /lib/x86_64-linux-gnu/ld-2.19.so
7f794cb61000-7f794cb62000 rw-p 00021000 08:03 19923161 /lib/x86_64-linux-gnu/ld-2.19.so
7f794cb62000-7f794cb63000 rw-p 00000000 00:00 0
7fff6d6ba000-7fff6d6db000 rw-p 00000000 00:00 0 [stack]
7fff6d7a7000-7fff6d7a9000 r--p 00000000 00:00 0 [vvar]
7fff6d7a9000-7fff6d7ab000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
Segmentation fault

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 109, Issue 36
**********************************************

0 Response to "Moses-support Digest, Vol 109, Issue 36"

Post a Comment

Subscribe to: Post Comments (Atom)