Home » Uncategories » Moses-support Digest, Vol 113, Issue 73

Moses-support Digest, Vol 113, Issue 73

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. mkcls fault (Tom Hoar)
2. Moses Server index.js 500 internal error (faiza shahid)


----------------------------------------------------------------------

Message: 1
Date: Tue, 29 Mar 2016 20:13:12 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: [Moses-support] mkcls fault
To: moses-support@mit.edu
Message-ID: <56FA7F68.5080806@precisiontranslationtools.com>
Content-Type: text/plain; charset="utf-8"

I think (M)GIZA++ expertise has faded over the years, but I'm hoping
someone has some ideas about this.

A user start training with an extremely small TMX file with a few dozen
of parallel segments. Our preparation tools reduced the parallel corpus
to only 2 pairs (attached). The user was running the Windows version
(mkcls.exe) but we verified the same error on Linux. The
train-model.perl script failed in step 1 (log also attached).
Specifically, the mkcls binary failed with this error message:

Assertion failed!
File: src/mkcls/StatVar.cpp, Line 110
Expression: index>=0&&index<n

I've never seen this error with a respectable corpus size. So, I did
some tests.

* test 1, copy same sentences 14,500 times, got assertion (failed).
* test 2, copy each of the pairs only 7,250 times, got assertion (failed).
* test 3, added 4,000 unique pairs, no assertion (success).
* test 4, reduced to 2 original + 3 new pairs, no assertion (success).
* test 5, reduced to 2 original + 2 new pairs, assertion returned
(failed).

It seems this assertion is linked to lack of variety in the training
corpus. Can anyone confirm this observation? Has anyone ever experienced
this error?

If no one's seen this with a larger corpus, a terminal failure due to
lack of variety is probably good. Would it be accurate if we add an
error message to the effect, "terminal error due to insufficient variety
in the training corpus"?

Thanks for any ideas/suggestions.
Tom


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160329/a2cf17b0/attachment-0001.html
-------------- next part --------------
***** STEP 1 **************************************************************
COMMAND LINE:
C:\Strawberry\perl\bin\perl.exe -w C:\Users\tahoar\workbench\slate-toolkit\scripts\training\train-model.perl ^
--root-dir C:\Users\tahoar\workbench\slate-desktop\var\TRAININGS\smt-tm-de_de-en_us-DANIEL ^
--e de_de ^
--do-steps 1 ^
--f en_us ^
--mgiza ^
--config C:\Users\tahoar\workbench\slate-desktop\var\TRAININGS\smt-tm-de_de-en_us-DANIEL\model.giza.grow-diag-final-and\moses.7.en_us-de_de.ini ^
--lm 0:11111:C:\placeholder.lm:9 ^
--external-bin-dir C:\Users\tahoar\workbench\slate-toolkit\bin ^
--max-phrase-length 7 ^
--temp-dir c:\users\tahoar\appdata\local\temp\Slate_Desktop-7288\train-tm-0\trainer,train,210,1,train-tm\1 ^
--continue ^
--reordering msd-bidirectional-fe ^
--cores 7 ^
--corpus C:\Users\tahoar\workbench\slate-desktop\var\TRAININGS\smt-tm-de_de-en_us-DANIEL\bitext ^
--mgiza-cpus 7 ^
--alignment grow-diag-final-and
Using SCRIPTS_ROOTDIR: C:\Users\tahoar\workbench\slate-toolkit\scripts
Using: $SPLIT_EXEC ="split.exe"
Using: $SORT_EXEC="sort.exe"
Using: $GZIP_EXEC="gzip.exe -q"
Using: $GUNZIP_EXEC="gzip.exe -q -d"
Using: $BZCAT_EXEC="bzcat.exe -q -d -c"
Using: $ZCAT_EXEC="gzip.exe -q -d -c"
Using: $CAT_EXEC="type"
Using DEBUG: 0
(1) preparing corpus @ Fri Mar 25 21:20:09 +0700 2016
(1.0) selecting factors @ Fri Mar 25 21:20:09 +0700 2016
(1.1) running mkcls @ Fri Mar 25 21:20:09 +0700 2016
Executing: C:\Users\tahoar\workbench\slate-toolkit\bin\mkcls.exe -c50 -n2 -p"C:\Users\tahoar\workbench\slate-desktop\var\TRAININGS\smt-tm-de_de-en_us-DANIEL\bitext.en_us" -V"C:\Users\tahoar\workbench\slate-desktop\var\TRAININGS\smt-tm-de_de-en_us-DANIEL\giza.de_de-en_us\en_us.vcb.classes" opt 1>&2

This application has requested the Runtime to terminate it in an unusual way.
Please contact the application's support team for more information.
Assertion failed!

Program: C:\Users\tahoar\workbench\slate-toolkit\bin\mkcls.exe
File: src/mkcls/StatVar.cpp, Line 110

Expression: index>=0&&index<n
ERROR: Failed to execute C:\Users\tahoar\workbench\slate-toolkit\bin\mkcls.exe
failed perl.exe
fail train-model.perl step 1
-------------- next part --------------
beispiel : sonntag .
um sich anzumelden , wenden sie sich bitte an die ?rtliche vertretung der gesellschaft f?r verkehrssicherheit .
-------------- next part --------------
for example : sunday .
to register , contact your local branch of the road safety association .

------------------------------

Message: 2
Date: Tue, 29 Mar 2016 15:14:34 +0100
From: faiza shahid <faiza_shahid12@hotmail.com>
Subject: [Moses-support] Moses Server index.js 500 internal error
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <DUB124-W292B9247F8ED1D195C3E72F9870@phx.gbl>
Content-Type: text/plain; charset="iso-8859-1"

Hi,
I'm very new to moses and am currently working on the moses web translation for fr-en. I have tested the moses server on the terminal and followed the steps from the moses website as much as possible but I'm getting errors on the error.log shown below when I try to translate a website:[Tue Mar 29 13:37:31.560334 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("01") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.560484 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("02") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.560548 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH0!
1215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("03") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.560606 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("04") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.560664 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("05") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.560831 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a co!
nstant ("06") in void context at /usr/lib/cgi-bin/moses-web/translate.
cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.560894 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("07") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.560949 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("08") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.561001 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("09") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=w!
ww.lemonde.fr[Tue Mar 29 13:37:31.561049 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("10") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.561097 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("11") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.561146 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("12") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.561195 2016] [cgi:error] [pid 125!
89] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] tr
anslate.cgi: Useless use of a constant ("13") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.575431 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("14") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.575495 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("15") in void context at /usr/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.575545 2016] [cgi:error] [pid 12589] [client 192.168.1.97:44205] AH01215: [Tue Mar 29 13:37:31 2016] translate.cgi: Useless use of a constant ("16") in void context at /us!
r/lib/cgi-bin/moses-web/translate.cgi line 68., referer: http://192.168.1.121/cgi-bin/moses-web/?url=www.lemonde.fr[Tue Mar 29 13:37:31.991766 2016] [cgi:error] [pid 12590] [client 192.168.1.97:44204] AH01215: (8)Exec format error: exec of '/usr/lib/cgi-bin/moses-web/index.js' failed, referer: http://192.168.1.121/cgi-bin/moses-web/?frame=top&url=http%3A%2F%2Fwww.lemonde.fr[Tue Mar 29 13:37:31.996931 2016] [cgi:error] [pid 12590] [client 192.168.1.97:44204] End of script output before headers: index.js, referer: http://192.168.1.121/cgi-bin/moses-web/?frame=top&url=http%3A%2F%2Fwww.lemonde.fr
I'm not really sure how to fix this. Much help would be appreciated. I have also looked at the translation-web but there isn't enough information for me to fully work on it.
Many thanks,
Faiza Shahid


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160329/bf0d1885/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 73
**********************************************

0 Response to "Moses-support Digest, Vol 113, Issue 73"

Post a Comment

Subscribe to: Post Comments (Atom)