Moses-support Digest, Vol 116, Issue 8

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Moses "died with error 11" error in factored training
(Sa?o Kuntaric)


----------------------------------------------------------------------

Message: 1
Date: Sun, 12 Jun 2016 11:40:15 +0200
From: Sa?o Kuntaric <saso.kuntaric@gmail.com>
Subject: [Moses-support] Moses "died with error 11" error in factored
training
To: moses-support@mit.edu
Message-ID:
<CANsquDq7vmtT8EffpyDPQUftt6qL4dKk0K1FyGsz3W2OGEj1-w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi all,

I am trying to perform factored training on a corpus that I have prepared.
While doing it on a small subset, everything works fine. However while
doing it on the whole corpus, I get the following error.

ERROR: Execution of: /home/ksaso/mosesdecoder/tools/GIZA++
-CoocurrenceFile
/home/ksaso/working/IT_corpus/TMX/txt/factored_corpus/morphgen/giza.en-sl/en-sl.cooc
-c
/home/ksaso/working/IT_corpus/TMX/txt/factored_corpus/morphgen/corpus/en-sl-int-train.snt
-m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4
-nodumps 1 -nsmooth 4 -o
/home/ksaso/working/IT_corpus/TMX/txt/factored_corpus/morphgen/giza.en-sl/en-sl
-onlyaldumps 1 -p0 0.999 -s
/home/ksaso/working/IT_corpus/TMX/txt/factored_corpus/morphgen/corpus/sl.vcb
-t
/home/ksaso/working/IT_corpus/TMX/txt/factored_corpus/morphgen/corpus/en.vcb
died with signal 11, with coredump

I have observed the training and Moses creates the vcb files fine and
completes a few iterations of the model1 training. However when it starts
the "Hmm Training Started at: Sun Jun 12 11:30:47 2016" it crashes with the
above warning. I do get a few of the "ERROR: Forbidden zero sentence length
0" errors, so I take it the zero length sentences are the issue. I tried
the Moses cleaning script, but it doesn't fix the error. I tried checking
manually, but can't find any empty lines.

Is there a way for Moses to tell me the line numbers that are problematic
while doing the training or does the problem lie somewhere else?

Best regards,

Saso
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160612/0b23b7b9/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 116, Issue 8
*********************************************

Tweet