Moses-support Digest, Vol 109, Issue 52

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Moses Training Error - died with signal 6, without
coredump (Nicholas Ruiz)


----------------------------------------------------------------------

Message: 1
Date: Mon, 23 Nov 2015 13:01:12 -0500
From: Nicholas Ruiz <nicruiz@fbk.eu>
Subject: Re: [Moses-support] Moses Training Error - died with signal
6, without coredump
To: Jeroen Vermeulen <jtv@precisiontranslationtools.com>
Cc: moses-support@mit.edu
Message-ID:
<CAKa+0YM_SheFtqgrkJk+mzXakzks+GC+qc5Y9=+FPvqgy=9MSA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Looks like this problem is operating system-specific. Here's a related
problem.

https://stackoverflow.com/questions/26623626/bash-redirect-to-dev-stdout-not-a-directory#

Reproduced here:
nruiz@cheetah:/n/w10-nruiz/mt/zh-en/experiment/toy$ (echo "hi" >
/dev/stdout) > test.txt
-bash: /dev/stdout: Not a directory
nruiz@cheetah:/n/w10-nruiz/mt/zh-en/experiment/toy$ (echo "hi" >
/dev/stdout) > /tmp/test.txt

The problem appears here
in mosesdecoder/scripts/generic/extract-parallel.perl:
my $cmd = "$extractCmd $TMPDIR/target.$numStr $TMPDIR/source.$numStr
$TMPDIR/align.$numStr $TMPDIR/extract.$numStr $glueArg $otherExtractArgs
$weightsCmd --SentenceOffset ".($i*$linesPerSplit)." 2>> /dev/stderr \n";

z?n? ???u

On Mon, Nov 23, 2015 at 11:17 AM, Nicholas Ruiz <nicruiz@fbk.eu> wrote:

> Reviving this. Thoudam, were you able to figure out why you were getting
> this error during the phrase extraction step?
> sh: /dev/stderr: Not a directory
>
> I recently encountered a similar problem at the same step in training.
>
> $ cat /proc/version
> Linux version 2.6.32-504.16.2.el6.x86_64 (
> mockbuild@c6b9.bsys.dev.centos.org) (gcc version 4.4.7 20120313 (Red Hat
> 4.4.7-11) (GCC) ) #1 SMP Wed Apr 22 06:48:29 UTC 2015
>
> z?n? ???u
>
> On Sun, Sep 13, 2015 at 11:37 PM, Jeroen Vermeulen <
> jtv@precisiontranslationtools.com> wrote:
>
>> There was an error about a missing /dev/stderr in there... Did that
>> special file get deleted?
>>
>>
>> Jeroen
>>
>>
>> On September 12, 2015 2:58:31 PM GMT+07:00, Hieu Hoang <
>> hieuhoang@gmail.com> wrote:
>>>
>>> i can't see where the problem is, the commands seems to be ok.
>>>
>>> what operating system are you using? where did you get the
>>> moses-train.sh code from?
>>>
>>> On 10/09/2015 17:03, Thoudam Doren Singh wrote:
>>>
>>> Moses training command I use is moses-train.sh
>>>
>>>
>>> #!/bin/bash
>>> set -x
>>> set -e
>>> HOME=/doren/Workspace
>>> MAIN_DIR=$HOME
>>> # mgiza++ directory
>>> TOOLS_DIR=$HOME/tools
>>> #Moses directory
>>> MOSES_DIR=$HOME/mosesdecoder
>>> export SCRIPTS_ROOTDIR=$MOSES_DIR/scripts
>>> WORKING_DIR=$HOME/SMT-Models
>>> CORPUS_DIR=$HOME/Corpus/Parallel-Corpora
>>> TMPDIR=$HOME/tmp
>>> SRC_LANG=EN
>>> TGT_LANG=HN
>>> SENT_LEN=70
>>> MOSES_ALIGN="grow-diag-final"
>>> MODEL_DIR_PREFIX="$WORKING_DIR/model-en-hn-grow-diag-final"
>>> LM_ORDER=5
>>> LM=$HOME/kenlm/bin/New-Filtered-Mono.Hindiaa.binary
>>> MAX_PHRASE_LEN=7
>>> CORPUS_PREFIX=$CORPUS_DIR/clean-corpus-part1
>>> MODEL_REORDER=hier-mslr-bidirectional-fe
>>> MODEL_DIR=$MODEL_DIR_PREFIX"-"$MODEL_REORDER"-intlm2"
>>> mkdir -p $MODEL_DIR
>>> nohup time $SCRIPTS_ROOTDIR/training/train-model.perl \
>>> -external-bin-dir $TOOLS_DIR \
>>> -model-dir $MODEL_DIR \
>>> -corpus $CORPUS_PREFIX \
>>> -f $SRC_LANG -e $TGT_LANG \
>>> -max-phrase-length $MAX_PHRASE_LEN \
>>> -alignment $MOSES_ALIGN \
>>> -reordering $MODEL_REORDER \
>>> -lm 0:$LM_ORDER:$LM:5 \
>>> -mgiza -mgiza-cpus 12 \
>>> -parallel -cores 4 \
>>> -temp-dir $TMPDIR
>>>
>>>
>>>
>>> Best Regards
>>>
>>> Thoudam Doren Singh
>>>
>>> On Thu, Sep 10, 2015 at 4:23 AM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>>
>>>> whats the exact command you ran? Can you also attach the config file
>>>> you use
>>>>
>>>>
>>>> On 09/09/2015 23:44, Thoudam Doren Singh wrote:
>>>>
>>>> Hi
>>>>
>>>>
>>>> I am not sure why I am getting this error. Can someone help me out?
>>>> I am sending part of the Moses training messages.
>>>>
>>>>
>>>>
>>>> /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4
>>>> split "sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract
>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract
>>>> 7 orientation --model hier-mslr --GZOutput
>>>> Executing:
>>>> /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4 split
>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract
>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract
>>>> 7 orientation --model hier-mslr --GZOutput
>>>> MAX 7 1 0
>>>> Started Tue Sep 8 15:21:49 2015
>>>> which: no pigz in
>>>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
>>>> using gzip
>>>> Usage: split [OPTION]... [INPUT [PREFIX]]
>>>> Output fixed-size pieces of INPUT to PREFIXaa, PREFIXab, ...; default
>>>> size is 1000 lines, and default PREFIX is `x'. With no INPUT, or when
>>>> INPUT
>>>> is -, read standard input.
>>>>
>>>> Mandatory arguments to long options are mandatory for short options too.
>>>> -a, --suffix-length=N use suffixes of length N (default 2)
>>>> -b, --bytes=SIZE put SIZE bytes per output file
>>>> -C, --line-bytes=SIZE put at most SIZE bytes of lines per output
>>>> file
>>>> -d, --numeric-suffixes use numeric suffixes instead of alphabetic
>>>> -l, --lines=NUMBER put NUMBER lines per output file
>>>> --verbose print a diagnostic just before each
>>>> output file is opened
>>>> --help display this help and exit
>>>> --version output version information and exit
>>>>
>>>> SIZE may be (or may be an integer optionally followed by) one of
>>>> following:
>>>> KB 1000, K 1024, MB 1000*1000, M 1024*1024, and so on for G, T, P, E,
>>>> Z, Y.
>>>>
>>>> Report split bugs to bug-coreutils@gnu.org
>>>> GNU coreutils home page: < <http://www.gnu.org/software/coreutils/>
>>>> http://www.gnu.org/software/coreutils/>
>>>> General help using GNU software: < <http://www.gnu.org/gethelp/>
>>>> http://www.gnu.org/gethelp/>
>>>> Report split translation bugs to <
>>>> <http://translationproject.org/team/>
>>>> http://translationproject.org/team/>
>>>> For complete documentation, run: info coreutils 'split invocation'
>>>> isBSDSplit=0
>>>> Executing: mkdir -p
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970;
>>>> ls -l
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
>>>> total=20000 line-per-split=5001
>>>> split -d -l 5001 -a 7
>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/target.split
>>>> -d -l 5001 -a 7
>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/source.split
>>>> -d -l 5001 -a 7
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/align.sh:
>>>> /dev/stderr: Not a directory
>>>> sh: /dev/stderr: Not a directory
>>>> sh: /dev/stderr: Not a directory
>>>> sh: /dev/stderr: Not a directory
>>>> merging extract / extract.inv
>>>> gunzip -c
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz
>>>> | LC_ALL=C sort -T
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
>>>> 2>> /dev/stderr | gzip -c >
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
>>>> 2>> /dev/stderr
>>>> gunzip -c
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz
>>>> | LC_ALL=C sort -T
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
>>>> 2>> /dev/stderr | gzip -c >
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
>>>> 2>> /dev/stderr
>>>> sh: /dev/stderr: Not a directory
>>>> gzip:
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz:
>>>> No such file or directory
>>>> sh: /dev/stderr: Not a directory
>>>> sh: /dev/stderr: Not a directory
>>>> sh: /dev/stderr: Not a directory
>>>> gzip:
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz:
>>>> No such file or directory
>>>> gzip: gzip:
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz:
>>>> No such file or directory
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz:
>>>> No such file or directory
>>>> gzip:
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz:
>>>> No such file or directory
>>>> gzip:
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz:
>>>> No such file or directory
>>>> gzip:
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz:
>>>> No such file or directory
>>>> gzip:
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz:
>>>> No such file or directory
>>>> Finished Tue Sep 8 15:21:50 2015
>>>> (6) score phrases @ Tue Sep 8 15:21:50 CDT 2015
>>>> (6.1) creating table half
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e
>>>> @ Tue Sep 8 15:21:50 CDT 2015
>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
>>>> 0
>>>> Executing:
>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
>>>> 0
>>>> (6.1) creating table half
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f
>>>> @ Tue Sep 8 15:21:50 CDT 2015
>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>>>> --Inverse 1
>>>> Executing:
>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>>>> --Inverse 1
>>>> which: no pigz in
>>>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
>>>> which: no pigz in
>>>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
>>>> using gzip
>>>> Started Tue Sep 8 15:21:50 2015
>>>> using gzip
>>>> Started Tue Sep 8 15:21:50 2015
>>>>
>>>> gzip:
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz:
>>>> unexpected end of file
>>>>
>>>> gzip:
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz:
>>>> unexpected end of file
>>>> /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/extract.0.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.0000000.gz
>>>> --Inverse 2>> /dev/stderr
>>>> /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/extract.0.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz
>>>> 2>> /dev/stderr
>>>>
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/
>>>> run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh:
>>>> line 1: /dev/stderr: Not a directory
>>>>
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/
>>>> run.0.sh: line 1: /dev/stderr: Not a directory
>>>> mv
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gzmv:
>>>> cannot stat
>>>> `/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz':
>>>> No such file or directory
>>>> gunzip -c
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.*.gz
>>>> 2>> /dev/stderr| LC_ALL=C sort -T
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018
>>>> | gzip -c >
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>>>> 2>> /dev/stderr sh: /dev/stderr: Not a directory
>>>> sh: /dev/stderr: Not a directory
>>>> Exit code: 1
>>>> ERROR: Scoring of phrases failed at
>>>> /doren/Workspace/mosesdecoder/scripts/training/train-model.perl line 1773.
>>>> Exit code: 1
>>>> ERROR: Scoring of phrases failed at
>>>> /doren/Workspace/mosesdecoder/scripts/training/train-model.perl line 1773.
>>>> (6.6) consolidating the two halves @ Tue Sep 8 15:21:50 CDT 2015
>>>> Executing: /doren/Workspace/mosesdecoder/scripts/../bin/consolidate
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>>>> /dev/stdout | gzip -c >
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.gz
>>>> Consolidate v2.0 written by Philipp Koehn
>>>> consolidating direct and indirect rule tables
>>>> terminate called after throwing an instance of 'std::runtime_error'
>>>> what(): Could not open
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz.
>>>> Executing: rm -f
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.*
>>>> (7) learn reordering model @ Tue Sep 8 15:21:51 CDT 2015
>>>> (7.1) [no factors] learn reordering model @ Tue Sep 8 15:21:51 CDT 2015
>>>> (7.2) building tables @ Tue Sep 8 15:21:51 CDT 2015
>>>> Executing:
>>>> /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
>>>> 0.5
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table.
>>>> --model "hier mslr hier-mslr-bidirectional-fe"
>>>> Lexical Reordering Scorer
>>>> scores lexical reordering models of several types (hierarchical,
>>>> phrase-based and word-based-extraction
>>>> terminate called after throwing an instance of 'util::ErrnoException'
>>>> what(): util/file.cc:68 in int util::OpenReadOrThrow(const char*)
>>>> threw ErrnoException because `-1 == (ret = open(name, 00))'.
>>>> No such file or directory while opening
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
>>>> ERROR: Execution of:
>>>> /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
>>>> 0.5
>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table.
>>>> --model "hier mslr hier-mslr-bidirectional-fe"
>>>> died with signal 6, without coredump
>>>> 823.89user 55.26system 3:53.03elapsed 377%CPU (0avgtext+0avgdata
>>>> 629344maxresident)k
>>>> 27176inputs+273160outputs (28major+2115194minor)pagefaults 0swaps
>>>>
>>>>
>>>>
>>>>
>>>> Best Regards
>>>>
>>>>
>>>> Thoudam Doren Singh
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>> --
>>>> Hieu Hoanghttp://www.hoang.co.uk/hieu
>>>>
>>>>
>>>
>>> --
>>> Hieu Hoanghttp://www.hoang.co.uk/hieu
>>>
>>> ------------------------------
>>>
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151123/ed746374/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 109, Issue 52
**********************************************

Tweet