Home » Uncategories » Moses-support Digest, Vol 109, Issue 54

Moses-support Digest, Vol 109, Issue 54

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Moses Training Error - died with signal 6, without
coredump (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Tue, 24 Nov 2015 01:16:21 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Moses Training Error - died with signal
6, without coredump
To: Thoudam Doren Singh <thoudam.doren@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbgTwcYxv0KgXmKtRPhPjZg5q81UMvz7qrDyt4hw8NKi8g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

There are problem with using /dev/stderr, and there's problems with
alternative methods of catching the errors.
https://github.com/moses-smt/mosesdecoder/pull/131
Not sure if anyone has time to work out the optimal path through this.
Otherwise just go with what we've got

Hieu Hoang
http://www.hoang.co.uk/hieu

On 23 November 2015 at 18:30, Thoudam Doren Singh <thoudam.doren@gmail.com>
wrote:

> Hi Nicholas
>
> Yes, I could figure out in my case. It was something to do with
>
>
> /mosesdecoder/scripts/generic/score-parallel.perl
> /mosesdecoder/scripts/generic/extract-parallel.per
>
>
> I removed the parts that send errors to /dev/stderr.
>
>
>
>
> Best Regards
>
>
> Doren
>
>
>
>
>
>
> On Mon, Nov 23, 2015 at 12:01 PM, Nicholas Ruiz <nicruiz@fbk.eu> wrote:
>
>> Looks like this problem is operating system-specific. Here's a related
>> problem.
>>
>>
>> https://stackoverflow.com/questions/26623626/bash-redirect-to-dev-stdout-not-a-directory#
>>
>> Reproduced here:
>> nruiz@cheetah:/n/w10-nruiz/mt/zh-en/experiment/toy$ (echo "hi" >
>> /dev/stdout) > test.txt
>> -bash: /dev/stdout: Not a directory
>> nruiz@cheetah:/n/w10-nruiz/mt/zh-en/experiment/toy$ (echo "hi" >
>> /dev/stdout) > /tmp/test.txt
>>
>> The problem appears here
>> in mosesdecoder/scripts/generic/extract-parallel.perl:
>> my $cmd = "$extractCmd $TMPDIR/target.$numStr $TMPDIR/source.$numStr
>> $TMPDIR/align.$numStr $TMPDIR/extract.$numStr $glueArg $otherExtractArgs
>> $weightsCmd --SentenceOffset ".($i*$linesPerSplit)." 2>> /dev/stderr \n";
>>
>> z?n? ???u
>>
>> On Mon, Nov 23, 2015 at 11:17 AM, Nicholas Ruiz <nicruiz@fbk.eu> wrote:
>>
>>> Reviving this. Thoudam, were you able to figure out why you were getting
>>> this error during the phrase extraction step?
>>> sh: /dev/stderr: Not a directory
>>>
>>> I recently encountered a similar problem at the same step in training.
>>>
>>> $ cat /proc/version
>>> Linux version 2.6.32-504.16.2.el6.x86_64 (
>>> mockbuild@c6b9.bsys.dev.centos.org) (gcc version 4.4.7 20120313 (Red
>>> Hat 4.4.7-11) (GCC) ) #1 SMP Wed Apr 22 06:48:29 UTC 2015
>>>
>>> z?n? ???u
>>>
>>> On Sun, Sep 13, 2015 at 11:37 PM, Jeroen Vermeulen <
>>> jtv@precisiontranslationtools.com> wrote:
>>>
>>>> There was an error about a missing /dev/stderr in there... Did that
>>>> special file get deleted?
>>>>
>>>>
>>>> Jeroen
>>>>
>>>>
>>>> On September 12, 2015 2:58:31 PM GMT+07:00, Hieu Hoang <
>>>> hieuhoang@gmail.com> wrote:
>>>>>
>>>>> i can't see where the problem is, the commands seems to be ok.
>>>>>
>>>>> what operating system are you using? where did you get the
>>>>> moses-train.sh code from?
>>>>>
>>>>> On 10/09/2015 17:03, Thoudam Doren Singh wrote:
>>>>>
>>>>> Moses training command I use is moses-train.sh
>>>>>
>>>>>
>>>>> #!/bin/bash
>>>>> set -x
>>>>> set -e
>>>>> HOME=/doren/Workspace
>>>>> MAIN_DIR=$HOME
>>>>> # mgiza++ directory
>>>>> TOOLS_DIR=$HOME/tools
>>>>> #Moses directory
>>>>> MOSES_DIR=$HOME/mosesdecoder
>>>>> export SCRIPTS_ROOTDIR=$MOSES_DIR/scripts
>>>>> WORKING_DIR=$HOME/SMT-Models
>>>>> CORPUS_DIR=$HOME/Corpus/Parallel-Corpora
>>>>> TMPDIR=$HOME/tmp
>>>>> SRC_LANG=EN
>>>>> TGT_LANG=HN
>>>>> SENT_LEN=70
>>>>> MOSES_ALIGN="grow-diag-final"
>>>>> MODEL_DIR_PREFIX="$WORKING_DIR/model-en-hn-grow-diag-final"
>>>>> LM_ORDER=5
>>>>> LM=$HOME/kenlm/bin/New-Filtered-Mono.Hindiaa.binary
>>>>> MAX_PHRASE_LEN=7
>>>>> CORPUS_PREFIX=$CORPUS_DIR/clean-corpus-part1
>>>>> MODEL_REORDER=hier-mslr-bidirectional-fe
>>>>> MODEL_DIR=$MODEL_DIR_PREFIX"-"$MODEL_REORDER"-intlm2"
>>>>> mkdir -p $MODEL_DIR
>>>>> nohup time $SCRIPTS_ROOTDIR/training/train-model.perl \
>>>>> -external-bin-dir $TOOLS_DIR \
>>>>> -model-dir $MODEL_DIR \
>>>>> -corpus $CORPUS_PREFIX \
>>>>> -f $SRC_LANG -e $TGT_LANG \
>>>>> -max-phrase-length $MAX_PHRASE_LEN \
>>>>> -alignment $MOSES_ALIGN \
>>>>> -reordering $MODEL_REORDER \
>>>>> -lm 0:$LM_ORDER:$LM:5 \
>>>>> -mgiza -mgiza-cpus 12 \
>>>>> -parallel -cores 4 \
>>>>> -temp-dir $TMPDIR
>>>>>
>>>>>
>>>>>
>>>>> Best Regards
>>>>>
>>>>> Thoudam Doren Singh
>>>>>
>>>>> On Thu, Sep 10, 2015 at 4:23 AM, Hieu Hoang <hieuhoang@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> whats the exact command you ran? Can you also attach the config file
>>>>>> you use
>>>>>>
>>>>>>
>>>>>> On 09/09/2015 23:44, Thoudam Doren Singh wrote:
>>>>>>
>>>>>> Hi
>>>>>>
>>>>>>
>>>>>> I am not sure why I am getting this error. Can someone help me out?
>>>>>> I am sending part of the Moses training messages.
>>>>>>
>>>>>>
>>>>>>
>>>>>> /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4
>>>>>> split "sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract
>>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
>>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract
>>>>>> 7 orientation --model hier-mslr --GZOutput
>>>>>> Executing:
>>>>>> /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4 split
>>>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract
>>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
>>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract
>>>>>> 7 orientation --model hier-mslr --GZOutput
>>>>>> MAX 7 1 0
>>>>>> Started Tue Sep 8 15:21:49 2015
>>>>>> which: no pigz in
>>>>>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
>>>>>> using gzip
>>>>>> Usage: split [OPTION]... [INPUT [PREFIX]]
>>>>>> Output fixed-size pieces of INPUT to PREFIXaa, PREFIXab, ...; default
>>>>>> size is 1000 lines, and default PREFIX is `x'. With no INPUT, or
>>>>>> when INPUT
>>>>>> is -, read standard input.
>>>>>>
>>>>>> Mandatory arguments to long options are mandatory for short options
>>>>>> too.
>>>>>> -a, --suffix-length=N use suffixes of length N (default 2)
>>>>>> -b, --bytes=SIZE put SIZE bytes per output file
>>>>>> -C, --line-bytes=SIZE put at most SIZE bytes of lines per output
>>>>>> file
>>>>>> -d, --numeric-suffixes use numeric suffixes instead of alphabetic
>>>>>> -l, --lines=NUMBER put NUMBER lines per output file
>>>>>> --verbose print a diagnostic just before each
>>>>>> output file is opened
>>>>>> --help display this help and exit
>>>>>> --version output version information and exit
>>>>>>
>>>>>> SIZE may be (or may be an integer optionally followed by) one of
>>>>>> following:
>>>>>> KB 1000, K 1024, MB 1000*1000, M 1024*1024, and so on for G, T, P, E,
>>>>>> Z, Y.
>>>>>>
>>>>>> Report split bugs to bug-coreutils@gnu.org
>>>>>> GNU coreutils home page: < <http://www.gnu.org/software/coreutils/>
>>>>>> http://www.gnu.org/software/coreutils/>
>>>>>> General help using GNU software: < <http://www.gnu.org/gethelp/>
>>>>>> http://www.gnu.org/gethelp/>
>>>>>> Report split translation bugs to <
>>>>>> <http://translationproject.org/team/>
>>>>>> http://translationproject.org/team/>
>>>>>> For complete documentation, run: info coreutils 'split invocation'
>>>>>> isBSDSplit=0
>>>>>> Executing: mkdir -p
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970;
>>>>>> ls -l
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
>>>>>> total=20000 line-per-split=5001
>>>>>> split -d -l 5001 -a 7
>>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/target.split
>>>>>> -d -l 5001 -a 7
>>>>>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/source.split
>>>>>> -d -l 5001 -a 7
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/align.sh:
>>>>>> /dev/stderr: Not a directory
>>>>>> sh: /dev/stderr: Not a directory
>>>>>> sh: /dev/stderr: Not a directory
>>>>>> sh: /dev/stderr: Not a directory
>>>>>> merging extract / extract.inv
>>>>>> gunzip -c
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz
>>>>>> | LC_ALL=C sort -T
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
>>>>>> 2>> /dev/stderr | gzip -c >
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
>>>>>> 2>> /dev/stderr
>>>>>> gunzip -c
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz
>>>>>> | LC_ALL=C sort -T
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
>>>>>> 2>> /dev/stderr | gzip -c >
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
>>>>>> 2>> /dev/stderr
>>>>>> sh: /dev/stderr: Not a directory
>>>>>> gzip:
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz:
>>>>>> No such file or directory
>>>>>> sh: /dev/stderr: Not a directory
>>>>>> sh: /dev/stderr: Not a directory
>>>>>> sh: /dev/stderr: Not a directory
>>>>>> gzip:
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz:
>>>>>> No such file or directory
>>>>>> gzip: gzip:
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz:
>>>>>> No such file or directory
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz:
>>>>>> No such file or directory
>>>>>> gzip:
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz:
>>>>>> No such file or directory
>>>>>> gzip:
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz:
>>>>>> No such file or directory
>>>>>> gzip:
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz:
>>>>>> No such file or directory
>>>>>> gzip:
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz:
>>>>>> No such file or directory
>>>>>> Finished Tue Sep 8 15:21:50 2015
>>>>>> (6) score phrases @ Tue Sep 8 15:21:50 CDT 2015
>>>>>> (6.1) creating table half
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e
>>>>>> @ Tue Sep 8 15:21:50 CDT 2015
>>>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
>>>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
>>>>>> 0
>>>>>> Executing:
>>>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
>>>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
>>>>>> 0
>>>>>> (6.1) creating table half
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f
>>>>>> @ Tue Sep 8 15:21:50 CDT 2015
>>>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
>>>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>>>>>> --Inverse 1
>>>>>> Executing:
>>>>>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
>>>>>> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>>>>>> --Inverse 1
>>>>>> which: no pigz in
>>>>>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
>>>>>> which: no pigz in
>>>>>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
>>>>>> using gzip
>>>>>> Started Tue Sep 8 15:21:50 2015
>>>>>> using gzip
>>>>>> Started Tue Sep 8 15:21:50 2015
>>>>>>
>>>>>> gzip:
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz:
>>>>>> unexpected end of file
>>>>>>
>>>>>> gzip:
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz:
>>>>>> unexpected end of file
>>>>>> /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/extract.0.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.0000000.gz
>>>>>> --Inverse 2>> /dev/stderr
>>>>>> /doren/Workspace/mosesdecoder/scripts/../bin/score
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/extract.0.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz
>>>>>> 2>> /dev/stderr
>>>>>>
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/
>>>>>> run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh:
>>>>>> line 1: /dev/stderr: Not a directory
>>>>>>
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/
>>>>>> run.0.sh: line 1: /dev/stderr: Not a directory
>>>>>> mv
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gzmv:
>>>>>> cannot stat
>>>>>> `/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz':
>>>>>> No such file or directory
>>>>>> gunzip -c
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.*.gz
>>>>>> 2>> /dev/stderr| LC_ALL=C sort -T
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018
>>>>>> | gzip -c >
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>>>>>> 2>> /dev/stderr sh: /dev/stderr: Not a directory
>>>>>> sh: /dev/stderr: Not a directory
>>>>>> Exit code: 1
>>>>>> ERROR: Scoring of phrases failed at
>>>>>> /doren/Workspace/mosesdecoder/scripts/training/train-model.perl line 1773.
>>>>>> Exit code: 1
>>>>>> ERROR: Scoring of phrases failed at
>>>>>> /doren/Workspace/mosesdecoder/scripts/training/train-model.perl line 1773.
>>>>>> (6.6) consolidating the two halves @ Tue Sep 8 15:21:50 CDT 2015
>>>>>> Executing: /doren/Workspace/mosesdecoder/scripts/../bin/consolidate
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>>>>>> /dev/stdout | gzip -c >
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.gz
>>>>>> Consolidate v2.0 written by Philipp Koehn
>>>>>> consolidating direct and indirect rule tables
>>>>>> terminate called after throwing an instance of 'std::runtime_error'
>>>>>> what(): Could not open
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz.
>>>>>> Executing: rm -f
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.*
>>>>>> (7) learn reordering model @ Tue Sep 8 15:21:51 CDT 2015
>>>>>> (7.1) [no factors] learn reordering model @ Tue Sep 8 15:21:51 CDT
>>>>>> 2015
>>>>>> (7.2) building tables @ Tue Sep 8 15:21:51 CDT 2015
>>>>>> Executing:
>>>>>> /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
>>>>>> 0.5
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table.
>>>>>> --model "hier mslr hier-mslr-bidirectional-fe"
>>>>>> Lexical Reordering Scorer
>>>>>> scores lexical reordering models of several types (hierarchical,
>>>>>> phrase-based and word-based-extraction
>>>>>> terminate called after throwing an instance of 'util::ErrnoException'
>>>>>> what(): util/file.cc:68 in int util::OpenReadOrThrow(const char*)
>>>>>> threw ErrnoException because `-1 == (ret = open(name, 00))'.
>>>>>> No such file or directory while opening
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
>>>>>> ERROR: Execution of:
>>>>>> /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
>>>>>> 0.5
>>>>>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table.
>>>>>> --model "hier mslr hier-mslr-bidirectional-fe"
>>>>>> died with signal 6, without coredump
>>>>>> 823.89user 55.26system 3:53.03elapsed 377%CPU (0avgtext+0avgdata
>>>>>> 629344maxresident)k
>>>>>> 27176inputs+273160outputs (28major+2115194minor)pagefaults 0swaps
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Best Regards
>>>>>>
>>>>>>
>>>>>> Thoudam Doren Singh
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Hieu Hoanghttp://www.hoang.co.uk/hieu
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> Hieu Hoanghttp://www.hoang.co.uk/hieu
>>>>>
>>>>> ------------------------------
>>>>>
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151123/4f30fccd/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 109, Issue 54
**********************************************

0 Response to "Moses-support Digest, Vol 109, Issue 54"

Post a Comment

Subscribe to: Post Comments (Atom)