Moses-support Digest, Vol 107, Issue 31

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Syntax Error in Fuzzy Match Rule Table (Hieu Hoang)
2. Re: Moses Training Error - died with signal 6, without
coredump (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Sat, 12 Sep 2015 09:49:14 +0200
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Syntax Error in Fuzzy Match Rule Table
To: ?lvaro Peris <lvapeab@prhlt.upv.es>, moses-support@mit.edu
Message-ID: <55F3D8FA.8080109@gmail.com>
Content-Type: text/plain; charset="windows-1252"

the fuzzy match rule table hasn't been used for a while. I'm not sure if
it still works anymore

On 10/09/2015 13:05, ?lvaro Peris wrote:
> Hi,
>
> I've been trying to test the Fuzzy Match Rule Table for hierarchical
> models, but when I run MERT, I only get syntax errors. I'm fairly new
> in hierarchical models, I think my moses.ini config is correct, but I
> may be doing something wrong. If I don't use the
> PhraseDictionaryFuzzyMatch, it works properly.
>
> I saw a similar thread
> (http://permalink.gmane.org/gmane.comp.nlp.moses.user/12239), but I
> can't even reach the translation process, it crashes before.
>
> I'd appreciate any help.
>
> This is the trace of the crash:
>
>
> (6.6) consolidating the two halves @ Thu Sep 10 12:59:50 CEST 2015
> Executing:
> /home/lvapeab/smt/software/mosesdecoder/scripts/../bin/consolidate
> /tmp/moses.XQR9TF/fuzzyMatchFile.pt.half.f2e.gz
> /tmp/moses.XQR9TF/fuzzyMatchFile.pt.half.e2f.gz /dev/stdout
> --Hierarchical | gzip -c > /tmp/moses.XQR9TF/fuzzyMatchFile.pt.gz
> Consolidate v2.0 written by Philipp Koehn
> consolidating direct and indirect rule tables
> processing hierarchical rules
>
> Executing: rm -f /tmp/moses.XQR9TF/fuzzyMatchFile.pt.half.*
> Start loading fuzzy-match phrase model : [1.245] seconds
> terminate called after throwing an instance of 'util::Exception'
> what():
> moses/TranslationModel/RuleTable/PhraseDictionaryFuzzyMatch.cpp:235
> in virtual void
> Moses::PhraseDictionaryFuzzyMatch::InitializeForInput(const
> ttasksptr&) threw util::Exception'.
> Syntax error at /tmp/moses.XQR9TF/fuzzyMatchFile.pt.gz:0
> Aborted (core dumped)
> Exit code: 134
> The decoder died. CONFIG WAS -weight-overwrite 'TranslationModel0=
> 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714
> LM0= 0.142857 WordPenalty0= -0.285714 PhrasePenalty0= 0.057143'
>
>
> The file which gives the syntax error
> (/tmp/moses.2pkyhw/fuzzyMatchFile.pt.gz) contains:
>
>
> nos hemos de marchar el jueves cinco de enero por la tarde . [X]
> ||| should leave on Thursday January the fifth in the afternoon .
> [X] ||| -nan -nan ||| 0-0 1-0 1-1 10-9 11-10 2-1 3-1 3-2 4-3 5-4
> 5-6 6-7 7-5 7-8 8-5 9-8 ||| 0 0 0 ||| |||
>
>
>
> (Maybe it fails because of the -nan?)
> Finally, my moses.ini:
>
>
> #########################
> ### MOSES CONFIG FILE ###
> #########################
>
> # input factors
> [input-factors]
> 0
>
> # mapping steps
> [mapping]
> 0 T 0
> 1 T 1
>
> [cube-pruning-pop-limit]
> 1000
>
> [non-terminals]
> X
>
> [search-algorithm]
> 3
>
> [inputtype]
> 3
>
> [max-chart-span]
> 20
> 1000
>
> # feature functions
> [feature]
> UnknownWordPenalty
> WordPenalty
> PhrasePenalty
> PhraseDictionaryMemory name=TranslationModel0 num-features=4
> path=/home/lvapeab/smt/tasks/turista/esen/fuzzy/model/rule-table.gz input-factor=0
> output-factor=0
> PhraseDictionaryMemory name=TranslationModel1 num-features=1
> path=/home/lvapeab/smt/tasks/turista/esen/fuzzy/model/glue-grammar
> input-factor=0 output-factor=0 tuneable=true
> KENLM name=LM0 factor=0
> path=/home/lvapeab/smt/tasks/turista/esen/LM/5gram.en order=5
> PhraseDictionaryFuzzyMatch
> source=/home/lvapeab/smt/tasks/turista/DATA/training.es
> <http://training.es>
> target=/home/lvapeab/smt/tasks/turista/DATA/training.en
> alignment=/home/lvapeab/smt/tasks/turista/esen/fuzzy/model/aligned.grow-diag-final-and
> num-features=0
> # dense weights for feature functions
> [weight]
> # The default weights are NOT optimized for translation quality.
> You MUST tune the weights.
> # Documentation for tuning is here:
> http://www.statmt.org/moses/?n=FactoredTraining.Tuning
> UnknownWordPenalty0= 1
> WordPenalty0= -1
> PhrasePenalty0= 0.2
> TranslationModel0= 0.2 0.2 0.2 0.2
> TranslationModel1= 1
> LM0= 0.5
>
>
>
>
> Thank you in advance.
>
> Cheers,
> --
> ?lvaro.
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

--
Hieu Hoang
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150912/c080780a/attachment-0001.html

------------------------------

Message: 2
Date: Sat, 12 Sep 2015 09:58:31 +0200
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Moses Training Error - died with signal
6, without coredump
To: Thoudam Doren Singh <thoudam.doren@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <55F3DB27.70205@gmail.com>
Content-Type: text/plain; charset="utf-8"

i can't see where the problem is, the commands seems to be ok.

what operating system are you using? where did you get the
moses-train.sh code from?

On 10/09/2015 17:03, Thoudam Doren Singh wrote:
> Moses training command I use is moses-train.sh
>
>
> #!/bin/bash
> set -x
> set -e
> HOME=/doren/Workspace
> MAIN_DIR=$HOME
> # mgiza++ directory
> TOOLS_DIR=$HOME/tools
> #Moses directory
> MOSES_DIR=$HOME/mosesdecoder
> export SCRIPTS_ROOTDIR=$MOSES_DIR/scripts
> WORKING_DIR=$HOME/SMT-Models
> CORPUS_DIR=$HOME/Corpus/Parallel-Corpora
> TMPDIR=$HOME/tmp
> SRC_LANG=EN
> TGT_LANG=HN
> SENT_LEN=70
> MOSES_ALIGN="grow-diag-final"
> MODEL_DIR_PREFIX="$WORKING_DIR/model-en-hn-grow-diag-final"
> LM_ORDER=5
> LM=$HOME/kenlm/bin/New-Filtered-Mono.Hindiaa.binary
> MAX_PHRASE_LEN=7
> CORPUS_PREFIX=$CORPUS_DIR/clean-corpus-part1
> MODEL_REORDER=hier-mslr-bidirectional-fe
> MODEL_DIR=$MODEL_DIR_PREFIX"-"$MODEL_REORDER"-intlm2"
> mkdir -p $MODEL_DIR
> nohup time $SCRIPTS_ROOTDIR/training/train-model.perl \
> -external-bin-dir $TOOLS_DIR \
> -model-dir $MODEL_DIR \
> -corpus $CORPUS_PREFIX \
> -f $SRC_LANG -e $TGT_LANG \
> -max-phrase-length $MAX_PHRASE_LEN \
> -alignment $MOSES_ALIGN \
> -reordering $MODEL_REORDER \
> -lm 0:$LM_ORDER:$LM:5 \
> -mgiza -mgiza-cpus 12 \
> -parallel -cores 4 \
> -temp-dir $TMPDIR
>
>
>
> Best Regards
>
> Thoudam Doren Singh
>
> On Thu, Sep 10, 2015 at 4:23 AM, Hieu Hoang <hieuhoang@gmail.com
> <mailto:hieuhoang@gmail.com>> wrote:
>
> whats the exact command you ran? Can you also attach the config
> file you use
>
>
> On 09/09/2015 23:44, Thoudam Doren Singh wrote:
>> Hi
>>
>>
>> I am not sure why I am getting this error. Can someone help me out?
>> I am sending part of the Moses training messages.
>>
>>
>>
>> /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl
>> 4 split "sort "
>> /doren/Workspace/mosesdecoder/scripts/../bin/extract
>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract
>> 7 orientation --model hier-mslr --GZOutput
>> Executing:
>> /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl
>> 4 split "sort "
>> /doren/Workspace/mosesdecoder/scripts/../bin/extract
>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract
>> 7 orientation --model hier-mslr --GZOutput
>> MAX 7 1 0
>> Started Tue Sep 8 15:21:49 2015
>> which: no pigz in
>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
>> using gzip
>> Usage: split [OPTION]... [INPUT [PREFIX]]
>> Output fixed-size pieces of INPUT to PREFIXaa, PREFIXab, ...; default
>> size is 1000 lines, and default PREFIX is `x'. With no INPUT, or
>> when INPUT
>> is -, read standard input.
>>
>> Mandatory arguments to long options are mandatory for short
>> options too.
>> -a, --suffix-length=N use suffixes of length N (default 2)
>> -b, --bytes=SIZE put SIZE bytes per output file
>> -C, --line-bytes=SIZE put at most SIZE bytes of lines per
>> output file
>> -d, --numeric-suffixes use numeric suffixes instead of alphabetic
>> -l, --lines=NUMBER put NUMBER lines per output file
>> --verbose print a diagnostic just before each
>> output file is opened
>> --help display this help and exit
>> --version output version information and exit
>>
>> SIZE may be (or may be an integer optionally followed by) one of
>> following:
>> KB 1000, K 1024, MB 1000*1000, M 1024*1024, and so on for G, T,
>> P, E, Z, Y.
>>
>> Report split bugs to bug-coreutils@gnu.org
>> <mailto:bug-coreutils@gnu.org>
>> GNU coreutils home page: <http://www.gnu.org/software/coreutils/>
>> General help using GNU software: <http://www.gnu.org/gethelp/>
>> Report split translation bugs to
>> <http://translationproject.org/team/>
>> For complete documentation, run: info coreutils 'split invocation'
>> isBSDSplit=0
>> Executing: mkdir -p
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970;
>> ls -l
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
>> total=20000 line-per-split=5001
>> split -d -l 5001 -a 7
>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/target.split
>> -d -l 5001 -a 7
>> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/source.split
>> -d -l 5001 -a 7
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/align.sh:
>> /dev/stderr: Not a directory
>> sh: /dev/stderr: Not a directory
>> sh: /dev/stderr: Not a directory
>> sh: /dev/stderr: Not a directory
>> merging extract / extract.inv
>> gunzip -c
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz
>> | LC_ALL=C sort -T
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
>> 2>> /dev/stderr | gzip -c >
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
>> 2>> /dev/stderr
>> gunzip -c
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz
>> | LC_ALL=C sort -T
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
>> 2>> /dev/stderr | gzip -c >
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
>> 2>> /dev/stderr
>> sh: /dev/stderr: Not a directory
>> gzip:
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz:
>> No such file or directory
>> sh: /dev/stderr: Not a directory
>> sh: /dev/stderr: Not a directory
>> sh: /dev/stderr: Not a directory
>> gzip:
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz:
>> No such file or directory
>> gzip: gzip:
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz:
>> No such file or directory
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz:
>> No such file or directory
>> gzip:
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz:
>> No such file or directory
>> gzip:
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz:
>> No such file or directory
>> gzip:
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz:
>> No such file or directory
>> gzip:
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz:
>> No such file or directory
>> Finished Tue Sep 8 15:21:50 2015
>> (6) score phrases @ Tue Sep 8 15:21:50 CDT 2015
>> (6.1) creating table half
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e
>> @ Tue Sep 8 15:21:50 CDT 2015
>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl
>> 4 "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
>> 0
>> Executing:
>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl
>> 4 "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
>> 0
>> (6.1) creating table half
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f
>> @ Tue Sep 8 15:21:50 CDT 2015
>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl
>> 4 "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>> --Inverse 1
>> Executing:
>> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl
>> 4 "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>> --Inverse 1
>> which: no pigz in
>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
>> which: no pigz in
>> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
>> using gzip
>> Started Tue Sep 8 15:21:50 2015
>> using gzip
>> Started Tue Sep 8 15:21:50 2015
>>
>> gzip:
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz:
>> unexpected end of file
>>
>> gzip:
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz:
>> unexpected end of file
>> /doren/Workspace/mosesdecoder/scripts/../bin/score
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/extract.0.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.0000000.gz
>> --Inverse 2>> /dev/stderr
>> /doren/Workspace/mosesdecoder/scripts/../bin/score
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/extract.0.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz
>> 2>> /dev/stderr
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh
>> <http://run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh>:
>> line 1: /dev/stderr: Not a directory
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh
>> <http://run.0.sh>: line 1: /dev/stderr: Not a directory
>> mv
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gzmv:
>> cannot stat
>> `/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz':
>> No such file or directory
>> gunzip -c
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.*.gz
>> 2>> /dev/stderr| LC_ALL=C sort -T
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018
>> | gzip -c >
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>> 2>> /dev/stderr sh: /dev/stderr: Not a directory
>> sh: /dev/stderr: Not a directory
>> Exit code: 1
>> ERROR: Scoring of phrases failed at
>> /doren/Workspace/mosesdecoder/scripts/training/train-model.perl
>> line 1773.
>> Exit code: 1
>> ERROR: Scoring of phrases failed at
>> /doren/Workspace/mosesdecoder/scripts/training/train-model.perl
>> line 1773.
>> (6.6) consolidating the two halves @ Tue Sep 8 15:21:50 CDT 2015
>> Executing:
>> /doren/Workspace/mosesdecoder/scripts/../bin/consolidate
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
>> /dev/stdout | gzip -c >
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.gz
>> Consolidate v2.0 written by Philipp Koehn
>> consolidating direct and indirect rule tables
>> terminate called after throwing an instance of 'std::runtime_error'
>> what(): Could not open
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz.
>> Executing: rm -f
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.*
>> (7) learn reordering model @ Tue Sep 8 15:21:51 CDT 2015
>> (7.1) [no factors] learn reordering model @ Tue Sep 8 15:21:51
>> CDT 2015
>> (7.2) building tables @ Tue Sep 8 15:21:51 CDT 2015
>> Executing:
>> /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
>> 0.5
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table.
>> --model "hier mslr hier-mslr-bidirectional-fe"
>> Lexical Reordering Scorer
>> scores lexical reordering models of several types (hierarchical,
>> phrase-based and word-based-extraction
>> terminate called after throwing an instance of 'util::ErrnoException'
>> what(): util/file.cc:68 in int util::OpenReadOrThrow(const
>> char*) threw ErrnoException because `-1 == (ret = open(name, 00))'.
>> No such file or directory while opening
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
>> ERROR: Execution of:
>> /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
>> 0.5
>> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table.
>> --model "hier mslr hier-mslr-bidirectional-fe"
>> died with signal 6, without coredump
>> 823.89user 55.26system 3:53.03elapsed 377%CPU (0avgtext+0avgdata
>> 629344maxresident)k
>> 27176inputs+273160outputs (28major+2115194minor)pagefaults 0swaps
>>
>>
>>
>>
>> Best Regards
>>
>>
>> Thoudam Doren Singh
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> --
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
>

--
Hieu Hoang
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150912/514251f3/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 107, Issue 31
**********************************************

Tweet