Home » Uncategories » Moses-support Digest, Vol 107, Issue 27

Moses-support Digest, Vol 107, Issue 27

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Syntax Error in Fuzzy Match Rule Table (?lvaro Peris)
2. Re: Moses Training Error - died with signal 6, without
coredump (Thoudam Doren Singh)


----------------------------------------------------------------------

Message: 1
Date: Thu, 10 Sep 2015 13:05:44 +0200
From: ?lvaro Peris <lvapeab@prhlt.upv.es>
Subject: [Moses-support] Syntax Error in Fuzzy Match Rule Table
To: moses-support@mit.edu
Message-ID:
<CAOku=OQByYDi7Akv7My57-=NU_TdDg3JGJEFHc=F1wf3NnW_uA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

I've been trying to test the Fuzzy Match Rule Table for hierarchical
models, but when I run MERT, I only get syntax errors. I'm fairly new in
hierarchical models, I think my moses.ini config is correct, but I may be
doing something wrong. If I don't use the PhraseDictionaryFuzzyMatch, it
works properly.

I saw a similar thread (
http://permalink.gmane.org/gmane.comp.nlp.moses.user/12239), but I can't
even reach the translation process, it crashes before.

I'd appreciate any help.

This is the trace of the crash:


(6.6) consolidating the two halves @ Thu Sep 10 12:59:50 CEST 2015
Executing:
/home/lvapeab/smt/software/mosesdecoder/scripts/../bin/consolidate
/tmp/moses.XQR9TF/fuzzyMatchFile.pt.half.f2e.gz
/tmp/moses.XQR9TF/fuzzyMatchFile.pt.half.e2f.gz /dev/stdout --Hierarchical
| gzip -c > /tmp/moses.XQR9TF/fuzzyMatchFile.pt.gz
Consolidate v2.0 written by Philipp Koehn
consolidating direct and indirect rule tables
processing hierarchical rules

Executing: rm -f /tmp/moses.XQR9TF/fuzzyMatchFile.pt.half.*
Start loading fuzzy-match phrase model : [1.245] seconds
terminate called after throwing an instance of 'util::Exception'
what():
moses/TranslationModel/RuleTable/PhraseDictionaryFuzzyMatch.cpp:235 in
virtual void Moses::PhraseDictionaryFuzzyMatch::InitializeForInput(const
ttasksptr&) threw util::Exception'.
Syntax error at /tmp/moses.XQR9TF/fuzzyMatchFile.pt.gz:0
Aborted (core dumped)
Exit code: 134
The decoder died. CONFIG WAS -weight-overwrite 'TranslationModel0= 0.057143
0.057143 0.057143 0.057143 TranslationModel1= 0.285714 LM0= 0.142857
WordPenalty0= -0.285714 PhrasePenalty0= 0.057143'


The file which gives the syntax error
(/tmp/moses.2pkyhw/fuzzyMatchFile.pt.gz) contains:


nos hemos de marchar el jueves cinco de enero por la tarde . [X] ||| should
leave on Thursday January the fifth in the afternoon . [X] ||| -nan -nan
||| 0-0 1-0 1-1 10-9 11-10 2-1 3-1 3-2 4-3 5-4 5-6 6-7 7-5 7-8 8-5 9-8 |||
0 0 0 ||| |||



(Maybe it fails because of the -nan?)
Finally, my moses.ini:



#########################
### MOSES CONFIG FILE ###
#########################

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0
1 T 1

[cube-pruning-pop-limit]
1000

[non-terminals]
X

[search-algorithm]
3

[inputtype]
3

[max-chart-span]
20
1000

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryMemory name=TranslationModel0 num-features=4
path=/home/lvapeab/smt/tasks/turista/esen/fuzzy/model/rule-table.gz
input-factor=0 output-factor=0
PhraseDictionaryMemory name=TranslationModel1 num-features=1
path=/home/lvapeab/smt/tasks/turista/esen/fuzzy/model/glue-grammar
input-factor=0 output-factor=0 tuneable=true
KENLM name=LM0 factor=0
path=/home/lvapeab/smt/tasks/turista/esen/LM/5gram.en order=5
PhraseDictionaryFuzzyMatch source=/home/lvapeab/smt/tasks/turista/DATA/
training.es target=/home/lvapeab/smt/tasks/turista/DATA/training.en
alignment=/home/lvapeab/smt/tasks/turista/esen/fuzzy/model/aligned.grow-diag-final-and
num-features=0
# dense weights for feature functions
[weight]
# The default weights are NOT optimized for translation quality. You MUST
tune the weights.
# Documentation for tuning is here:
http://www.statmt.org/moses/?n=FactoredTraining.Tuning
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2
TranslationModel1= 1
LM0= 0.5




Thank you in advance.

Cheers,
--
?lvaro.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150910/82dd19a4/attachment-0001.html

------------------------------

Message: 2
Date: Thu, 10 Sep 2015 10:03:11 -0500
From: Thoudam Doren Singh <thoudam.doren@gmail.com>
Subject: Re: [Moses-support] Moses Training Error - died with signal
6, without coredump
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAC7R0zwBLUnV_A1vQZwY8LtsN0b4DuH-h2jXyWfbPPxy_XOC5Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Moses training command I use is moses-train.sh


#!/bin/bash
set -x
set -e
HOME=/doren/Workspace
MAIN_DIR=$HOME
# mgiza++ directory
TOOLS_DIR=$HOME/tools
#Moses directory
MOSES_DIR=$HOME/mosesdecoder
export SCRIPTS_ROOTDIR=$MOSES_DIR/scripts
WORKING_DIR=$HOME/SMT-Models
CORPUS_DIR=$HOME/Corpus/Parallel-Corpora
TMPDIR=$HOME/tmp
SRC_LANG=EN
TGT_LANG=HN
SENT_LEN=70
MOSES_ALIGN="grow-diag-final"
MODEL_DIR_PREFIX="$WORKING_DIR/model-en-hn-grow-diag-final"
LM_ORDER=5
LM=$HOME/kenlm/bin/New-Filtered-Mono.Hindiaa.binary
MAX_PHRASE_LEN=7
CORPUS_PREFIX=$CORPUS_DIR/clean-corpus-part1
MODEL_REORDER=hier-mslr-bidirectional-fe
MODEL_DIR=$MODEL_DIR_PREFIX"-"$MODEL_REORDER"-intlm2"
mkdir -p $MODEL_DIR
nohup time $SCRIPTS_ROOTDIR/training/train-model.perl \
-external-bin-dir $TOOLS_DIR \
-model-dir $MODEL_DIR \
-corpus $CORPUS_PREFIX \
-f $SRC_LANG -e $TGT_LANG \
-max-phrase-length $MAX_PHRASE_LEN \
-alignment $MOSES_ALIGN \
-reordering $MODEL_REORDER \
-lm 0:$LM_ORDER:$LM:5 \
-mgiza -mgiza-cpus 12 \
-parallel -cores 4 \
-temp-dir $TMPDIR



Best Regards

Thoudam Doren Singh

On Thu, Sep 10, 2015 at 4:23 AM, Hieu Hoang <hieuhoang@gmail.com> wrote:

> whats the exact command you ran? Can you also attach the config file you
> use
>
>
> On 09/09/2015 23:44, Thoudam Doren Singh wrote:
>
> Hi
>
>
> I am not sure why I am getting this error. Can someone help me out?
> I am sending part of the Moses training messages.
>
>
>
> /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4
> split "sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract
> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract
> 7 orientation --model hier-mslr --GZOutput
> Executing:
> /doren/Workspace/mosesdecoder/scripts/generic/extract-parallel.perl 4 split
> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/extract
> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract
> 7 orientation --model hier-mslr --GZOutput
> MAX 7 1 0
> Started Tue Sep 8 15:21:49 2015
> which: no pigz in
> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
> using gzip
> Usage: split [OPTION]... [INPUT [PREFIX]]
> Output fixed-size pieces of INPUT to PREFIXaa, PREFIXab, ...; default
> size is 1000 lines, and default PREFIX is `x'. With no INPUT, or when
> INPUT
> is -, read standard input.
>
> Mandatory arguments to long options are mandatory for short options too.
> -a, --suffix-length=N use suffixes of length N (default 2)
> -b, --bytes=SIZE put SIZE bytes per output file
> -C, --line-bytes=SIZE put at most SIZE bytes of lines per output file
> -d, --numeric-suffixes use numeric suffixes instead of alphabetic
> -l, --lines=NUMBER put NUMBER lines per output file
> --verbose print a diagnostic just before each
> output file is opened
> --help display this help and exit
> --version output version information and exit
>
> SIZE may be (or may be an integer optionally followed by) one of following:
> KB 1000, K 1024, MB 1000*1000, M 1024*1024, and so on for G, T, P, E, Z, Y.
>
> Report split bugs to bug-coreutils@gnu.org
> GNU coreutils home page: <http://www.gnu.org/software/coreutils/>
> General help using GNU software: <http://www.gnu.org/gethelp/>
> Report split translation bugs to <http://translationproject.org/team/>
> For complete documentation, run: info coreutils 'split invocation'
> isBSDSplit=0
> Executing: mkdir -p
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970;
> ls -l
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
> total=20000 line-per-split=5001
> split -d -l 5001 -a 7
> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.HN
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/target.split
> -d -l 5001 -a 7
> /doren/Workspace/Corpus/Parallel-Corpora/clean-corpus-part1.EN
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/source.split
> -d -l 5001 -a 7
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/aligned.grow-diag-final
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/align.sh:
> /dev/stderr: Not a directory
> sh: /dev/stderr: Not a directory
> sh: /dev/stderr: Not a directory
> sh: /dev/stderr: Not a directory
> merging extract / extract.inv
> gunzip -c
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz
> | LC_ALL=C sort -T
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
> 2>> /dev/stderr | gzip -c >
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
> 2>> /dev/stderr
> gunzip -c
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz
> | LC_ALL=C sort -T
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970
> 2>> /dev/stderr | gzip -c >
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
> 2>> /dev/stderr
> sh: /dev/stderr: Not a directory
> gzip:
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.gz:
> No such file or directory
> sh: /dev/stderr: Not a directory
> sh: /dev/stderr: Not a directory
> sh: /dev/stderr: Not a directory
> gzip:
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000000.inv.gz:
> No such file or directory
> gzip: gzip:
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.gz:
> No such file or directory
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000001.inv.gz:
> No such file or directory
> gzip:
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.gz:
> No such file or directory
> gzip:
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000002.inv.gz:
> No such file or directory
> gzip:
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.gz:
> No such file or directory
> gzip:
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.7970/extract.0000003.inv.gz:
> No such file or directory
> Finished Tue Sep 8 15:21:50 2015
> (6) score phrases @ Tue Sep 8 15:21:50 CDT 2015
> (6.1) creating table half
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e
> @ Tue Sep 8 15:21:50 CDT 2015
> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
> 0
> Executing:
> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
> 0
> (6.1) creating table half
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f
> @ Tue Sep 8 15:21:50 CDT 2015
> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
> --Inverse 1
> Executing:
> /doren/Workspace/mosesdecoder/scripts/generic/score-parallel.perl 4
> "sort " /doren/Workspace/mosesdecoder/scripts/../bin/score
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
> --Inverse 1
> which: no pigz in
> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
> which: no pigz in
> (/opt/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/bio/ncbi/bin:/opt/bio/mpiblast/bin:/opt/bio/EMBOSS/bin:/opt/bio/clustalw/bin:/opt/bio/tcoffee/bin:/opt/bio/hmmer/bin:/opt/bio/phylip/exe:/opt/bio/mrbayes:/opt/bio/fasta:/opt/bio/glimmer/bin:/opt/bio/glimmer/scripts:/opt/bio/gromacs/bin:/opt/bio/gmap/bin:/opt/bio/tigr/bin:/opt/bio/autodocksuite/bin:/opt/bio/wgs/bin:/opt/ganglia/bin:/opt/ganglia/sbin:/usr/java/latest/bin:/opt/maui/bin:/opt/torque/bin:/opt/torque/sbin:/opt/pdsh/bin:/opt/rocks/bin:/opt/rocks/sbin:/home/tsingh3/bin)
> using gzip
> Started Tue Sep 8 15:21:50 2015
> using gzip
> Started Tue Sep 8 15:21:50 2015
>
> gzip:
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.inv.sorted.gz:
> unexpected end of file
>
> gzip:
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.sorted.gz:
> unexpected end of file
> /doren/Workspace/mosesdecoder/scripts/../bin/score
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/extract.0.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.e2f
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.0000000.gz
> --Inverse 2>> /dev/stderr
> /doren/Workspace/mosesdecoder/scripts/../bin/score
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/extract.0.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/lex.f2e
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz
> 2>> /dev/stderr
>
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/
> run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.0.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.1.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.2.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/run.3.sh/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/run.0.sh:
> line 1: /dev/stderr: Not a directory
>
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/
> run.0.sh: line 1: /dev/stderr: Not a directory
> mv
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gzmv:
> cannot stat
> `/doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8017/phrase-table.half.0000000.gz':
> No such file or directory
> gunzip -c
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018/phrase-table.half.*.gz
> 2>> /dev/stderr| LC_ALL=C sort -T
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/tmp.8018
> | gzip -c >
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
> 2>> /dev/stderr sh: /dev/stderr: Not a directory
> sh: /dev/stderr: Not a directory
> Exit code: 1
> ERROR: Scoring of phrases failed at
> /doren/Workspace/mosesdecoder/scripts/training/train-model.perl line 1773.
> Exit code: 1
> ERROR: Scoring of phrases failed at
> /doren/Workspace/mosesdecoder/scripts/training/train-model.perl line 1773.
> (6.6) consolidating the two halves @ Tue Sep 8 15:21:50 CDT 2015
> Executing: /doren/Workspace/mosesdecoder/scripts/../bin/consolidate
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.e2f.gz
> /dev/stdout | gzip -c >
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.gz
> Consolidate v2.0 written by Philipp Koehn
> consolidating direct and indirect rule tables
> terminate called after throwing an instance of 'std::runtime_error'
> what(): Could not open
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.f2e.gz.
> Executing: rm -f
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/phrase-table.half.*
> (7) learn reordering model @ Tue Sep 8 15:21:51 CDT 2015
> (7.1) [no factors] learn reordering model @ Tue Sep 8 15:21:51 CDT 2015
> (7.2) building tables @ Tue Sep 8 15:21:51 CDT 2015
> Executing:
> /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
> 0.5
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table.
> --model "hier mslr hier-mslr-bidirectional-fe"
> Lexical Reordering Scorer
> scores lexical reordering models of several types (hierarchical,
> phrase-based and word-based-extraction
> terminate called after throwing an instance of 'util::ErrnoException'
> what(): util/file.cc:68 in int util::OpenReadOrThrow(const char*) threw
> ErrnoException because `-1 == (ret = open(name, 00))'.
> No such file or directory while opening
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
> ERROR: Execution of:
> /doren/Workspace/mosesdecoder/scripts/../bin/lexical-reordering-score
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/extract.o.sorted.gz
> 0.5
> /doren/Workspace/SMT-Models/model-en-hn-grow-diag-final-hier-mslr-bidirectional-fe-intlm2/reordering-table.
> --model "hier mslr hier-mslr-bidirectional-fe"
> died with signal 6, without coredump
> 823.89user 55.26system 3:53.03elapsed 377%CPU (0avgtext+0avgdata
> 629344maxresident)k
> 27176inputs+273160outputs (28major+2115194minor)pagefaults 0swaps
>
>
>
>
> Best Regards
>
>
> Thoudam Doren Singh
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> --
> Hieu Hoanghttp://www.hoang.co.uk/hieu
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150910/81c6a762/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 107, Issue 27
**********************************************

0 Response to "Moses-support Digest, Vol 107, Issue 27"

Post a Comment

Subscribe to: Post Comments (Atom)