Moses-support Digest, Vol 126, Issue 1

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: ERROR: Lexical reordering scoring failed (Philipp Koehn)
2. Re: Training vs Incremental Training (Philipp Koehn)


----------------------------------------------------------------------

Message: 1
Date: Fri, 31 Mar 2017 16:25:50 -0400
From: Philipp Koehn <phi@jhu.edu>
Subject: Re: [Moses-support] ERROR: Lexical reordering scoring failed
To: Anna Kup? <aniakups@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDBt1pnaJkm__0Qya5kT1FwYpE3Ztzb=C871hk-8t29xUQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

can you check if the line

inhaled corticosteroids ||| inhalative Kortikoichaemic ||| isch?mische |||
mono other

really occurs in the extract.o file?

It should only have source / target / reordering status, not 4 entries.

Did something go wrong when the extract file was created (out of disk
space?).

Do you have "|||" in the corpus?

Did you try re-running extract & build reorder?

-phi


On Tue, Mar 28, 2017 at 10:03 AM, Anna Kup? <aniakups@gmail.com> wrote:

>
> Hi,
>
> I got the following error while using Experiment Management System:
>
> ==> TRAINING_build-reordering.3 <==
>
> PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/
> sbin:/bin:/snap/bin:/snap/bin"
> cd /root/working/experiments
> echo 'starting at '`date`' on '`hostname`
> mkdir -p /root/working/experiments/training
>
> /root/mosesdecoder/scripts/training/train-model.perl -mgiza -mgiza-cpus 8
> -dont-zip -first-step 7 -last-step 7 -external-bin-dir
> /root/mosesdecoder/tools -f en -e de -alignment grow-diag-final-and
> -reordering msd-bidirectional-fe -extract-file /root/working/experiments/model/extract.2
> -reordering-table /root/working/experiments/model/reordering-table.3
>
> echo 'finished at '`date`
> touch /root/working/experiments/steps/3/TRAINING_build-reordering.3.DONE
>
> ==> TRAINING_build-reordering.3.INFO <==
> lexicalized-reordering = msd-bidirectional-fe
> INPUT = USED /root/working/experiments/model/extract.2
> # reuse run 2 for TRAINING:extract-phrases
>
> ==> TRAINING_build-reordering.3.STDERR <==
> Using SCRIPTS_ROOTDIR: /root/mosesdecoder/scripts
> using gzip
> (7) learn reordering model @ Tue Mar 28 12:19:55 CEST 2017
> (7.1) [no factors] learn reordering model @ Tue Mar 28 12:19:55 CEST 2017
> (7.2) building tables @ Tue Mar 28 12:19:55 CEST 2017
> Executing: /root/mosesdecoder/scripts/../bin/lexical-reordering-score
> /root/working/experiments/model/extract.2.o.sorted.gz 0.5
> /root/working/experiments/model/reordering-table.3. --model "wbe msd
> wbe-msd-bidirectional-fe"
> Lexical Reordering Scorer
> scores lexical reordering models of several types (hierarchical,
> phrase-based and word-based-extraction
>
> ==> TRAINING_build-reordering.3.STDOUT <==
> starting at Di 28. M?r 12:19:54 CEST 2017 on machine-VirtualBox
>
> ==> TRAINING_build-reordering.3.STDERR <==
> terminate called after throwing an instance of 'FileFormatException'
> what(): phrase-extract/lexical-reordering/score.cpp:260 in void
> split_line(const StringPiece&, StringPiece&, StringPiece&, StringPiece&,
> StringPiece&, StringPiece&, float&) threw FileFormatException because
> `errIndex == next.data()'.
> Invalid extract file format: inhaled corticosteroids ||| inhalative
> Kortikoichaemic ||| isch?mische ||| mono other
> Aborted (core dumped)
> Exit code: 134
> *ERROR: Lexical reordering scoring failed at
> /root/mosesdecoder/scripts/training/train-model.perl line 1924.*
>
> Does someone know how to get rid of that problem?
>
> Thanks in advance and best regards,
> Anna
>
> --
> Anna Kup?
> +48 782 823 850 <+48%20782%20823%20850> | www.linkedin.com/in/annakups
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170331/1e62813a/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 31 Mar 2017 16:27:46 -0400
From: Philipp Koehn <phi@jhu.edu>
Subject: Re: [Moses-support] Training vs Incremental Training
To: Adel Khalifa <adelkhalifa9@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDAWC8zHibiEaFQnJ3OCcP7ZKDq11vrhtkAN9bWBe_PVrw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

there are various versions of incremental training, but full re-training
from scratch will give better results, since incremental word alignment
will not be as good as full word alignment.

-phi

On Thu, Mar 23, 2017 at 9:49 AM, Adel Khalifa <adelkhalifa9@gmail.com>
wrote:

> Dear all,
>
> I just need to Know what is the difference between Training & Incremental
> Training rather than time.
>
> Regards,
> Adel Khalifa .. Software developer
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170331/9f3b6ded/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 126, Issue 1
*********************************************

Tweet