Moses-support Digest, Vol 89, Issue 3

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. format change in phrase table halves (because of bug with
hiero systems) (Rico Sennrich)
2. Re: Tokenisation issue - following the implementation
baseline (Janez Kadivec)
3. giza-training-error-EMS (nadeem khan)


----------------------------------------------------------------------

Message: 1
Date: Sun, 2 Mar 2014 17:38:16 +0000 (UTC)
From: Rico Sennrich <rico.sennrich@gmx.ch>
Subject: [Moses-support] format change in phrase table halves (because
of bug with hiero systems)
To: moses-support@MIT.EDU
Message-ID: <loom.20140302T175656-290@post.gmane.org>
Content-Type: text/plain; charset=us-ascii

Hi list,

I swapped the score and alignment column of the phrase table halves in
commit 01bc3c1. The format of the final phrase table is not affected. If you
know of any side effects (such as downstream software that relies on the
column order in the phrase table halves), please complain here.

We recently found a bug with hierarchical/syntactic models that had multiple
rules with the same source and target phrase, but different non-terminal
alignments. The current implementation does not guarantee that the order of
such rules is the same in both phrase table halves, and may cause the scores
of two rules to be swapped.

To ensure that the rules are sorted in the same order in both halves (and
can be consolidated), the scorer now writes the alignment info to both
phrase table halves (for hierarchical models), and puts the alignment before
the scores.

While the change is only important for hierarchical/syntactic models, I
applied it to all models for consistency.

-
Rico



------------------------------

Message: 2
Date: Mon, 3 Mar 2014 08:58:27 +0100
From: Janez Kadivec <jankad@zop-cr.com>
Subject: Re: [Moses-support] Tokenisation issue - following the
implementation baseline
To: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CA+viJsfrYqC3XzJvzTt4O2o2TGETsDst=m0BMhgkjJoRXWnEMQ@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi.

It worked without the "\" character. The entire command was entered as a
single line. After that I found also the output file.

Thank's for the help.

Lep pozdrav! Best regards!
Janez Kadivec


Call
Send SMS
Add to Skype
You'll need Skype CreditFree via Skype
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140303/9f1a785a/attachment-0001.htm

------------------------------

Message: 3
Date: Mon, 3 Mar 2014 03:02:21 -0800 (PST)
From: nadeem khan <nad_star06@yahoo.com>
Subject: [Moses-support] giza-training-error-EMS
To: moses-support <moses-support@mit.edu>, Hieu Hoang
<hieuhoang@gmail.com>
Message-ID:
<1393844541.18926.YahooMailNeo@web162402.mail.bf1.yahoo.com>
Content-Type: text/plain; charset="iso-8859-1"

HI All;
I am getting the giza failed error on EMS moses toy data default that is given in example of EMS.
using ubuntu 12.04
please check out the attached screen shot and? EMS step files attached..

Error is :

ERROR: Giza did not produce the output file /home/legends/work/ems-toy/training/giza.1/en-fr.A3.final. Is your corpus clean (reasonably-sized sentences)? at /home/legends/tools/mosesdecoder-RELEASE-2.1/scripts/training/train-model.perl line 1178.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140303/8824e236/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: giza-training.tar.gz
Type: application/x-gzip
Size: 8309 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140303/8824e236/attachment.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Screenshot from 2014-03-03 02:56:47.png
Type: image/png
Size: 216756 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140303/8824e236/attachment.png

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 89, Issue 3
********************************************

Tweet