Moses-support Digest, Vol 110, Issue 9

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Exit code: 127 ERROR: Can't generate symmetrized
alignment file (Read, James C)


----------------------------------------------------------------------

Message: 1
Date: Thu, 3 Dec 2015 16:49:01 +0000
From: "Read, James C" <jcread@essex.ac.uk>
Subject: Re: [Moses-support] Exit code: 127 ERROR: Can't generate
symmetrized alignment file
To: Philipp Koehn <phi@jhu.edu>
Cc: Moses Support <moses-support@mit.edu>
Message-ID:
<DB5PR06MB14780D4830D15E36E7239103850D0@DB5PR06MB1478.eurprd06.prod.outlook.com>

Content-Type: text/plain; charset="iso-8859-1"

Indeed.


On this box I will not be making use of the decoder and most of the Moses software. All I need is for the training script to complete and to be able to use evaluation scripts to output bleu scores at the end. Will be using own custom translation software. Just need a phrase table to extract information from to make own custom translation tables.


Which binaries need to be compiled to make the training script complete? Any suggestions for modifications to install scripts so I can install only the essential components would be most welcomed.


James


________________________________
From: phkoehn@gmail.com <phkoehn@gmail.com> on behalf of Philipp Koehn <phi@jhu.edu>
Sent: Wednesday, December 2, 2015 9:22 PM
To: Read, James C
Cc: Moses Support
Subject: Re: [Moses-support] Exit code: 127 ERROR: Can't generate symmetrized alignment file

Hi,

it looks like that symal was not compiled - it should be in $MOSES/bin

Can you check what went wrong during compilation?

-phi

On Wed, Dec 2, 2015 at 10:21 AM, Read, James C <jcread@essex.ac.uk<mailto:jcread@essex.ac.uk>> wrote:

nohup nice /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/train-model.perl -root-dir phrase_table -corpus /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/europarl-v7.it-en.1-0010.00001000 -f it -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/media/bigdata/jcread/llv/lm:8 -external-bin-dir /media/bigdata/jcread/3rd_party_software/bin >& training.out &



Runs well for a while and then bombs out with following output and Error 127



(3) generate word alignment @ Wed Dec 2 01:56:06 GMT 2015
Combining forward and inverted alignment from files:
/media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/giza.it-en/it-en.A3.final.{bz2,gz}
/media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/giza.en-it/en-it.A3.final.{bz2,gz}
Executing: mkdir -p /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/model
Executing: /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/training/giza2bal.pl<http://giza2bal.pl> -d "gzip -cd /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/giza.en-it/en-it.A3.final.gz" -i "gzip -cd /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/giza.it-en/it-en.A3.final.gz" |/media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/../bin/symal -alignment="grow" -diagonal="yes" -final="yes" -both="yes" > /media/bigdata/jcread/llv/data/europarlv7/prealigned/tokenized_truecased_cleaned/1-0010/00001000/phrase_table/model/aligned.grow-diag-final-and
sh: 1: /media/bigdata/jcread/3rd_party_software/mosesdecoder/scripts/../bin/symal: not found
Exit code: 127
ERROR: Can't generate symmetrized alignment file


It seems this problem with the script has been encountered before:


http://comments.gmane.org/gmane.comp.nlp.moses.user/10489


I'm not sure I understand the accepted solution.


"Use absolute paths to all the scripts, and make sure your parallel files have the same names but the extension"


The command I issued uses only absolute paths. Is this referring to modifications in the training script itself?


James


_______________________________________________
Moses-support mailing list
Moses-support@mit.edu<mailto:Moses-support@mit.edu>
http://mailman.mit.edu/mailman/listinfo/moses-support


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151203/59cda744/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 110, Issue 9
*********************************************

Tweet