Moses-support Digest, Vol 130, Issue 10

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Error while Training at Step 5 (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Sun, 20 Aug 2017 20:59:19 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Error while Training at Step 5
To: Aileen Joan Vicente <aovicente@up.edu.ph>, moses-support@mit.edu
Message-ID: <49677c80-21d6-26cd-9a96-6601e259cf83@gmail.com>
Content-Type: text/plain; charset="windows-1252"

it looks like you're using Mac OSX. You must make sure that the GNU
version of sort and split, not the BSD version. Moses has been tested on
OSX using MacPorts to install sort and split so you should install MacPorts

??? https://www.macports.org/



On 20/08/2017 13:22, Aileen Joan Vicente wrote:
>
>>>
>>> Hi! I ran training.perl, succeeded but found an empty phrase table.
>>> I googled around to look for answer and some guy advised to check
>>> the logs. I wonder if the problem is caused by this error in Step 5.
>>> Please help.
>>>
>>> Using SCRIPTS_ROOTDIR: /Users/dcs/Moses/tools/mosesdecoder/scripts
>>> using gzip
>>> (5) extract phrases @ Sun Aug 20 19:26:48 PHT 2017
>>> MAX 7 0 0
>>> /Users/dcs/Moses/tools/mosesdecoder/scripts/generic/extract-parallel.perl
>>> 4 split "sort? ? "
>>> /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract
>>> /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.en
>>> /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.cbk
>>> /Users/dcs/Desktop/Corpus/training/model/aligned.grow-diag-final
>>> /Users/dcs/Desktop/Corpus/training/model/extract 7 --GZOutput
>>> Executing:
>>> /Users/dcs/Moses/tools/mosesdecoder/scripts/generic/extract-parallel.perl
>>> 4 split "sort? ? "
>>> /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract
>>> /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.en
>>> /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.cbk
>>> /Users/dcs/Desktop/Corpus/training/model/aligned.grow-diag-final
>>> /Users/dcs/Desktop/Corpus/training/model/extract 7 --GZOutput
>>> Started Sun Aug 20 19:26:48 2017
>>> using gzip
>>> split: illegal option -- -
>>> usage: split [-a sufflen] [-b byte_count] [-l line_count] [-p pattern]
>>> [file [prefix]]
>>> isBSDSplit=1
>>> Executing: mkdir -p
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798; ls -l
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798
>>> total=2942 line-per-split=736
>>> split? -l 736 -a 7
>>> /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.en
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/target.split? -l
>>> 736 -a 7 /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.cbk
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/source.split? -l
>>> 736 -a 7
>>> /Users/dcs/Desktop/Corpus/training/model/aligned.grow-diag-final
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/align.sh:
>>> /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No such
>>> file or directory
>>> sh: /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No
>>> such file or directory
>>> sh: /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No
>>> such file or directory
>>> sh: /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No
>>> such file or directory
>>> merging extract / extract.inv
>>> gunzip -c
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.gz
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.gz
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.gz
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.gz?
>>> | LC_ALL=C sort ? ? -T
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798 2>> /dev/stderr |
>>> gzip -c > /Users/dcs/Desktop/Corpus/training/model/extract.sorted.gz
>>> 2>> /dev/stderr
>>> gunzip -c
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.inv.gz
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.inv.gz
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.inv.gz
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.inv.gz
>>> | LC_ALL=C sort ? ? -T
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798 2>> /dev/stderr |
>>> gzip -c >
>>> /Users/dcs/Desktop/Corpus/training/model/extract.inv.sorted.gz 2>>
>>> /dev/stderr
>>> gunzip: can't stat:
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.inv.gz
>>> (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.inv.gz.gz):
>>> No such file or directory
>>> gunzip: can't stat:
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.inv.gz
>>> (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.inv.gz.gz):
>>> No such file or directory
>>> gunzip: can't stat:
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.inv.gz
>>> (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.inv.gz.gz):
>>> No such file or directory
>>> gunzip: can't stat:
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.inv.gz
>>> (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.inv.gz.gz):
>>> No such file or directory
>>> gunzip: can't stat:
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.gz
>>> (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.gz.gz):
>>> No such file or directory
>>> gunzip: can't stat:
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.gz
>>> (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.gz.gz):
>>> No such file or directory
>>> gunzip: can't stat:
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.gz
>>> (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.gz.gz):
>>> No such file or directory
>>> gunzip: can't stat:
>>> /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.gz
>>> (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.gz.gz):
>>> No such file or directory
>>> Finished Sun Aug 20 19:26:48 2017
>>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

--
Hieu Hoang
http://moses-smt.org/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170820/46ed75c9/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 130, Issue 10
**********************************************

Tweet