Moses-support Digest, Vol 130, Issue 9

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Error while Training at Step 5 (Aileen Joan Vicente)
2. Meaning of probabilities in Word lattices and how Moses
decodes them. (Sanket Gandhare)


----------------------------------------------------------------------

Message: 1
Date: Sun, 20 Aug 2017 20:22:13 +0800
From: Aileen Joan Vicente <aovicente@up.edu.ph>
Subject: [Moses-support] Error while Training at Step 5
To: moses-support@mit.edu
Message-ID: <21516CC6-48E4-48CB-8C4F-AAC507155E81@up.edu.ph>
Content-Type: text/plain; charset="us-ascii"


>>
>> Hi! I ran training.perl, succeeded but found an empty phrase table. I googled around to look for answer and some guy advised to check the logs. I wonder if the problem is caused by this error in Step 5. Please help.
>>
>> Using SCRIPTS_ROOTDIR: /Users/dcs/Moses/tools/mosesdecoder/scripts
>> using gzip
>> (5) extract phrases @ Sun Aug 20 19:26:48 PHT 2017
>> MAX 7 0 0
>> /Users/dcs/Moses/tools/mosesdecoder/scripts/generic/extract-parallel.perl 4 split "sort " /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.en /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.cbk /Users/dcs/Desktop/Corpus/training/model/aligned.grow-diag-final /Users/dcs/Desktop/Corpus/training/model/extract 7 --GZOutput
>> Executing: /Users/dcs/Moses/tools/mosesdecoder/scripts/generic/extract-parallel.perl 4 split "sort " /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.en /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.cbk /Users/dcs/Desktop/Corpus/training/model/aligned.grow-diag-final /Users/dcs/Desktop/Corpus/training/model/extract 7 --GZOutput
>> Started Sun Aug 20 19:26:48 2017
>> using gzip
>> split: illegal option -- -
>> usage: split [-a sufflen] [-b byte_count] [-l line_count] [-p pattern]
>> [file [prefix]]
>> isBSDSplit=1
>> Executing: mkdir -p /Users/dcs/Desktop/Corpus/training/model/tmp.798; ls -l /Users/dcs/Desktop/Corpus/training/model/tmp.798
>> total=2942 line-per-split=736
>> split -l 736 -a 7 /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.en /Users/dcs/Desktop/Corpus/training/model/tmp.798/target.split -l 736 -a 7 /Users/dcs/Desktop/Corpus/training/corpus/mycorpus.cbk /Users/dcs/Desktop/Corpus/training/model/tmp.798/source.split -l 736 -a 7 /Users/dcs/Desktop/Corpus/training/model/aligned.grow-diag-final /Users/dcs/Desktop/Corpus/training/model/tmp.798/align.sh: /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No such file or directory
>> sh: /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No such file or directory
>> sh: /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No such file or directory
>> sh: /Users/dcs/Moses/tools/mosesdecoder/scripts/../bin/extract: No such file or directory
>> merging extract / extract.inv
>> gunzip -c /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.gz /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.gz /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.gz /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.gz | LC_ALL=C sort -T /Users/dcs/Desktop/Corpus/training/model/tmp.798 2>> /dev/stderr | gzip -c > /Users/dcs/Desktop/Corpus/training/model/extract.sorted.gz 2>> /dev/stderr
>> gunzip -c /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.inv.gz /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.inv.gz /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.inv.gz /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.inv.gz | LC_ALL=C sort -T /Users/dcs/Desktop/Corpus/training/model/tmp.798 2>> /dev/stderr | gzip -c > /Users/dcs/Desktop/Corpus/training/model/extract.inv.sorted.gz 2>> /dev/stderr
>> gunzip: can't stat: /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.inv.gz (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.inv.gz.gz): No such file or directory
>> gunzip: can't stat: /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.inv.gz (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.inv.gz.gz): No such file or directory
>> gunzip: can't stat: /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.inv.gz (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.inv.gz.gz): No such file or directory
>> gunzip: can't stat: /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.inv.gz (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.inv.gz.gz): No such file or directory
>> gunzip: can't stat: /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.gz (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaaa.gz.gz): No such file or directory
>> gunzip: can't stat: /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.gz (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaab.gz.gz): No such file or directory
>> gunzip: can't stat: /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.gz (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaac.gz.gz): No such file or directory
>> gunzip: can't stat: /Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.gz (/Users/dcs/Desktop/Corpus/training/model/tmp.798/extract.aaaaaad.gz.gz): No such file or directory
>> Finished Sun Aug 20 19:26:48 2017
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170820/b28e4189/attachment-0001.html

------------------------------

Message: 2
Date: Sun, 20 Aug 2017 18:09:15 +0530
From: Sanket Gandhare <sanketgandhare1991.sg@gmail.com>
Subject: [Moses-support] Meaning of probabilities in Word lattices and
how Moses decodes them.
To: moses-support@mit.edu
Message-ID:
<CAG7UqeSuorwEaJx_S2y=fK72K2ZCwLpD0Pc=n+vTpo4yMD=WfA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello all,

I want to give input to moses in lattice format but I am not sure what
the probabilities in the lattice mean. I went through this link :

http://www.statmt.org/moses/?n=Moses.WordLattices

Also, how these probabilities calculated. What algorithm Moses uses to
decode these word lattices?

Please give me idea of all this.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170820/a3a72f80/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 130, Issue 9
*********************************************

Tweet