Moses-support Digest, Vol 97, Issue 44

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Training Progress indicator (Raj Dabre)
2. binarise of the arpa file (emna hkiri)
3. Re: Training Progress indicator (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Mon, 17 Nov 2014 19:15:24 +0900
From: Raj Dabre <prajdabre@gmail.com>
Subject: Re: [Moses-support] Training Progress indicator
To: "i.ramadan@saudisoft.com" <i.ramadan@saudisoft.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAB3gfjD0VKDWLhNvk=_6cvf5qQOXqYxbPBpLr7ne_Af7B2SfWw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Ihab,

Im afraid that there is no easy way to do that.
The only thing you can do is detect which stage of the training you are on.
For example: There are a total of 7 steps in training: You can simply grep
the .out file and find out which stage of the training you are on.

Regards.

On Mon, Nov 17, 2014 at 6:55 PM, Ihab Ramadan <i.ramadan@saudisoft.com>
wrote:

> Thanks Raj for your reply
>
> I already can get the output from the training process I just want to get
> the progress in a percentage format ( 10% -- 20% -- 30% ) or find some way
> to calculate it
>
>
>
>
>
> *From:* Raj Dabre [mailto:prajdabre@gmail.com]
> *Sent:* Monday, November 17, 2014 11:31 AM
> *To:* i.ramadan@saudisoft.com
> *Cc:* moses-support@mit.edu
> *Subject:* Re: [Moses-support] Training Progress indicator
>
>
>
> Are you using: nohup nice -n 19 (training script line) > training.out& ????
>
> if so keep looking at the tail of training.out (or whichever .out file you
> are using) to check for progress.
>
>
>
> On Mon, Nov 17, 2014 at 6:10 PM, Ihab Ramadan <i.ramadan@saudisoft.com>
> wrote:
>
> Dear All,
>
> Is there any way to know the progress of the training process or any other
> process ?
>
>
>
> Note: lately I do not receive reply for my questions , how to make sure
> that I have no problem in receiving emails from your side?
>
> Thanks
>
>
>
> Best Regards
>
> *Ihab Ramadan*| Senior Developer| Saudisoft <http://www.saudisoft.com/> -
> Egypt | *Tel * +2 02 330 320 37 Ext- 0 | Mob+201007570826 | Fax
> +20233032036 | *Follow us on *[image: linked]
> <http://www.linkedin.com/company/77017?trk=vsrp_companies_res_name&trkInfo=VSRPsearchId%3A1489659901402995947155%2CVSRPtargetId%3A77017%2CVSRPcmpt%3Aprimary>* |
> **[image: ZA102637861]*
> <https://www.facebook.com/pages/Saudisoft-Co-Ltd/289968997768973?ref_type=bookmark>* |
> **[image: ZA102637858]* <https://twitter.com/Saudisoft>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
>
> Raj Dabre.
> Research Student,
>
> Graduate School of Informatics,
> Kyoto University.
>
> CSE MTech, IITB., 2011-2014
>



--
Raj Dabre.
Research Student,
Graduate School of Informatics,
Kyoto University.
CSE MTech, IITB., 2011-2014
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141117/90476e5a/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.gif
Type: image/gif
Size: 1314 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141117/90476e5a/attachment-0003.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 1351 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141117/90476e5a/attachment-0004.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 1317 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141117/90476e5a/attachment-0005.gif

------------------------------

Message: 2
Date: Mon, 17 Nov 2014 11:17:18 +0100
From: emna hkiri <emna.hkiri@gmail.com>
Subject: [Moses-support] binarise of the arpa file
To: moses-support@mit.edu
Message-ID:
<CAAp-nZ3=dzB5B6Y_6-iF=agkCYnmzPwTpiRUjF18OaBk7Y8ALw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear Friends
i'm trying to build an arabic language model.
the error is in the binarise of the .arpa file command (
/home/emna/emna/mosesdecoder/bin/build_binary 2000.arpa.ar \
2000.blm.ar)

i have this error would you help me please/

lm/read_arpa.cc:151 in void lm::PositiveProbWarn::Warn(float) threw
FormatLoadException'.
Positive log probability 2.40965e-07 in the model. This is a bug in
IRSTLM; you can set config.positive_log_probability = SILENT or pass -i to
build_binary to substitute 0.0 for the log probability. Error in the
3-gram at byte 195895800 Byte: 195895800 File: 2000.arpa.ar
ERROR


the code is as follows:
/home/emna/emna/irstlm/bin/add-start-end.sh \
< /home/emna/emna/corpus/2000.true.ar \
> 2000.sb.ar
export IRSTLM=$HOME/emna/irstlm; /home/emna/emna/irstlm/bin/build-lm.sh \
-i 2000.sb.ar \
-t ./tmp -p -s improved-kneser-ney -o 2000.lm.ar
/home/emna/emna/irstlm/bin/compile-lm --text 2000.lm.ar.gz \
2000.arpa.ar
/home/emna/emna/mosesdecoder/bin/build_binary 2000.arpa.ar \
2000.blm.ar
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141117/1fc02b4a/attachment-0001.htm

------------------------------

Message: 3
Date: Mon, 17 Nov 2014 10:27:52 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Training Progress indicator
To: i.ramadan@saudisoft.com
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbiivrE3=zDaJ8snOhB2KwU1Bvj5tYfaf_KNRH_jm8+LaA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

On 17 November 2014 09:10, Ihab Ramadan <i.ramadan@saudisoft.com> wrote:

> Dear All,
>
> Is there any way to know the progress of the training process or any other
> process ?
>
>
>
> Note: lately I do not receive reply for my questions , how to make sure
> that I have no problem in receiving emails from your side?
>
we receive your questions. You can check for yourself in the archive
https://www.mail-archive.com/moses-support@mit.edu/
You are more likely to get replies if
1. Try your best to solve your problem before asking questions so you
only ask a small number of more difficult questions.
2. Answer other peoples questions, or commit some code or documentation,
or be generally useful to the community

Thanks
>
>
>
> Best Regards
>
> *Ihab Ramadan*| Senior Developer| Saudisoft <http://www.saudisoft.com/> -
> Egypt | *Tel * +2 02 330 320 37 Ext- 0 | Mob+201007570826 | Fax
> +20233032036 | *Follow us on *[image: linked]
> <http://www.linkedin.com/company/77017?trk=vsrp_companies_res_name&trkInfo=VSRPsearchId%3A1489659901402995947155%2CVSRPtargetId%3A77017%2CVSRPcmpt%3Aprimary>* |
> **[image: ZA102637861]*
> <https://www.facebook.com/pages/Saudisoft-Co-Ltd/289968997768973?ref_type=bookmark>* |
> **[image: ZA102637858]* <https://twitter.com/Saudisoft>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141117/404168c5/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 1317 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141117/404168c5/attachment.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 1351 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141117/404168c5/attachment-0001.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.gif
Type: image/gif
Size: 1314 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141117/404168c5/attachment-0002.gif

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 97, Issue 44
*********************************************

Tweet