Moses-support Digest, Vol 104, Issue 44

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Moses-support post from alefya-fida@hotmail.com requires
approval (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 18 Jun 2015 15:47:31 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Moses-support post from
alefya-fida@hotmail.com requires approval
To: Alefya Fida Ali <alefya-fida@hotmail.com>, moses-support
<moses-support@mit.edu>
Message-ID: <5582AFD3.1000902@gmail.com>
Content-Type: text/plain; charset="windows-1252"

I think it's
-glue-grammar-file path/name
eg.
http://www.statmt.org/moses/RELEASE-3.0/models/en-cs/steps/2/TRAINING_extract-phrases.2

On 18/06/2015 15:35, Alefya Fida Ali wrote:
>
> i used this command for training. a rule table is generated in the
> training folder but no glue grammer. M i missing something here?
>
>
> nohup nice
> /share/apps/packages/MosesSMT/mosesdecoder-master/scripts/training/train-model.perl
> -root-dir train -corpus $HOME/USMT/data/training/train.clean -f ur -e
> en -alignment grow-diag-final-and -hierarchical ?glue-grammar -lm
> 0:5:$HOME/USMT/HSMT/lm-ur-en/train-ur-en.lm.en.arpa.gz:8
> -external-bin-dir $HOME/USMT/PBSMT/tools >& training.out &
>
>
>
> ------------------------------------------------------------------------
> From: alefya-fida@hotmail.com
> To: hieuhoang@gmail.com
> Subject: RE: Moses-support post from alefya-fida@hotmail.com requires
> approval
> Date: Thu, 18 Jun 2015 16:02:37 +0500
>
> I had already subscribed there before mailing, but haven't received
> any confirmation yet. I was in bit hurry so I posted before
> confirmation. sorry for inconvenience.
>
> i had done some experimenting with command. but still it gives me the
> same error about run1.best100.out empty. attached is the mosses file
> generated. and also my input file isn't empty. i have also attached my
> input file
> ------------------------------------------------------------------------
> Date: Thu, 18 Jun 2015 13:59:51 +0400
> Subject: Fwd: Moses-support post from alefya-fida@hotmail.com requires
> approval
> From: hieuhoang@gmail.com
> To: alefya-fida@hotmail.com
>
> Please subscribe to the mailing list before posting to it. You can
> subscribe here:
> http://mailman.mit.edu/mailman/listinfo/moses-support
> Can you please send the moses.ini file so we can have a look at it.
> Also, is your input file empty?
>
>
> Hieu Hoang
> Researcher
> New York University, Abu Dhabi
> http://www.hoang.co.uk/hieu
>
> ---------- Forwarded message ----------
> From: <moses-support-owner@mit.edu <mailto:moses-support-owner@mit.edu>>
> Date: 17 June 2015 at 09:53
> Subject: Moses-support post from alefya-fida@hotmail.com
> <mailto:alefya-fida@hotmail.com> requires approval
> To: moses-support-owner@mit.edu <mailto:moses-support-owner@mit.edu>
>
>
> As list administrator, your authorization is requested for the
> following mailing list posting:
>
> List: Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> From: alefya-fida@hotmail.com <mailto:alefya-fida@hotmail.com>
> Subject: tuning failed to complete for hierarchical SMT
> Reason: Post by non-member to a members-only list
>
> At your convenience, visit:
>
> http://mailman.mit.edu/mailman/admindb/moses-support
>
> to approve or deny the request.
>
>
> ---------- Forwarded message ----------
> From: Alefya Fida Ali <alefya-fida@hotmail.com
> <mailto:alefya-fida@hotmail.com>>
> To: "moses-support@mit.edu <mailto:moses-support@mit.edu>"
> <moses-support@mit.edu <mailto:moses-support@mit.edu>>
> Cc:
> Date: Wed, 17 Jun 2015 10:53:45 +0500
> Subject: tuning failed to complete for hierarchical SMT
> I m trying to built and urdu-english Hierarchical system. but tuning
> fails at "Line empty in nbestlist 'run1.best100.out' at
> /share/apps/packages/MosesSMT/mosesdecoder-master/scripts/training/mert-moses.pl
> <http://mert-moses.pl> line 1452." it gives me empty run1.out and
> run1.best100.out files.
> i have used the following script for tuning
>
>
> nohup nice
> /share/apps/packages/MosesSMT/mosesdecoder-master/scripts/training/mert-moses.pl
> <http://mert-moses.pl> $HOME/USMT/data/tuning/tune.true.ur
> $HOME/USMT/data/tuning/tune.true.en
> /share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_charttrain/model.filtered/dev/moses.ini--nbest
> 100 --working-dir ~/USMT/HSMT/working-ur-en/tuning --decoder-flags
> "-threads 8 -v 0 " --rootdir
> /share/apps/packages/MosesSMT/mosesdecoder-master/scripts/--inputtype
> 3 -mertdir
> /share/apps/packages/MosesSMT/mosesdecoder-master/bin/-threads 10
> --no-filter-phrase-table >& mert.out&
>
>
> this is what mert.out says :
>
>
> nohup: ignoring input
>
> Using SCRIPTS_ROOTDIR:
> /share/apps/packages/MosesSMT/mosesdecoder-master/scripts/
>
> Asking moses for feature names and values from
> /export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
>
> Executing:
> /share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_chart
> -threads 8 -v 0 -config
> /export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
> -inputtype 3 -show-weights
>
> exec:
> /share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_chart
> -threads 8 -v 0 -config
> /export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
> -inputtype 3 -show-weights
>
> Executing:
> /share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_chart
> -threads 8 -v 0 -config
> /export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
> -inputtype 3 -show-weights > ./features.list 2> /dev/null
>
> MERT starting values and ranges for random generation:
>
> LM0 = 0.500 ( 0.00 .. 1.00)
>
> WordPenalty0 = -1.000 ( 0.00 .. 1.00)
>
> PhrasePenalty0 = 0.200 ( 0.00 .. 1.00)
>
> TranslationModel0 = 0.200 ( 0.00 .. 1.00)
>
> TranslationModel0 = 0.200 ( 0.00 .. 1.00)
>
> TranslationModel0 = 0.200 ( 0.00 .. 1.00)
>
> TranslationModel0 = 0.200 ( 0.00 .. 1.00)
>
> featlist: LM0=0.500000
>
> featlist: WordPenalty0=-1.000000
>
> featlist: PhrasePenalty0=0.200000
>
> featlist: TranslationModel0=0.200000
>
> featlist: TranslationModel0=0.200000
>
> featlist: TranslationModel0=0.200000
>
> featlist: TranslationModel0=0.200000
>
> run 1 start at Wed Jun 17 05:57:56 PKT 2015
>
> Parsing --decoder-flags: |-threads 8 -v 0 |
>
> Saving new config to: ./run1.moses.ini
>
> Saved: ./run1.moses.ini
>
> Normalizing lambdas: 0.500000 -1.000000 0.200000 0.200000 0.200000
> 0.200000 0.200000
>
> DECODER_CFG = -weight-overwrite 'PhrasePenalty0= 0.080000
> WordPenalty0= -0.400000 TranslationModel0= 0.080000 0.080000 0.080000
> 0.080000 LM0= 0.200000'
>
> Executing:
> /share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_chart
> -threads 8 -v 0 -config
> /export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
> -inputtype 3 -weight-overwrite 'PhrasePenalty0= 0.080000 WordPenalty0=
> -0.400000 TranslationModel0= 0.080000 0.080000 0.080000 0.080000 LM0=
> 0.200000' -n-best-list run1.best100.out 100 distinct -input-file
> /export/home3/fjwu/sadaf.rauf/USMT/data/tuning/tune.true.ur > run1.out
>
> Executing:
> /share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_chart
> -threads 8 -v 0 -config
> /export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
> -inputtype 3 -weight-overwrite 'PhrasePenalty0= 0.080000 WordPenalty0=
> -0.400000 TranslationModel0= 0.080000 0.080000 0.080000 0.080000 LM0=
> 0.200000' -n-best-list run1.best100.out 100 distinct -input-file
> /export/home3/fjwu/sadaf.rauf/USMT/data/tuning/tune.true.ur > run1.out
>
> 1-10.20.2 0.2 0.2 0.20.5(1) run decoder to produce n-best lists
>
> params = -threads 8 -v 0
>
> decoder_config = -weight-overwrite 'PhrasePenalty0= 0.080000
> WordPenalty0= -0.400000 TranslationModel0= 0.080000 0.080000 0.080000
> 0.080000 LM0= 0.200000'
>
> Line empty in nbestlist 'run1.best100.out' at
> /share/apps/packages/MosesSMT/mosesdecoder-master/scripts/training/mert-moses.pl
> <http://mert-moses.pl> line 1452.
>
>
>
>
>
> ---------- Forwarded message ----------
> From: moses-support-request@mit.edu <mailto:moses-support-request@mit.edu>
> To:
> Cc:
> Date:
> Subject: confirm 45ed6af19dfe664c09e0209730a0b5d1b3c78afc
> If you reply to this message, keeping the Subject: header intact,
> Mailman will discard the held message. Do this if the message is
> spam. If you reply to this message and include an Approved: header
> with the list password in it, the message will be approved for posting
> to the list. The Approved: header can also appear in the first line
> of the body of the reply.
>

--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150618/c4030945/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 104, Issue 44
**********************************************

Tweet