Moses-support Digest, Vol 115, Issue 16

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Fwd: Moses-support post from farnazgh73@gmail.com requires
approval (Hieu Hoang)
2. Re: Kendall's tau metric (Arefeh Kazemi)


----------------------------------------------------------------------

Message: 1
Date: Sat, 14 May 2016 20:57:44 -0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: [Moses-support] Fwd: Moses-support post from
farnazgh73@gmail.com requires approval
To: farnazgh73@gmail.com, moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbjfCMriUgSSHFJOZMGhu=5Eepc+CB0ORQkb9ZHWwGXu7w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Please subscribe to the moses mailing list before posting to it. You can
subscribe here
http://mailman.mit.edu/mailman/listinfo/moses-support

I'm not sure what the solution to your problem is, but this looks wrong
`pwd`/~/working/train/model/moses.ini

Hieu Hoang
http://www.hoang.co.uk/hieu

---------- Forwarded message ----------
From: <moses-support-owner@mit.edu>
Date: 14 May 2016 at 16:27
Subject: Moses-support post from farnazgh73@gmail.com requires approval
To: moses-support-owner@mit.edu


As list administrator, your authorization is requested for the
following mailing list posting:

List: Moses-support@mit.edu
From: farnazgh73@gmail.com
Subject: problem with tuning
Reason: Post by non-member to a members-only list

At your convenience, visit:

http://mailman.mit.edu/mailman/admindb/moses-support

to approve or deny the request.


---------- Forwarded message ----------
From: farnaz ghasemi <farnazgh73@gmail.com>
To: moses-support@mit.edu
Cc:
Date: Sun, 15 May 2016 00:57:31 +0430
Subject: problem with tuning
hi
After training, I use bellow command for tuning :

~/mosesdecoder/scripts/training/mert-moses.pl
~/Desktop/moses/moses/syntax based/Tune/News_Tune.txt
~/Desktop/moses/moses/syntax based/Tune/Ref/Ref
~/mosesdecoder/bin/moses_chart
`pwd`/~/working/train/model/moses.ini
--mertdir ~/mosesdecoder/bin
--working-dir `pwd`/~/Desktop/working/tuning/mert
--threads 4
--no-filter-phrase-table
--decoder-flags "-threads 4 -max-chart-span 1000"
--inputtype 3
--predictable-seeds
>& ~/Desktop/working/tuning/mert.log


but the only thing that I received was this :

Options:
--working-dir=mert-dir ... where all the files are created
--nbest=100 ... how big nbestlist to generate
--lattice-samples ... how many lattice samples (Chatterjee &
Cancedda, emnlp 2010)
--jobs=N ... set this to anything to run moses in parallel
--mosesparallelcmd=STR ... use a different script instead of
moses-parallel
--queue-flags=STRING ... anything you with to pass to qsub, eg.
'-l ws06osssmt=true'. The default is: '-hard'
To reset the parameters, please use
--queue-flags=' '
(i.e. a space between the quotes).
--decoder-flags=STRING ... extra parameters for the decoder
--continue ... continue from the last successful iteration
--skip-decoder ... skip the decoder run for the first time,
assuming that we got interrupted during
optimization
--shortest --average --closest
... Use shortest/average/closest reference length
as effective reference length (mutually
exclusive)
--nocase ... Do not preserve case information; i.e.
case-insensitive evaluation (default is false).
--nonorm ... Do not use text normalization (flag is not
active,
i.e. text is NOT normalized)
--filtercmd=STRING ... path to filter-model-given-input.pl
--filterfile=STRING ... path to alternative to input-text for filtering
model. useful for lattice decoding
--rootdir=STRING ... where do helpers reside (if not given
explicitly)
--mertdir=STRING ... path to new mert implementation
--mertargs=STRING ... extra args for both extractor and mert
--extractorargs=STRING ... extra args for extractor only
--mertmertargs=STRING ... extra args for mert only
--scorenbestcmd=STRING ... path to score-nbest.py
--old-sge ... passed to parallelizers, assume Grid Engine <
6.0
--inputtype=[0|1|2] ... Handle different input types: (0 for text,
1 for confusion network, 2 for lattices,
default is 0)
--no-filter-phrase-table ... disallow filtering of phrase tables
(useful if binary phrase tables are available)
--random-restarts=INT ... number of random restarts (default: 20)
--predictable-seeds ... provide predictable seeds to mert so that
random
restarts are the same on every run
--range=tm:0..1,-1..1 ... specify min and max value for some features
--range can be repeated as needed.
The order of the various --range specifications
is important only within a feature name.
E.g.:
--range=tm:0..1,-1..1 --range=tm:0..2
is identical to:
--range=tm:0..1,-1..1,0..2
but not to:
--range=tm:0..2 --range=tm:0..1,-1..1
--activate-features=STRING ... comma-separated list of features to
optimize,
others are fixed to the starting values
default: optimize all features
example: tm_0,tm_4,d_0
--prev-aggregate-nbestlist=INT ... number of previous step to consider
when
loading data (default = -1)
-1 means all previous, i.e. from
iteration 1
0 means no previous data, i.e. only the
current iteration
N means this and N previous iterations

--maximum-iterations=ITERS ... Maximum number of iterations. Default: 25
--return-best-dev ... Return the weights according to dev bleu,
instead of returning
the last iteration
--random-directions ... search only in random directions
--number-of-random-directions=int ... number of random directions
(also works with regular optimizer,
default: 0)
--pairwise-ranked ... Use PRO for optimisation (Hopkins and May,
emnlp 2011)
--pro-starting-point ... Use PRO to get a starting point for MERT
--batch-mira ... Use Batch MIRA for optimisation (Cherry and
Foster, NAACL 2012)
--hg-mira ... Use hypergraph MIRA, ie batch mira with
hypergraphs instead of kbests.
--batch-mira-args=STRING ... args to pass through to batch/hg MIRA. This
flag is useful to
change MIRA's hyperparameters such as
regularization parameter C,
BLEU decay factor, and the number of
iterations of MIRA.
--promix-training=STRING ... PRO-based mixture model training (Haddow,
NAACL 2013)
--promix-tables=STRING ... Phrase tables for PRO-based mixture model
training.
--threads=NUMBER ... Use multi-threaded mert (must be compiled
in).
--historic-interpolation ... Interpolate optimized weights with prior
iterations' weight
(parameter sets factor [0;1] given to
current weights)
--spe-symal=SYMAL ... Use simulated post-editing when decoding.
(SYMAL aligns input to refs)


is there any idea?..
thanks


---------- Forwarded message ----------
From: moses-support-request@mit.edu
To:
Cc:
Date:
Subject: confirm d234dedb76fd164c3538f94377b479ae749a1512
If you reply to this message, keeping the Subject: header intact,
Mailman will discard the held message. Do this if the message is
spam. If you reply to this message and include an Approved: header
with the list password in it, the message will be approved for posting
to the list. The Approved: header can also appear in the first line
of the body of the reply.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160514/d1003d19/attachment-0001.html

------------------------------

Message: 2
Date: Sun, 15 May 2016 06:22:25 +0000 (UTC)
From: Arefeh Kazemi <arefeh_kazemi@yahoo.com>
Subject: Re: [Moses-support] Kendall's tau metric
To: Moses-support <moses-support@mit.edu>
Message-ID:
<1533005254.2565742.1463293345815.JavaMail.yahoo@mail.yahoo.com>
Content-Type: text/plain; charset="utf-8"

Hi
I've used Lrsocre for tuning moses, with this command:mert-moses.pl --mertargs="--sctype KENDALL,BLEU --scconfig weights:0.2+0.8 refalign: ... "It works well and gives a bleu score on tuning set.
Now I'm going to use Lrscore to evaluate the test set with Lrscore but I don't know how.
ThanksArefeh
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160515/c4e6c368/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 115, Issue 16
**********************************************

Tweet