Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Tuning hyperparamters with MERT (Prashant)
2. Need help in resolving Compilation error for moses
(Ratish Puduppully)
3. Problem when running moses-server, Issues with abyss++
(Roee Aharoni)
4. Re: Problem when running moses-server, Issues with abyss++
(Jie Jiang)
----------------------------------------------------------------------
Message: 1
Date: Fri, 17 Jan 2014 23:34:00 +0100
From: Prashant <prashant@fbk.eu>
Subject: Re: [Moses-support] Tuning hyperparamters with MERT
To: Kevin Gimpel <kgimpel@cs.cmu.edu>
Cc: Hieu Hoang <hieu.hoang@ed.ac.uk>, Barry Haddow
<bhaddow@staffmail.ed.ac.uk>, Moses <moses-support@mit.edu>
Message-ID:
<1389998040.2358.6.camel@Host-001.homenet.telecomitalia.it>
Content-Type: text/plain; charset="UTF-8"
Thanks for the papers Barry and Kevin..
and thanks for the code Hieu.
Got the ideas for solving the problem.
Ciao,
Prashant
On Fri, 2014-01-17 at 15:36 -0600, Kevin Gimpel wrote:
> Also see http://aclweb.org/anthology//W/W12/W12-3159.pdf
> (And thanks for those pointers, Barry.)
> Kevin
>
>
>
>
> On Fri, Jan 17, 2014 at 3:31 PM, Barry Haddow
> <bhaddow@staffmail.ed.ac.uk> wrote:
> Hi Prashant
>
> PRO also assumes that the model score depends linearly on the
> weights, as do the mira variants. There have been some
> attempts at "tuning" of hyperparameters, but it's a tricky
> problem. For example, see:
>
> http://books.nips.cc/papers/files/nips25/NIPS2012_0650.pdf
> (for parsing)
> http://www.aclweb.org/anthology/W13-2229.pdf
>
> cheers - Barry
>
>
>
> On 17/01/14 18:08, Hieu Hoang wrote:
>
> > interesting. I don't think you can use MERT because it
> > assumes that there is a linear relationship between weights
> > and model scores.
> >
> >
> > However, I think you can use PRO.
> >
> >
> > I added a feature function
> > HyperParameterAsWeight
> >
> > that uses it's weights to change some hyper-parameters such
> > as stack size and beam width.
> >
> >
> > It's a hack, but I hope it's a start of what you want to do.
> > Change it however you want. I haven't tested it so it's up
> > to you to test it
> >
> >
> > Fyi, the commit is here
> >
> > https://github.com/moses-smt/mosesdecoder/commit/20e7d078a6ed23e6a293801955ba09e622f993df
> >
> >
> >
> >
> >
> >
> > On 17 January 2014 16:10, Prashant Mathur <prashant@fbk.eu>
> > wrote:
> > Hi All,
> >
> > I am tuning the standard models with an extended
> > feature.
> > As far as I understood, we can tune only the feature
> > weights in mert.
> > In my case I have some more hyper parameters that I
> > want to tune
> > together with the feature weights .. for example.
> > feature learning rate.
> > Once the nbest-list is created these parameters
> > cannot have any effect
> > on the list, but they are useful for generating a
> > better nbest-list.
> > Is there a way to tune all the parameters and hyper
> > parameters together?
> >
> > Thanks,
> > Prashant
> >
> > PS: Till now I was tuning these hyper parameters
> > using Simplex.
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> >
> >
> > --
> > Hieu Hoang
> > Research Associate
> > University of Edinburgh
> > http://www.hoang.co.uk/hieu
> >
> >
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> >
> >
> > The University of Edinburgh is a charitable body, registered in
> > Scotland, with registration number SC005336.
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
------------------------------
Message: 2
Date: Sat, 18 Jan 2014 11:56:29 +0530
From: Ratish Puduppully <ratish123@gmail.com>
Subject: [Moses-support] Need help in resolving Compilation error for
moses
To: moses-support@mit.edu
Message-ID:
<CAEb1jG4Skj2e3Mg2=8dEEA+duFbddeqGHjKyFyMf9kb0V2-7wQ@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"
Command run:
./bjam --with-boost=/home/ratish/boost_1_55_0
OS: Fedora 18
Attached build log file.
Please help me fix the issue.
Thanks,
Ratish
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140118/18b3beed/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: buildlog.zip
Type: application/zip
Size: 3788 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140118/18b3beed/attachment-0001.zip
------------------------------
Message: 3
Date: Sat, 18 Jan 2014 12:17:22 +0200
From: Roee Aharoni <roee.aharoni@gmail.com>
Subject: [Moses-support] Problem when running moses-server, Issues
with abyss++
To: "moses-support@mit.edu" <Moses-support@mit.edu>
Message-ID:
<CAAFz8fUSckvEFCLcXwV+n=q71+fc=BfvgawGK-s6Mgp2+QzqrA@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"
Hi all,
I'm having trouble when running mosesserver: after setting the
LD_LIBRARY_PATH environment to include the path where the relevant xmlrpc-c
libraries are, the compilation and linking phase is passing fine.
However, while trying to run the moses-server executable, it fails with
runtime error after loading the model, which is "symbol not found for the
function call : *xmlrpc_server_abyss_set_handler3()
<http://xmlrpc-c.sourceforge.net/doc/libxmlrpc_server_abyss.html#set_handler3>"*
We checked the relevant abyss++ library and this symbol really appears in
the library as undefined.
We suspect this happens due to one of the following reasons:
[1] some library which does contain the symbol is missing and its path
should be added to the LD_LIBRARY_PATH
[2] there is some problems with the procedure of building and installing
the xmlrpc-c package.
[3] there are issues with the xmlrpc-c-config which does not configures the
parameters correctly.
If anyone has met these conditions and solved it or has an explanation of
the xmlrpc libraries which should be used and how, we would appreciate any
help.
Thanks,
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140118/7d3de5e6/attachment-0001.htm
------------------------------
Message: 4
Date: Sat, 18 Jan 2014 19:56:09 +0800
From: Jie Jiang <jie.jiang@capita-ti.com>
Subject: Re: [Moses-support] Problem when running moses-server, Issues
with abyss++
To: Roee Aharoni <roee.aharoni@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAGWrrwPcpDQTPjhM0dA=Pn1kr-O=u4v6pXRdeL9+S=D0ZtP+JQ@mail.gmail.com>
Content-Type: text/plain; charset="gb2312"
Hi Roee:
Last time when I did it, the link flag I used was:
-L/usr/local/lib -Wl,-Bstatic -lxmlrpc_server_abyss++ -lxmlrpc_server++
-lxmlrpc_server_abyss -lxmlrpc_server -lxmlrpc_abyss -lxmlrpc_xmlparse
-lxmlrpc_xmltok -lxmlrpc++ -Wl,-Bdynamic -lpthread -lxmlrpc -lxmlrpc_util
-Wl,--as-needed
Hopefully it can solve your problem.
2014-1-18 ????10:18?? "Roee Aharoni" <roee.aharoni@gmail.com>??????
> Hi all,
>
> I'm having trouble when running mosesserver: after setting the
> LD_LIBRARY_PATH environment to include the path where the relevant xmlrpc-c
> libraries are, the compilation and linking phase is passing fine.
> However, while trying to run the moses-server executable, it fails with
> runtime error after loading the model, which is "symbol not found for the
> function call : *xmlrpc_server_abyss_set_handler3()
> <http://xmlrpc-c.sourceforge.net/doc/libxmlrpc_server_abyss.html#set_handler3>"*
> We checked the relevant abyss++ library and this symbol really appears in
> the library as undefined.
> We suspect this happens due to one of the following reasons:
>
> [1] some library which does contain the symbol is missing and its path
> should be added to the LD_LIBRARY_PATH
> [2] there is some problems with the procedure of building and installing
> the xmlrpc-c package.
> [3] there are issues with the xmlrpc-c-config which does not configures
> the parameters correctly.
>
> If anyone has met these conditions and solved it or has an explanation of
> the xmlrpc libraries which should be used and how, we would appreciate any
> help.
>
> Thanks,
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140118/9fbf84c2/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 87, Issue 44
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 87, Issue 44"
Post a Comment