Moses-support Digest, Vol 125, Issue 19

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: mosesserver output empty string for hie models (Guchun Zhang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 9 Mar 2017 14:59:35 +0000
From: Guchun Zhang <gzhang@alphacrc.com>
Subject: Re: [Moses-support] mosesserver output empty string for hie
models
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CA+cfSVLmezDt_nfEqwNjqmidMv-v3g=tXiRr8hz5oTJTAtwRBg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Okie dokie. All is working now. One catch is that when compiling filter-pt,
one needs to either set LD_LIBRARY_PATH to be the same as LIBRARY_PATH or
make a static bin.

Thanks,
Guchun

On 9 March 2017 at 13:11, Guchun Zhang <gzhang@alphacrc.com> wrote:

> ?Hi Hieu,
>
> I will use the link Mike gave to try it out.
>
> Hi Mike,
>
> Thanks a lot for the link.
>
> Thanks,
> Guchun?
>
> On 9 March 2017 at 12:39, Hieu Hoang <hieuhoang@gmail.com> wrote:
>
>> SALM will compile. It's just old and the Makefile is creaky
>>
>> * Looking for MT/NLP opportunities *
>> Hieu Hoang
>> http://moses-smt.org/
>>
>>
>> On 9 March 2017 at 12:30, Guchun Zhang <gzhang@alphacrc.com> wrote:
>>
>>> Hi Hieu,
>>>
>>> It works now. I didn't manage to make binarize4moses2.perl work as
>>> sigtest-filter didn't compile and SALM page seems down.
>>>
>>> Thanks,
>>> Guchun
>>>
>>> On 8 March 2017 at 16:01, Guchun Zhang <gzhang@alphacrc.com> wrote:
>>>
>>>> Ah, cool. Will let you know how it goes in a few days time.
>>>>
>>>> Thanks a lot,
>>>> Guchun
>>>>
>>>> On 8 March 2017 at 14:49, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>>>
>>>>> cool, nearly there.
>>>>>
>>>>> moses2 only supports ProbingPT, not PhraseDictionaryOnDisk
>>>>> http://www.statmt.org/moses/?n=Site.Moses2
>>>>> use the script
>>>>> scripts/generic/binarize4moses2.perl
>>>>> to binarize. If you are using hiero models, don't forget the flag
>>>>> --scfg
>>>>>
>>>>> * Looking for MT/NLP opportunities *
>>>>> Hieu Hoang
>>>>> http://moses-smt.org/
>>>>>
>>>>>
>>>>> On 8 March 2017 at 14:43, Guchun Zhang <gzhang@alphacrc.com> wrote:
>>>>>
>>>>>> Great. The fix works. :-)
>>>>>>
>>>>>> As with many things, now there's this run time error:
>>>>>>
>>>>>> Feature name PhraseDictionaryOnDisk is not registered.Aborted (core
>>>>>> dumped)
>>>>>>
>>>>>> My hie models are binarised. Should I skip binarisation for such
>>>>>> models from now on?
>>>>>>
>>>>>> Thanks,
>>>>>> Guchun
>>>>>>
>>>>>> On 8 March 2017 at 14:02, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>>>>>
>>>>>>> git pull and try again. I've just pushed a fix
>>>>>>> https://github.com/moses-smt/mosesdecoder/commit/ac3069fb32d
>>>>>>> 87c57ac84d5bac3d07328b5ab71dd
>>>>>>>
>>>>>>> * Looking for MT/NLP opportunities *
>>>>>>> Hieu Hoang
>>>>>>> http://moses-smt.org/
>>>>>>>
>>>>>>>
>>>>>>> On 8 March 2017 at 12:48, Guchun Zhang <gzhang@alphacrc.com> wrote:
>>>>>>>
>>>>>>>> Sure. Both are attached. Thanks, Guchun
>>>>>>>>
>>>>>>>> On 8 March 2017 at 11:52, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> what's the exact bjam command you used, and can I please have a
>>>>>>>>> look at the compile error
>>>>>>>>>
>>>>>>>>> * Looking for MT/NLP opportunities *
>>>>>>>>> Hieu Hoang
>>>>>>>>> http://moses-smt.org/
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 8 March 2017 at 11:48, Guchun Zhang <gzhang@alphacrc.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Have to say ?I can't disagree with that.?
>>>>>>>>>>
>>>>>>>>>> Moses2 still doesn't compile when --max-kenlm-order is passed.
>>>>>>>>>>
>>>>>>>>>> HTH.
>>>>>>>>>>
>>>>>>>>>> Guchun
>>>>>>>>>>
>>>>>>>>>> On 8 March 2017 at 10:29, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> I guess the cost/benefit ratio isn't high enough for commercial
>>>>>>>>>>> users using the server, but you can probably answer that better. Hopefully
>>>>>>>>>>> the faster Moses2 implementation can improve that.
>>>>>>>>>>>
>>>>>>>>>>> If it doesn't compile, please let me know
>>>>>>>>>>>
>>>>>>>>>>> * Looking for MT/NLP opportunities *
>>>>>>>>>>> Hieu Hoang
>>>>>>>>>>> http://moses-smt.org/
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On 8 March 2017 at 09:31, Guchun Zhang <gzhang@alphacrc.com>
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Also, may I ask why hie models aren't commonly used in the
>>>>>>>>>>>> server mode?
>>>>>>>>>>>>
>>>>>>>>>>>> On 8 March 2017 at 09:28, Guchun Zhang <gzhang@alphacrc.com>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> ?Thanks, Hieu. I will give Moses2 another try. Last time, it
>>>>>>>>>>>>> didn't compile.?
>>>>>>>>>>>>>
>>>>>>>>>>>>> On 7 March 2017 at 18:35, Hieu Hoang <hieuhoang@gmail.com>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> if you're not able to fix it, you might wanna try the hiero
>>>>>>>>>>>>>> model on Moses2
>>>>>>>>>>>>>> http://www.statmt.org/moses/?n=Site.Moses2
>>>>>>>>>>>>>> I don't think the hiero model is used much in server mode so
>>>>>>>>>>>>>> it's suffering from code rot.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> The model is much faster in Moses2 so hopefully more people
>>>>>>>>>>>>>> will use it. The server code is also much simplier
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> * Looking for MT/NLP opportunities *
>>>>>>>>>>>>>> Hieu Hoang
>>>>>>>>>>>>>> http://moses-smt.org/
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On 7 March 2017 at 17:46, Guchun Zhang <gzhang@alphacrc.com>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I pull the repo recently and just noticed that mosesserver
>>>>>>>>>>>>>>> outputs empty strings for hie models. The command I issued is
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> *$ mosesserver --config moses.tuned.ini*
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> There's no error message at all. Tried to record the server
>>>>>>>>>>>>>>> log and this is the log:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> *127.0.0.1:43644 <http://127.0.0.1:43644> - no_user -
>>>>>>>>>>>>>>> [07/Mar/2017:17:37:48 +0000] "POST" 200 581*
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Is "no_user" causing the problem? The same ini runs fine
>>>>>>>>>>>>>>> with moses.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> It's been a while (more than a year at least) since last
>>>>>>>>>>>>>>> time I looked at the source code and it seems the code has changed a lot.
>>>>>>>>>>>>>>> Where should I start to debug it?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>> Guchun
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>>>> Moses-support mailing list
>>>>>>>>>>>>>>> Moses-support@mit.edu
>>>>>>>>>>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> *Guchun Zhang*
>>>>>>>>>>>>> Machine Translation Lead
>>>>>>>>>>>>> ? <http://www.thisisalpha.com/>
>>>>>>>>>>>>> Office: +44(0)1223 431035 <+44%201223%20431035> | Skype:
>>>>>>>>>>>>> mt.alpha | *thisisalpha.com* <http://www.thisisalpha.com/>
>>>>>>>>>>>>> St Andrews House, St Andrew Road | Cambridge CB4 1DL | United
>>>>>>>>>>>>> Kingdom
>>>>>>>>>>>>> [image: ALPHA]
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> *Guchun Zhang*
>>>>>>>>>>>> Machine Translation Lead
>>>>>>>>>>>> ? <http://www.thisisalpha.com/>
>>>>>>>>>>>> Office: +44(0)1223 431035 <01223%20431035> | Skype: mt.alpha |
>>>>>>>>>>>> *thisisalpha.com* <http://www.thisisalpha.com/>
>>>>>>>>>>>> St Andrews House, St Andrew Road | Cambridge CB4 1DL | United
>>>>>>>>>>>> Kingdom
>>>>>>>>>>>> [image: ALPHA]
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> *Guchun Zhang*
>>>>>>>>>> Machine Translation Lead
>>>>>>>>>> ? <http://www.thisisalpha.com/>
>>>>>>>>>> Office: +44(0)1223 431035 <01223%20431035> | Skype: mt.alpha |
>>>>>>>>>> *thisisalpha.com* <http://www.thisisalpha.com/>
>>>>>>>>>> St Andrews House, St Andrew Road | Cambridge CB4 1DL | United
>>>>>>>>>> Kingdom
>>>>>>>>>> [image: ALPHA]
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> *Guchun Zhang*
>>>>>>>> Machine Translation Lead
>>>>>>>> ? <http://www.thisisalpha.com/>
>>>>>>>> Office: +44(0)1223 431035 <01223%20431035> | Skype: mt.alpha |
>>>>>>>> *thisisalpha.com* <http://www.thisisalpha.com/>
>>>>>>>> St Andrews House, St Andrew Road | Cambridge CB4 1DL | United
>>>>>>>> Kingdom
>>>>>>>> [image: ALPHA]
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Guchun Zhang*
>>>>>> Machine Translation Lead
>>>>>> ? <http://www.thisisalpha.com/>
>>>>>> Office: +44(0)1223 431035 <01223%20431035> | Skype: mt.alpha |
>>>>>> *thisisalpha.com* <http://www.thisisalpha.com/>
>>>>>> St Andrews House, St Andrew Road | Cambridge CB4 1DL | United Kingdom
>>>>>> [image: ALPHA]
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> *Guchun Zhang*
>>>> Machine Translation Lead
>>>> ? <http://www.thisisalpha.com/>
>>>> Office: +44(0)1223 431035 <+44%201223%20431035> | Skype: mt.alpha |
>>>> *thisisalpha.com* <http://www.thisisalpha.com/>
>>>> St Andrews House, St Andrew Road | Cambridge CB4 1DL | United Kingdom
>>>> [image: ALPHA]
>>>>
>>>
>>>
>>>
>>> --
>>> *Guchun Zhang*
>>> Machine Translation Lead
>>> ? <http://www.thisisalpha.com/>
>>> Office: +44(0)1223 431035 <01223%20431035> | Skype: mt.alpha |
>>> *thisisalpha.com* <http://www.thisisalpha.com/>
>>> St Andrews House, St Andrew Road | Cambridge CB4 1DL | United Kingdom
>>> [image: ALPHA]
>>>
>>
>>
>
>
> --
> *Guchun Zhang*
> Machine Translation Lead
> ? <http://www.thisisalpha.com/>
> Office: +44(0)1223 431035 <+44%201223%20431035> | Skype: mt.alpha |
> *thisisalpha.com* <http://www.thisisalpha.com/>
> St Andrews House, St Andrew Road | Cambridge CB4 1DL | United Kingdom
> [image: ALPHA]
>



--
*Guchun Zhang*
Machine Translation Lead
? <http://www.thisisalpha.com/>
Office: +44(0)1223 431035 | Skype: mt.alpha | *thisisalpha.com*
<http://www.thisisalpha.com/>
St Andrews House, St Andrew Road | Cambridge CB4 1DL | United Kingdom
[image: ALPHA]
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170309/d7239fe2/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 67617 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20170309/d7239fe2/attachment.jpg

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 125, Issue 19
**********************************************

Tweet