Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. What is meaning of Output of Language Model (Asad A.Malik)
2. Python InterfaceSupport (Judah Schvimer)
3. Re: Python InterfaceSupport (Barry Haddow)
4. Re: Python InterfaceSupport (Judah Schvimer)
----------------------------------------------------------------------
Message: 1
Date: Sun, 29 Jun 2014 11:48:24 -0700
From: "Asad A.Malik" <asad_12204@yahoo.com>
Subject: [Moses-support] What is meaning of Output of Language Model
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<1404067704.28666.YahooMailNeo@web140204.mail.bf1.yahoo.com>
Content-Type: text/plain; charset="us-ascii"
Hi All,
I've generated languge model for my corpus and in the output file there is value before and after each word i.e.
-2.625965 Title -2.148461
So what does these number means?
Kind Regards,
Mr. Asad
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140629/0b509090/attachment-0001.htm
------------------------------
Message: 2
Date: Mon, 30 Jun 2014 11:04:34 -0400
From: Judah Schvimer <judah.schvimer@mongodb.com>
Subject: [Moses-support] Python InterfaceSupport
To: moses-support@mit.edu
Message-ID:
<CALF9aB4Bv5i0mMMOEZkVgi59smPn9GQOtPP+opniEqQO5mYFeg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi,
I'm attempting to use the python interface to aid with a translation
pipeline for longer pieces of text. Currently the pipeline is all written
in python so this interface seemed perfect. I've run into a few problems
however. The first problem is with compiling moses. Using "./bjam
--libdir=/home/judah/mosesdecoder/lib link=shared -j12 -a" the compilation
is successful, but using "./bjam --with-boost=/home/judah/boost_1_55_0
--with-irstlm=/home/judah/irstlm-5.80.03
-libdir=/home/judah/mosesdecoder/lib link=shared -j12 -a" the compilation
fails. Compiling with only irstlm and no link=shared succeeds. Do you have
any idea what's wrong? I can include a log if that would help. I have
followed all of the documentation as well as I could. The error is:
"/usr/bin/ld: /home/judah/irstlm-5.80.03/lib/libirstlm.a(dictionary.o):
relocation R_X86_64_32 against `.rodata' can not be used when making a
shared object; recompile with -fPIC
/home/judah/irstlm-5.80.03/lib/libirstlm.a: error adding symbols: Bad value"
I've tried recompiling both moses and irstlm with the -fPIC flag but
nothing has worked so far.
The second issue is with the interface itself. I may be misunderstanding
the point of this interface but it seems to not translate anything longer
than a 2 word phrase, is this something I'm doing wrong or is that all that
it can do?
Thanks,
Judah
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140630/8f22e24f/attachment-0001.htm
------------------------------
Message: 3
Date: Mon, 30 Jun 2014 16:28:01 +0100
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] Python InterfaceSupport
To: Judah Schvimer <judah.schvimer@mongodb.com>, moses-support@mit.edu
Message-ID: <53B18201.60404@staffmail.ed.ac.uk>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Hi Judah
Have you tried compiling with "link=shared" and without irstlm?
The python interface to Moses is, afaik, incomplete and has not been
heavily used. I have successfully used it to query a binarised phrase
table but haven't tried its decoding interface.
cheers - Barry
On 30/06/14 16:04, Judah Schvimer wrote:
> Hi,
>
> I'm attempting to use the python interface to aid with a translation
> pipeline for longer pieces of text. Currently the pipeline is all
> written in python so this interface seemed perfect. I've run into a
> few problems however. The first problem is with compiling moses. Using
> "./bjam --libdir=/home/judah/mosesdecoder/lib link=shared -j12 -a" the
> compilation is successful, but using "./bjam
> --with-boost=/home/judah/boost_1_55_0
> --with-irstlm=/home/judah/irstlm-5.80.03
> -libdir=/home/judah/mosesdecoder/lib link=shared -j12 -a" the
> compilation fails. Compiling with only irstlm and no link=shared
> succeeds. Do you have any idea what's wrong? I can include a log if
> that would help. I have followed all of the documentation as well as I
> could. The error is:
>
>
> "/usr/bin/ld:
> /home/judah/irstlm-5.80.03/lib/libirstlm.a(dictionary.o): relocation
> R_X86_64_32 against `.rodata' can not be used when making a shared
> object; recompile with -fPIC
>
> /home/judah/irstlm-5.80.03/lib/libirstlm.a: error adding symbols: Bad
> value"
>
> I've tried recompiling both moses and irstlm with the -fPIC flag but
> nothing has worked so far.
>
> The second issue is with the interface itself. I may be
> misunderstanding the point of this interface but it seems to not
> translate anything longer than a 2 word phrase, is this something I'm
> doing wrong or is that all that it can do?
>
> Thanks,
>
> Judah
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
------------------------------
Message: 4
Date: Mon, 30 Jun 2014 11:37:26 -0400
From: Judah Schvimer <judah.schvimer@mongodb.com>
Subject: Re: [Moses-support] Python InterfaceSupport
To: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Cc: moses-support@mit.edu
Message-ID:
<CALF9aB47=HAs2dPAj6kzavRPEOpJmaNnH0NnHQJVoCRE=r+XCw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi,
Thanks for the quick response! I have tried just link=shared and it does
work. It's the combination of the two that doesn't work. It seems like
IRSTLM is what needs to be compiled with -fPIC but I can't get that to work.
And what do you mean by query the binarised phrase table? How is that
different from decoding? I may be misunderstanding what the python
interface was created for.
Thanks,
Judah
On Mon, Jun 30, 2014 at 11:28 AM, Barry Haddow <bhaddow@staffmail.ed.ac.uk>
wrote:
> Hi Judah
>
> Have you tried compiling with "link=shared" and without irstlm?
>
> The python interface to Moses is, afaik, incomplete and has not been
> heavily used. I have successfully used it to query a binarised phrase table
> but haven't tried its decoding interface.
>
> cheers - Barry
>
>
> On 30/06/14 16:04, Judah Schvimer wrote:
>
>> Hi,
>>
>> I'm attempting to use the python interface to aid with a translation
>> pipeline for longer pieces of text. Currently the pipeline is all written
>> in python so this interface seemed perfect. I've run into a few problems
>> however. The first problem is with compiling moses. Using "./bjam
>> --libdir=/home/judah/mosesdecoder/lib link=shared -j12 -a" the
>> compilation is successful, but using "./bjam --with-boost=/home/judah/boost_1_55_0
>> --with-irstlm=/home/judah/irstlm-5.80.03 -libdir=/home/judah/mosesdecoder/lib
>> link=shared -j12 -a" the compilation fails. Compiling with only irstlm and
>> no link=shared succeeds. Do you have any idea what's wrong? I can include a
>> log if that would help. I have followed all of the documentation as well as
>> I could. The error is:
>>
>>
>> "/usr/bin/ld: /home/judah/irstlm-5.80.03/lib/libirstlm.a(dictionary.o):
>> relocation R_X86_64_32 against `.rodata' can not be used when making a
>> shared object; recompile with -fPIC
>>
>> /home/judah/irstlm-5.80.03/lib/libirstlm.a: error adding symbols: Bad
>> value"
>>
>> I've tried recompiling both moses and irstlm with the -fPIC flag but
>> nothing has worked so far.
>>
>> The second issue is with the interface itself. I may be misunderstanding
>> the point of this interface but it seems to not translate anything longer
>> than a 2 word phrase, is this something I'm doing wrong or is that all that
>> it can do?
>>
>> Thanks,
>>
>> Judah
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140630/b77708a7/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 92, Issue 53
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 92, Issue 53"
Post a Comment