Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Load LD_LIBRARY_PATH in ems with -cluster (sge)
(Kenneth Heafield)
2. Meaning to language arguments for train-model.perl?
(Kenneth Heafield)
3. Re: Meaning to language arguments for train-model.perl? (Tom Hoar)
4. Re: Meaning to language arguments for train-model.perl?
(Alexandra Birch)
5. Re: Meaning to language arguments for train-model.perl?
(Marcin Junczys-Dowmunt)
----------------------------------------------------------------------
Message: 1
Date: Thu, 13 Nov 2014 09:53:15 -0500
From: Kenneth Heafield <moses@kheafield.com>
Subject: Re: [Moses-support] Load LD_LIBRARY_PATH in ems with -cluster
(sge)
To: moses-support@mit.edu
Message-ID: <5464C5DB.6050001@kheafield.com>
Content-Type: text/plain; charset=ISO-8859-1
Alternatively, if you must link dynamically, configure your shell to
always run
setenv LD_LIBRARY_PATH /export/sw/std/boost/v1.56.0/x86_64/lib
by adding it to whatever file csh sources when it runs on the cluster.
It would help if you posted --debug-configuration from bjam (gzip the
stdout).
Also unclear why you wanted both SRILM and IRSTLM. . .
Kenneth
On 11/13/14 09:44, Hieu Hoang wrote:
> you don't need to set LD_LIBRARY_PATH if the boost lib statically
> linked. This is how I always use it, I never set this variable.
>
> You need to make sure there's no .so file in the folder
> /export/sw/std/boost/v1.56.0/x86_64/lib
> /export/sw/std/boost/v1.56.0/x86_64/lib64
>
>
> On 13 November 2014 14:39, Raymond W. M. Ng <wm.ng@sheffield.ac.uk
> <mailto:wm.ng@sheffield.ac.uk>> wrote:
>
> Thanks Hieu,
>
> I did link boost (and sirlm, irstlm) when i built moses.
>
> ./bjam --with-boost=/export/sw/std/boost/v1.56.0/x86_64
> --with-srilm=/export/sw/spl/srilm/v1.6.0/srilm
> --with-irstlm=/export/sw/spl/irstlm/v5.80.03/x86_64 -j8
>
> But I think at run time I still need to load the path.
> setenv LD_LIBRARY_PATH /export/sw/std/boost/v1.56.0/x86_64/lib
>
> It won't cause an issue if everything is run locally, because I
> could source the environment just once. Maybe this problem is,
> again, specific to computing environment
>
> cheers
> raymond
>
>
> On 13 November 2014 13:36, Hieu Hoang <Hieu.Hoang@ed.ac.uk
> <mailto:Hieu.Hoang@ed.ac.uk>> wrote:
>
> personally, I would try to ensure that moses was statically
> linked to the boost libraries so it won't go looking for the
> libboost*.so at runtime.
>
> I do this by building my own boost library and linking to it,
> rather than the system boost. The instructions are here
> http://www.statmt.org/moses/?n=Development.GetStarted
>
> On 13 November 2014 13:23, Raymond W. M. Ng
> <wm.ng@sheffield.ac.uk <mailto:wm.ng@sheffield.ac.uk>> wrote:
>
> Dear moses,
>
> I have the following error in training my translation model
> with ems on SGE.
>
> /home/users/moses/v-2014-08-15/mosesdecoder/bin/build_binary: error
> while loading shared libraries:
> libboost_thread-mt.so.1.56.0: cannot open shared object
> file: No such file or directory
>
> In the offline mode, I can run this without problem by first
> sourcing an environment file which contains something like
> setenv LD_LIBRARY_PATH /export/sw/boost/v1.56.0/x86_64/lib
>
> So, I think the LD_LIBRARY_PATH environment was not loaded
> in the sge parallel scripts,
>
> grep 'ENV'
> /home/moses/mosesdecoder/scripts/generic/qsub-wrapper.pl
> <http://qsub-wrapper.pl>
>
> returns nothing.
>
> Is there something to modify in the code or did I miss any
> setting so the environment variable is not loaded?
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
------------------------------
Message: 2
Date: Thu, 13 Nov 2014 10:04:57 -0500
From: Kenneth Heafield <moses@kheafield.com>
Subject: [Moses-support] Meaning to language arguments for
train-model.perl?
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <5464C899.9060703@kheafield.com>
Content-Type: text/plain; charset=ISO-8859-1
Dear Moses,
Do the -e and -f arguments to train-model.perl and clean-corpus-n.perl
actually get interpreted by anything? Or are they just there as file
name extensions that could just as easily be "src" and "tgt"? I think
it doesn't matter.
Kenneth
------------------------------
Message: 3
Date: Thu, 13 Nov 2014 16:17:25 +0100
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] Meaning to language arguments for
train-model.perl?
To: moses-support@mit.edu
Message-ID: <5464CB85.5080705@precisiontranslationtools.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
Are you kidding? I thought "decoding" the meaning of "f" and "e" was a
right of passage for "real" computational linguists! Besides, you go and
change that and I have to type four more characters every time I run the
script. Are there any better reasons for leaving things the way they are?
--- Ok. I'll pull my bleeding tongue from my clinched teeth now :) but
you will create more work for many people with automation wrappers
around those scripts.
Tom
On 11/13/2014 04:04 PM, Kenneth Heafield wrote:
> Dear Moses,
>
> Do the -e and -f arguments to train-model.perl and clean-corpus-n.perl
> actually get interpreted by anything? Or are they just there as file
> name extensions that could just as easily be "src" and "tgt"? I think
> it doesn't matter.
>
> Kenneth
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
------------------------------
Message: 4
Date: Thu, 13 Nov 2014 15:21:56 +0000
From: Alexandra Birch <lexi.birch@gmail.com>
Subject: Re: [Moses-support] Meaning to language arguments for
train-model.perl?
To: Kenneth Heafield <moses@kheafield.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CA+h82t6D1FXKuCpPkqHzpEWx24Zs_fWCV7aNjPOhZ3YbRKMV9w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi Kenneth,
In train-model.perl, the -e and -f arguments are used to determine
filenames and extensions so they could easily be changed to src and tgt
within the script. But Tom has a handle on how this could be painful to
change in the wrapper code. clean-corpus-n.perl doesn't have a -e and -f
argument, but the src and tgt languages are passed as arguments with
position.
Lexi
On Thu, Nov 13, 2014 at 3:04 PM, Kenneth Heafield <moses@kheafield.com>
wrote:
> Dear Moses,
>
> Do the -e and -f arguments to train-model.perl and
> clean-corpus-n.perl
> actually get interpreted by anything? Or are they just there as file
> name extensions that could just as easily be "src" and "tgt"? I think
> it doesn't matter.
>
> Kenneth
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
--
------------------------------------------------------------------------------------------
School of Informatics
University of Edinburgh
Phone +44 (0)131 650-8286
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141113/3cfe9234/attachment-0001.htm
------------------------------
Message: 5
Date: Thu, 13 Nov 2014 16:24:25 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Meaning to language arguments for
train-model.perl?
To: moses-support@mit.edu
Message-ID: <dffb04ef86e83f5ed5146a568af4fc74@amu.edu.pl>
Content-Type: text/plain; charset="utf-8"
Perl being the worlds best programming language allows for options like
"f|src" :)
I have to admit I always have to pause for half a second, mumbling " f
stands for 'from' " ...
W dniu 2014-11-13 16:21, Alexandra Birch napisa?(a):
> Hi Kenneth,
>
> In train-model.perl, the -e and -f arguments are used to determine filenames and extensions so they could easily be changed to src and tgt within the script. But Tom has a handle on how this could be painful to change in the wrapper code. clean-corpus-n.perl doesn't have a -e and -f argument, but the src and tgt languages are passed as arguments with position.
>
> Lexi
>
> On Thu, Nov 13, 2014 at 3:04 PM, Kenneth Heafield <moses@kheafield.com> wrote:
>
>> Dear Moses,
>>
>> Do the -e and -f arguments to train-model.perl and clean-corpus-n.perl
>> actually get interpreted by anything? Or are they just there as file
>> name extensions that could just as easily be "src" and "tgt"? I think
>> it doesn't matter.
>>
>> Kenneth
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support [1]
>
> --
>
> ------------------------------------------------------------------------------------------
> School of Informatics
> University of Edinburgh
> Phone +44 (0)131 650-8286
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support [1]
Links:
------
[1] http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141113/609c9a9d/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 97, Issue 19
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 97, Issue 19"
Post a Comment