Home » Uncategories » Moses-support Digest, Vol 113, Issue 53

Moses-support Digest, Vol 113, Issue 53

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Missing /usr/lib64/lib64/libboost_thread-mt.so.5 for
multithreaded GIZA (Sergey A.)
2. Re: Missing /usr/lib64/lib64/libboost_thread-mt.so.5 for
multithreaded GIZA (Barry Haddow)


----------------------------------------------------------------------

Message: 1
Date: Sat, 19 Mar 2016 15:56:08 +0200
From: "Sergey A." <www.sergo@gmail.com>
Subject: Re: [Moses-support] Missing
/usr/lib64/lib64/libboost_thread-mt.so.5 for multithreaded GIZA
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAJ=+Y-se0=WmHyMMrLWbeYpVDGUbwisiq3eG2rhZCxrWvFX=0Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello Hieu Hoang.

Thank you for your suggestion, everything worked!!! Now to the next
problem, I'm trying to use it in the training of the translation system,
I've copied the bins and the script from the mgiza compiled, but it doesn't
work (specifying the *--external-bin-dir* didn't work as well):

* $ ~/mosesdecoder/scripts/training/train-model.perl -root-dir train
-corpus corpus/train.tags.he-en.clean -f he -e en -alignment
grow-diag-final-and -reordering msd-bidirectional-fe -lm
0:3:/home/altshus/he-en/lm/train.blm.en:8 -external-bin-dir
~/mosesdecoder/tools -cores 12 -mgiza-cpus 12 -mgiza 2>&1 *
Use of implicit split to @_ is deprecated at
/home/altshus/mosesdecoder/scripts/training/train-model.perl line
2103.
Using SCRIPTS_ROOTDIR: /home/altshus/mosesdecoder/scripts
Using multi-thread GIZA
using gzip
Use of uninitialized value $GIZA in -x at
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in
/home/altshus/mosesdecoder/tools.
You MUST specify the parameter -external-bin-dir at
/home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.


* $ ll /home/altshus/mosesdecoder/tools *
total 1996
-rwxr-xr-x. 1 altshus altshus 1103791 Mar 5 19:14 GIZA++
-rwxr-xr-x. 1 altshus altshus 3291 Mar 19 15:41 merge_alignment.py
-rwxr-xr-x. 1 altshus altshus 277836 Mar 19 15:42 *mkcls*
-rwxr-xr-x. 1 altshus altshus 43595 Mar 19 15:42 plain2snt
-rwxr-xr-x. 1 altshus altshus 42358 Mar 19 15:42 snt2cooc
-rwxr-xr-x. 1 altshus altshus 439934 Mar 5 19:14 snt2cooc.out
-rwxr-xr-x. 1 altshus altshus 30883 Mar 19 15:42 snt2coocrmp
-rwxr-xr-x. 1 altshus altshus 35005 Mar 19 15:42 snt2plain
-rwxr-xr-x. 1 altshus altshus 50385 Mar 19 15:42 symal


Should I open a separate topic for it, or is it okay to ask in this thread?

Thanks.

Sergey Altshuller

2016-03-10 17:19 GMT+02:00 Hieu Hoang <hieuhoang@gmail.com>:

> not sure, to be honest.
>
> If you tire of fighting cmake/make problems, you can try
> ./manual-compile/compile.sh
> It has it's own problems, but it's problems that you can see and fix
> yourself
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 9 March 2016 at 18:20, Sergey A. <www.sergo@gmail.com> wrote:
>
>> Hi and thank you for your time. I also just cloned it from the path
>> you've provided, and ran these commands, from the mgizapp directory inside
>> the repo. I'm getting this:
>>
>> [ 94%] Building CXX object src/CMakeFiles/mgiza_lib.dir/vocab.cpp.o
>> Linking CXX static library ../lib/libmgiza.a
>> [ 94%] Built target mgiza_lib
>> Scanning dependencies of target d4norm
>> Scanning dependencies of target hmmnorm
>> Scanning dependencies of target mgiza
>> make[2]: *** No rule to make target
>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/d4norm'. Stop.
>> make[2]: *** Waiting for unfinished jobs....
>> make[2]: *** No rule to make target
>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/hmmnorm'. Stop.
>> make[2]: *** Waiting for unfinished jobs....
>> [ 96%] make[2]: *** No rule to make target
>> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/mgiza'. Stop.
>> make[2]: *** Waiting for unfinished jobs....
>> [ 98%] [100%] Building CXX object src/CMakeFiles/d4norm.dir/d4norm.cxx.o
>> Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
>> Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
>> make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
>> make[1]: *** Waiting for unfinished jobs....
>> make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
>> make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2
>> make: *** [all] Error 2
>>
>>
>> 2016-03-07 11:33 GMT+02:00 Hieu Hoang <hieuhoang@gmail.com>:
>>
>>> where did you get the code for mgiza from and what was the exact
>>> commands you used to compile?
>>>
>>> I just tested mgiza compilation with the code from
>>> https://github.com/moses-smt/mgiza
>>> using the commands
>>> cmake .
>>> cmake .
>>> make -j4
>>> It seems to compile ok
>>>
>>>
>>> On 06/03/2016 20:02, Sergey A. wrote:
>>>
>>> Hello.
>>>
>>> I'm trying to compile mgiza
>>> <http://www.statmt.org/moses/?n=Moses.ExternalTools#ntoc3>, but getting
>>> the below error. What am I doing wrong? Note that I don't have root access
>>> on the machine, so if libraries needed I'd like to know how to download and
>>> use them without installing on the server. BTW, I couldn't find anything in
>>> the archives
>>> <http://www.google.com/coop/cse?cx=006255449393150026232:wtqyknvwh4g>.
>>>
>>> make[2]: *** No rule to make target `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/hmmnorm'. Stop.
>>> make[2]: *** Waiting for unfinished jobs....
>>> make[2]: *** No rule to make target `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/d4norm'. Stop.
>>> make[2]: *** Waiting for unfinished jobs....
>>> make[2]: *** No rule to make target `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/mgiza'. Stop.
>>> make[2]: *** Waiting for unfinished jobs....
>>> [ 96%] [ 98%] [100%] Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
>>> Building CXX object src/CMakeFiles/d4norm.dir/d4norm.cxx.o
>>> Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
>>> make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
>>> make[1]: *** Waiting for unfinished jobs....
>>> make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
>>> make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2make: *** [all] Error 2
>>>
>>>
>>> Thanks in advance, I'll really appreciate any help here.
>>>
>>> Sergey
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160319/52d7de95/attachment-0001.html

------------------------------

Message: 2
Date: Sat, 19 Mar 2016 15:01:20 +0000
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] Missing
/usr/lib64/lib64/libboost_thread-mt.so.5 for multithreaded GIZA
To: "Sergey A." <www.sergo@gmail.com>, Hieu Hoang
<hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <56ED69C0.2070008@staffmail.ed.ac.uk>
Content-Type: text/plain; charset="windows-1252"

Hi Sergey

It's looking for mgiza, which you don't have. Either install mgiza into
your tools directory, or remove the mgiza arguments from your
train-model.perl command line.

cheers - Barry

On 19/03/16 13:56, Sergey A. wrote:
> Hello Hieu Hoang.
>
> Thank you for your suggestion, everything worked!!! Now to the next
> problem, I'm trying to use it in the training of the translation
> system, I've copied the bins and the script from the mgiza compiled,
> but//it doesn't work (specifying the *--external-bin-dir* didn't work
> as well):
>
> *$ ~/mosesdecoder/scripts/training/train-model.perl -root-dir train
> -corpus corpus/train.tags.he-en.clean -f he -e en -alignment
> grow-diag-final-and -reordering msd-bidirectional-fe -lm
> 0:3:/home/altshus/he-en/lm/train.blm.en:8 -external-bin-dir
> ~/mosesdecoder/tools -cores 12 -mgiza-cpus 12 -mgiza 2>&1 *
> Use of implicit split to @_ is deprecated at /home/altshus/mosesdecoder/scripts/training/train-model.perl line 2103.
> Using SCRIPTS_ROOTDIR: /home/altshus/mosesdecoder/scripts
> Using multi-thread GIZA
> using gzip
> Use of uninitialized value $GIZA in -x at /home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
> ERROR:Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in/home/altshus/mosesdecoder/tools.
> You MUST specify the parameter -external-bin-dir at /home/altshus/mosesdecoder/scripts/training/train-model.perl line 489.
>
> *$ ll /home/altshus/mosesdecoder/tools *
> total 1996
> -rwxr-xr-x. 1 altshus altshus 1103791 Mar 5 19:14 GIZA++
> -rwxr-xr-x. 1 altshus altshus 3291 Mar 19 15:41 merge_alignment.py
> -rwxr-xr-x. 1 altshus altshus 277836 Mar 19 15:42*mkcls*
> -rwxr-xr-x. 1 altshus altshus 43595 Mar 19 15:42 plain2snt
> -rwxr-xr-x. 1 altshus altshus 42358 Mar 19 15:42 snt2cooc
> -rwxr-xr-x. 1 altshus altshus 439934 Mar 5 19:14 snt2cooc.out
> -rwxr-xr-x. 1 altshus altshus 30883 Mar 19 15:42 snt2coocrmp
> -rwxr-xr-x. 1 altshus altshus 35005 Mar 19 15:42 snt2plain
> -rwxr-xr-x. 1 altshus altshus 50385 Mar 19 15:42 symal
>
> Should I open a separate topic for it, or is it okay to ask in this
> thread?
>
> Thanks.
>
> Sergey Altshuller
>
> 2016-03-10 17:19 GMT+02:00 Hieu Hoang <hieuhoang@gmail.com
> <mailto:hieuhoang@gmail.com>>:
>
> not sure, to be honest.
>
> If you tire of fighting cmake/make problems, you can try
> ./manual-compile/compile.sh
> It has it's own problems, but it's problems that you can see and
> fix yourself
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 9 March 2016 at 18:20, Sergey A. <www.sergo@gmail.com
> <mailto:www.sergo@gmail.com>> wrote:
>
> Hi and thank you for your time. I also just cloned it from the
> path you've provided, and ran these commands, from the mgizapp
> directory inside the repo. I'm getting this:
>
> [ 94%] Building CXX object
> src/CMakeFiles/mgiza_lib.dir/vocab.cpp.o
> Linking CXX static library ../lib/libmgiza.a
> [ 94%] Built target mgiza_lib
> Scanning dependencies of target d4norm
> Scanning dependencies of target hmmnorm
> Scanning dependencies of target mgiza
> make[2]: *** No rule to make target
> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by
> `bin/d4norm'. Stop.
> make[2]: *** Waiting for unfinished jobs....
> make[2]: *** No rule to make target
> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by
> `bin/hmmnorm'. Stop.
> make[2]: *** Waiting for unfinished jobs....
> [ 96%] make[2]: *** No rule to make target
> `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by
> `bin/mgiza'. Stop.
> make[2]: *** Waiting for unfinished jobs....
> [ 98%] [100%] Building CXX object
> src/CMakeFiles/d4norm.dir/d4norm.cxx.o
> Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
> Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
> make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
> make[1]: *** Waiting for unfinished jobs....
> make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
> make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2
> make: *** [all] Error 2
>
>
> 2016-03-07 11:33 GMT+02:00 Hieu Hoang <hieuhoang@gmail.com
> <mailto:hieuhoang@gmail.com>>:
>
> where did you get the code for mgiza from and what was the
> exact commands you used to compile?
>
> I just tested mgiza compilation with the code from
> https://github.com/moses-smt/mgiza
> using the commands
> cmake .
> cmake .
> make -j4
> It seems to compile ok
>
>
> On 06/03/2016 20:02, Sergey A. wrote:
>> Hello.
>>
>> I'm trying to compile mgiza
>> <http://www.statmt.org/moses/?n=Moses.ExternalTools#ntoc3>,
>> but getting the below error. What am I doing wrong? Note
>> that I don't have root access on the machine, so if
>> libraries needed I'd like to know how to download and use
>> them without installing on the server. BTW, I couldn't
>> find anything in the archives
>> <http://www.google.com/coop/cse?cx=006255449393150026232:wtqyknvwh4g>.
>>
>> make[2]: *** No rule to make target `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/hmmnorm'. Stop.
>> make[2]: *** Waiting for unfinished jobs....
>> make[2]: *** No rule to make target `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/d4norm'. Stop.
>> make[2]: *** Waiting for unfinished jobs....
>> make[2]: *** No rule to make target `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/mgiza'. Stop.
>> make[2]: *** Waiting for unfinished jobs....
>> [ 96%] [ 98%] [100%] Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
>> Building CXX object src/CMakeFiles/d4norm.dir/d4norm.cxx.o
>> Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
>> make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
>> make[1]: *** Waiting for unfinished jobs....
>> make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
>> make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2
>> make: *** [all] Error 2
>>
>> Thanks in advance, I'll really appreciate any help here.
>>
>> Sergey
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160319/a81d5e42/attachment.html
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: not available
Url: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160319/a81d5e42/attachment.pl

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 53
**********************************************

Related Posts :

0 Response to "Moses-support Digest, Vol 113, Issue 53"

Post a Comment

Subscribe to: Post Comments (Atom)