Moses-support Digest, Vol 107, Issue 7

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Several Issues with Baseline and EMS (Anita Pal)
2. Re: g++: error: unrecognized command line option
'-no-cpp-precomp' (Jorg Tiedemann)
3. Re: g++: error: unrecognized command line option
'-no-cpp-precomp' (Matt Post)


----------------------------------------------------------------------

Message: 1
Date: Tue, 1 Sep 2015 20:26:43 +0200
From: Anita Pal <fujitahibaraki@gmail.com>
Subject: [Moses-support] Several Issues with Baseline and EMS
To: moses-support@mit.edu
Message-ID:
<CABX1R6mqy3LyUpxyx81diyAFLiX_tNPLYwmX7TZJc9a__iD20g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hey!

I'm really, really new to Linux and have no idea how to set /change the
config file when it comes to running the experiments as described here (
http://www.statmt.org/moses/?n=moses.baseline)

home-dir = /home/liam/

working-dir =/home/liam/working/experiments
moses-src-dir = /home/liam/mosesdecoder
moses-script-dir = home/liam/working/experiments (this is where config is
located?)
moses-bin-dir = /home/liam/mosesdecoder/bin
external-bin-dir =/home/liam/mosesdecoder/tools
data-dir =/home/liam/corpus
train-dir =/home/liam/corpus/training
dev-dir = /home/liam/corpus/dev
irstlm-dir =/home/liam/irstlm/bin

Is this correct? I really have no idea ):

Because I just keep getting errors no matter what I do. I have the same
problem when it comes to training the language model via IRSTLM. For
example:

export IRSTLM=$HOME/irstlm; ~/irstlm/bin/build-lm.sh \
-i news-commentary-v8.fr-en.sb.en \
-t ./tmp -p -s improved-kneser-ney -o news-commentary-v8.fr-en.lm.en
~/irstlm/bin/compile-lm \
--text=yes \
news-commentary-v8.fr-en.lm.en.gz \
news-commentary-v8.fr-en.arpa.en

I assume this is a separate command. I keep getting errors though I do
set HOME=/home/liam/irstlm.

What am I doing wrong?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150901/dc5ad37b/attachment-0001.html

------------------------------

Message: 2
Date: Tue, 1 Sep 2015 22:58:08 +0300
From: Jorg Tiedemann <tiedeman@gmail.com>
Subject: Re: [Moses-support] g++: error: unrecognized command line
option '-no-cpp-precomp'
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <2A47F7B2-1A00-4C80-A722-9ABE1BEC9707@gmail.com>
Content-Type: text/plain; charset="utf-8"


This is kind of frustrating ? so, the recommended way is to use apples clang and to built boost from source, is that correct?
I thought I could pull gcc and boost out of macpots (as I used to do) and they would understand each other, but this does not seem to work. Why not?

Well, thanks anyway. I will try with a fresh boost built ...
J?rg




> On 01 Sep 2015, at 15:21, Hieu Hoang <hieuhoang@gmail.com> wrote:
>
> My advice on osx is don't install GCC. Clang is the ordained compiler now, you'll be fighting apple every step of the way. Don't think different!
>
> Hieu Hoang
> Sent while bumping into things
>
> On 31 Aug 2015 5:14 pm, "Jorg Tiedemann" <tiedeman@gmail.com <mailto:tiedeman@gmail.com>> wrote:
>
> Well, I have /opt/local/ search paths in various environment variables to get macports to work.
> I deleted all this paths and tried again but I still get the same problem.
>
> I am confused. And why is gcc not working anymore when installed via macports? I also installed boost with macports. Is that a problem as well?
>
> I have also some problems with kenlm but part of it compiles and links fine. build_binary and query seems to compile fine but lmplz does not link because of some undefined symbols:
> Undefined symbols for architecture x86_64:
> "boost::program_options::value_semantic_codecvt_helper<char>::parse(boost::any&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, bool) const", referenced from:
> ?.
>
> I also had to link /opt/local/lib to /opt/local/lib64 (which didn?t exist in my setup).
> I am afraid that I started to make quite a mess on my system but what did I do wrong?
>
> Is macports not working properly anymore?
> As I said, I have gcc 5.2.0 and boost 1.59.0 via macports on my system. Is that bad?
>
> Thanks for helping!
> J?rg
>
>
>
>
>> On 31 Aug 2015, at 16:19, Hieu Hoang <hieuhoang@gmail.com <mailto:hieuhoang@gmail.com>> wrote:
>>
>> the errors for clang looks like it's coming from the stl library. Have you fiddled with the PATH variable or otherwise tried to make gcc on OSX work? You shouldn't do that, it will just mess up the compilation environment on your machine
>>
>> On 31/08/2015 10:28, Jorg Tiedemann wrote:
>>>
>>> Unfortunately, this didn?t work for me either. I attach both logiles - one for clang and one for gcc (which I installed via macports)
>>> What can I do? Thanks!
>>>
>>> J?rg
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>> On 30 Aug 2015, at 11:33, Hieu Hoang < <mailto:hieuhoang@gmail.com>hieuhoang@gmail.com <mailto:hieuhoang@gmail.com>> wrote:
>>>>
>>>> Add
>>>> toolset=clang
>>>> to the bjam compile command. Osx no longer has gcc
>>>>
>>>> Hieu Hoang
>>>> Sent while bumping into things
>>>>
>>>> On 29 Aug 2015 11:56 pm, "Jorg Tiedemann" <tiedeman@gmail.com <mailto:tiedeman@gmail.com>> wrote:
>>>> Hi,
>>>>
>>>> I tried to make a fresh install of Moses on my new Mac and I get the following error
>>>> g++: error: unrecognized command line option '-no-cpp-precomp'
>>>>
>>>> What?s wrong? I have gcc5 and boost 1.59 on my machine via macports ...
>>>>
>>>> Thanks for your help!
>>>> J?rg
>>>>
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support <http://mailman.mit.edu/mailman/listinfo/moses-support>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support <http://mailman.mit.edu/mailman/listinfo/moses-support>
>>>
>>
>> --
>> Hieu Hoang
>> Researcher
>> New York University, Abu Dhabi
>> http://www.hoang.co.uk/hieu <http://www.hoang.co.uk/hieu>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150901/08cf129a/attachment-0001.html

------------------------------

Message: 3
Date: Tue, 1 Sep 2015 16:19:18 -0400
From: Matt Post <post@cs.jhu.edu>
Subject: Re: [Moses-support] g++: error: unrecognized command line
option '-no-cpp-precomp'
To: Jorg Tiedemann <tiedeman@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <7C67B981-FE48-4160-BA65-6F7937CD9423@cs.jhu.edu>
Content-Type: text/plain; charset="utf-8"

You do not need gcc; Apple's stock compiler (installed via Xcode) is fine. If you've installed it, I'd recommend uninstalling it, and if you can't, make sure that /opt/local/bin is last in your path, so that /usr/bin/gcc is found first.

I've also had a lot of trouble with the Macports boost installation, which uses the "--layout=tagged" argument to the boost installer, instead of the default "--layout=system". The difference is the tagged layout adds compile options to the library name (e.g., "-mt"). However, I think that Moses compilation tool figures this out.

matt


> On Sep 1, 2015, at 3:58 PM, Jorg Tiedemann <tiedeman@gmail.com> wrote:
>
>
> This is kind of frustrating ? so, the recommended way is to use apples clang and to built boost from source, is that correct?
> I thought I could pull gcc and boost out of macpots (as I used to do) and they would understand each other, but this does not seem to work. Why not?
>
> Well, thanks anyway. I will try with a fresh boost built ...
> J?rg
>
>
>
>
>> On 01 Sep 2015, at 15:21, Hieu Hoang <hieuhoang@gmail.com <mailto:hieuhoang@gmail.com>> wrote:
>>
>> My advice on osx is don't install GCC. Clang is the ordained compiler now, you'll be fighting apple every step of the way. Don't think different!
>>
>> Hieu Hoang
>> Sent while bumping into things
>>
>> On 31 Aug 2015 5:14 pm, "Jorg Tiedemann" <tiedeman@gmail.com <mailto:tiedeman@gmail.com>> wrote:
>>
>> Well, I have /opt/local/ search paths in various environment variables to get macports to work.
>> I deleted all this paths and tried again but I still get the same problem.
>>
>> I am confused. And why is gcc not working anymore when installed via macports? I also installed boost with macports. Is that a problem as well?
>>
>> I have also some problems with kenlm but part of it compiles and links fine. build_binary and query seems to compile fine but lmplz does not link because of some undefined symbols:
>> Undefined symbols for architecture x86_64:
>> "boost::program_options::value_semantic_codecvt_helper<char>::parse(boost::any&, std::vector<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const&, bool) const", referenced from:
>> ?.
>>
>> I also had to link /opt/local/lib to /opt/local/lib64 (which didn?t exist in my setup).
>> I am afraid that I started to make quite a mess on my system but what did I do wrong?
>>
>> Is macports not working properly anymore?
>> As I said, I have gcc 5.2.0 and boost 1.59.0 via macports on my system. Is that bad?
>>
>> Thanks for helping!
>> J?rg
>>
>>
>>
>>
>>> On 31 Aug 2015, at 16:19, Hieu Hoang <hieuhoang@gmail.com <mailto:hieuhoang@gmail.com>> wrote:
>>>
>>> the errors for clang looks like it's coming from the stl library. Have you fiddled with the PATH variable or otherwise tried to make gcc on OSX work? You shouldn't do that, it will just mess up the compilation environment on your machine
>>>
>>> On 31/08/2015 10:28, Jorg Tiedemann wrote:
>>>>
>>>> Unfortunately, this didn?t work for me either. I attach both logiles - one for clang and one for gcc (which I installed via macports)
>>>> What can I do? Thanks!
>>>>
>>>> J?rg
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>> On 30 Aug 2015, at 11:33, Hieu Hoang < <mailto:hieuhoang@gmail.com>hieuhoang@gmail.com <mailto:hieuhoang@gmail.com>> wrote:
>>>>>
>>>>> Add
>>>>> toolset=clang
>>>>> to the bjam compile command. Osx no longer has gcc
>>>>>
>>>>> Hieu Hoang
>>>>> Sent while bumping into things
>>>>>
>>>>> On 29 Aug 2015 11:56 pm, "Jorg Tiedemann" <tiedeman@gmail.com <mailto:tiedeman@gmail.com>> wrote:
>>>>> Hi,
>>>>>
>>>>> I tried to make a fresh install of Moses on my new Mac and I get the following error
>>>>> g++: error: unrecognized command line option '-no-cpp-precomp'
>>>>>
>>>>> What?s wrong? I have gcc5 and boost 1.59 on my machine via macports ...
>>>>>
>>>>> Thanks for your help!
>>>>> J?rg
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support <http://mailman.mit.edu/mailman/listinfo/moses-support>
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support <http://mailman.mit.edu/mailman/listinfo/moses-support>
>>>>
>>>
>>> --
>>> Hieu Hoang
>>> Researcher
>>> New York University, Abu Dhabi
>>> http://www.hoang.co.uk/hieu <http://www.hoang.co.uk/hieu>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150901/98a26619/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 107, Issue 7
*********************************************

Tweet