Moses-support Digest, Vol 105, Issue 30

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Getting started - Baseline basic question (Vincent Nguyen)
2. Re: Moses build failed (Rico Sennrich)
3. Re: Getting started - Baseline basic question (Hieu Hoang)
4. Re: Getting started - Baseline basic question (Vincent Nguyen)
5. Sparse phrase table, is still supported? (jian zhang)


----------------------------------------------------------------------

Message: 1
Date: Wed, 15 Jul 2015 18:18:12 +0200
From: Vincent Nguyen <vnguyen@neuf.fr>
Subject: [Moses-support] Getting started - Baseline basic question
To: moses-support@mit.edu
Message-ID: <55A687C4.5080502@neuf.fr>
Content-Type: text/plain; charset=utf-8; format=flowed


> Hello,
>
> Sorry if this is basic but I am trying to get started and something is
> unclear to me in the manual :
>
> Section 2.1.3 recommends (Hieu) Mgiza for Word Alignment and says
> Moses includes KenLM
> which makes me understand that IRSTLM and SRILM are optional.
>
> Build is fine.
> Section 2.1.8 Run Moses for the first time is fine
>
> Then comes the baseline section 2.3 :
>
> Can I skip installing Giza++ since I have installed Mgiza as mentioned
> before ?
>
> Corpus training is fine.
>
> Then if I skip installation of IRSTLM ---since it is optional --- do I
> need to skip completely 2.3.4 ?
> is there any Language Model Training to perform if we stick to KenLM ?
>
> Subsequently, if 2.3.4 is not performed, there is no
> news-commentary-v8.fr-en.blm.en file which means
> no ability to Train the Translation System.
>
>
> Does the tuning 2.3.6 remain relevant without the above steps ? but in
> this case what the "working" directory ?
>
> I hope my questions are clear but basically how do we follow the
> Baseline guide without using IRSTLM ?
>
> Thanks
> Vincent
>


------------------------------

Message: 2
Date: Wed, 15 Jul 2015 17:30:41 +0100
From: Rico Sennrich <rico.sennrich@gmx.ch>
Subject: Re: [Moses-support] Moses build failed
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <55A68AB1.4050100@gmx.ch>
Content-Type: text/plain; charset="windows-1252"

Hi Manuela,

I don't know enough about cygwin to know how the installation of the
dependencies could have gone wrong.

Can someone who uses cygwin help?

best wishes,
Rico

On 15.07.2015 14:56, Manuela Sanguinetti wrote:
> Hi Rico,
>
> first of all, thanks for your feedback.
> I first installed all the dependencies listed on the Moses page by
> running the Cygwin 'set_up-x86_64' executable file. However, checking
> if everything was actually there (using the command "which ..."), it
> appeared that for a large number of those packages this wasn't the
> case. So I've just tried to install them using the command "apt-cyg
> install ...", but I got the message "Package ... is already installed,
> skipping"!
> I guess that all these "missing" dependecies should then be properly
> linked, by setting some path or environment variable ... but
> unfortunately this goes far beyond my competences in computer science
> :( so now I'm totally clueless as to what to do.
>
> Thank you anyway,
> Manuela
>
>
> Il 15/07/2015 15:26, Rico Sennrich ha scritto:
>> Hello Manuela,
>>
>> have you installed all the dependencies listed here for Cygwin
>> installation? http://www.statmt.org/moses/?n=Development.GetStarted
>>
>> it seems like you're missing a system-wide installation of boost.
>> mosesdecoder/bjam currently isn't set-up to use the boost-jam of a
>> local boost installation (even if you pass a "--with-boost" argument).
>>
>> best wishes,
>> Rico
>>
>>
>> On 15.07.2015 12:19, Manuela Sanguinetti wrote:
>>> Hi,
>>>
>>> I'm experiencing some problems in compiling Moses on Windows using
>>> Cygwin. I manually installed Boost (v. 1.58), but when I run the
>>> command
>>>
>>> ~/mosesdecoder
>>> $ ./bjam --with-boost=~/boost_1_58_0/ -j4
>>>
>>> the build fails.
>>> I'm attaching the 'build.log.gz' file, as suggested in the error
>>> message, hoping that someone could help me figuring out what the
>>> problem is and how I can fix it.
>>>
>>>
>>> Thank you in advance for any hint you may provide,
>>> MS
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150715/1d945659/attachment-0001.htm

------------------------------

Message: 3
Date: Wed, 15 Jul 2015 23:14:35 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Getting started - Baseline basic question
To: Vincent Nguyen <vnguyen@neuf.fr>, moses-support@mit.edu
Message-ID: <55A6B11B.6060707@gmail.com>
Content-Type: text/plain; charset=windows-1252; format=flowed



On 15/07/2015 20:18, Vincent Nguyen wrote:
>> Hello,
>>
>> Sorry if this is basic but I am trying to get started and something is
>> unclear to me in the manual :
>>
>> Section 2.1.3 recommends (Hieu) Mgiza for Word Alignment and says
>> Moses includes KenLM
>> which makes me understand that IRSTLM and SRILM are optional.
>>
>> Build is fine.
>> Section 2.1.8 Run Moses for the first time is fine
>>
>> Then comes the baseline section 2.3 :
>>
>> Can I skip installing Giza++ since I have installed Mgiza as mentioned
>> before ?
that's fine. I only ever use mgiza too
>>
>> Corpus training is fine.
>>
>> Then if I skip installation of IRSTLM ---since it is optional --- do I
>> need to skip completely 2.3.4 ?
>> is there any Language Model Training to perform if we stick to KenLM ?
you need to create a language model. You can do it with kenlm using the
program lmplz. The program is described here:
https://kheafield.com/code/kenlm/estimation/
We haven't updated the tutorial with more info about lmplz yet, but we
should do at some point
>>
>> Subsequently, if 2.3.4 is not performed, there is no
>> news-commentary-v8.fr-en.blm.en file which means
>> no ability to Train the Translation System.
>>
>>
>> Does the tuning 2.3.6 remain relevant without the above steps ? but in
>> this case what the "working" directory ?
yes, you MUST tune to get good translation quality.
>>
>> I hope my questions are clear but basically how do we follow the
>> Baseline guide without using IRSTLM ?
that's not a problem. It's probably common now use use kenlm in place of
SRILM and IRSTLM for training and decoding.
>>
>> Thanks
>> Vincent
>>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>

--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu



------------------------------

Message: 4
Date: Wed, 15 Jul 2015 21:50:31 +0200
From: Vincent Nguyen <vnguyen@neuf.fr>
Subject: Re: [Moses-support] Getting started - Baseline basic question
To: Hieu Hoang <hieuhoang@gmail.com>, moses-support@mit.edu
Message-ID: <55A6B987.3050501@neuf.fr>
Content-Type: text/plain; charset=windows-1252; format=flowed

you need to create a language model. You can do it with kenlm using the
program lmplz. The program is described here:
> https://kheafield.com/code/kenlm/estimation/
> We haven't updated the tutorial with more info about lmplz yet, but we
> should do at some point


I have read this page, but honestly I have no clue about the sequence of
what to do to create the LM and the training
once I have prepared the Corpus.


------------------------------

Message: 5
Date: Thu, 16 Jul 2015 00:48:23 +0100
From: jian zhang <zhangj@computing.dcu.ie>
Subject: [Moses-support] Sparse phrase table, is still supported?
To: moses-support@mit.edu
Message-ID:
<CALA=z0D+qWG17+HiN-JzjwsQ7B6nJBU0X1K7GB5dJySXpzdCPg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

Is the sparse features at phrase table, like

das Haus ||| the house ||| 0.8 0.5 0.8 0.5 2.718 ||| 0-0 1-1 ||| 5000 5000
2500 ||| dom_europarl 1

still supported? If yes, what should I set to the ini file based on the
example above?

Thank,

Jian

--
Jian Zhang
Centre for Next Generation Localisation (CNGL)
<http://www.cngl.ie/index.html>
Dublin City University <http://www.dcu.ie/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150716/896e5f1c/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 105, Issue 30
**********************************************

Tweet