Moses-support Digest, Vol 113, Issue 37

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Lexical Reordering Model in Moses (Liangyou Li)
2. Re: Training backward LM? (Michael Denkowski)
3. Re: Compiling with ./bjam problem (Matthias Huck)


----------------------------------------------------------------------

Message: 1
Date: Fri, 11 Mar 2016 17:12:40 +0000
From: Liangyou Li <liangyouli@computing.dcu.ie>
Subject: [Moses-support] Lexical Reordering Model in Moses
To: moses-support@mit.edu
Message-ID:
<CAHeunNW6w3W6ff46xJ8ouFRuUqjoJwUHBV9AP8QKdiW-5xwjYg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi all

I have a question on the implementation of phrase-based and hierarchical
based reordering models in Moses.
According to Galley and Manning (2008)
<http://www.aclweb.org/anthology/D/D08/D08-1089.pdf> , in the phrase-based
model, orientation is set to M if an adjacent phrase pair lies at (s?1,u?1)
in the alignment grid. However, the implementation in Moses is like this:

if((connectedLeftTop && !connectedRightTop) ||
((it = inBottomRight.find(startE - unit)) != inBottomRight.end() &&
it->second.find(startF-unit) != it->second.end()))
return LEFT;

This means if there's an alignment at (s-1,u-1), the orientation will be M.
But existing an alignment at that position does not mean we can extract a
phrase there.
So why implementing like that?


Chees
Liangyou

--


Liangyou Li
PhD Candidate
ADAPT Centre
School of Computing
Dublin City University
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160311/a5a4dc6b/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 11 Mar 2016 13:01:01 -0500
From: Michael Denkowski <michael.j.denkowski@gmail.com>
Subject: Re: [Moses-support] Training backward LM?
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: Moses Support <moses-support@mit.edu>
Message-ID:
<CA+-Geg+HoTTAPdtFBmf7PP2-J8J2BUw_ab327aLDAiy2VqFyCQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thanks for the explanations everyone. I added it back to the feature
factory and it seems to be working. I'll run some tests and check it back
in if nothing catches fire (since it's already building everything anyway).

Best,
Michael

On Fri, Mar 11, 2016 at 11:30 AM, Hieu Hoang <hieuhoang@gmail.com> wrote:

> FF/Factory.cpp
>
> There never was a LM/Factory.cpp
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 11 March 2016 at 16:26, Lane Schwartz <dowobeha@gmail.com> wrote:
>
>> Hieu,
>>
>> What happened to moses/LM/Factory.cpp? It's not there anymore.
>>
>> Lane
>>
>>
>> On Fri, Mar 11, 2016 at 10:22 AM, Lane Schwartz <dowobeha@gmail.com>
>> wrote:
>>
>>> You'll also need to tell the moses.ini file that you want a BackwardLM.
>>>
>>> For example, see the code at revision
>>> 8459a86137f7d15834009557a62c4278479da088 in moses/LM/Factory.cpp:
>>>
>>> + case BackwardLM:
>>>> + return ConstructBackwardLM(languageModelFile, factorTypes[0],
>>>> lmImplementation == LazyKen);
>>>> + break;
>>>
>>>
>>> If that code has been removed, it will need to be re-added.
>>>
>>>
>>> On Fri, Mar 11, 2016 at 10:16 AM, Lane Schwartz <dowobeha@gmail.com>
>>> wrote:
>>>
>>>> I see ngrams in the backward.arpa file that look like this:
>>>>
>>>> -1.263617 we </s>
>>>>> -1.263617 we when
>>>>> -0.6615573 when </s>
>>>>
>>>>
>>>> -1.48317 <s> . rights
>>>>
>>>> -1.48317 <s> . works
>>>>
>>>>
>>>> Based on that, and on my recollection, I think you just have to reverse
>>>> the order of the words in each sentence, and then just run that modified
>>>> corpus through your LM trainer.
>>>>
>>>>
>>>>
>>>> On Fri, Mar 11, 2016 at 10:12 AM, Lane Schwartz <dowobeha@gmail.com>
>>>> wrote:
>>>>
>>>>> I'm the one who wrote that code. I don't remember off hand exactly
>>>>> what was necessary, but I believe that I left notes in the git commit log.
>>>>> Somewhere in my archives I think I have the actual scripts that I used, but
>>>>> I don't have those easily accessible right now. I'll try to find them.
>>>>>
>>>>> In the meantime, the best way to figure it out is to run git log
>>>>> within the moses repo, and search for all mentioned of the word "backward".
>>>>> That will show you my commits. I did create unit tests for the backward LM,
>>>>> so I would advise looking at the unit tests.
>>>>>
>>>>> I have checked in a trained backward LM. I believe it's a backward
>>>>> trigram model trained on the text of the GNU GPL license file.
>>>>>
>>>>> That file is in the moses repo at moses/LM/backward.arpa. There is a
>>>>> corresponding unit test at moses/LM/BackwardTest.cpp that tests the
>>>>> correctness of the code when querying moses/LM/backward.arpa for certain
>>>>> specific n-grams.
>>>>>
>>>>> I suspect that looking at those two files should be sufficient to
>>>>> answer your questions. If it's not, let me know and I can spend some time
>>>>> digging through my old archived files.
>>>>>
>>>>>
>>>>>
>>>>> On Thu, Mar 10, 2016 at 3:33 PM, Michael Denkowski <
>>>>> michael.j.denkowski@gmail.com> wrote:
>>>>>
>>>>>> Hi Moses LM enthusiasts,
>>>>>>
>>>>>> This may be a silly question. If I want to use the BackwardLanguageModel
>>>>>> feature, what (if anything) should I do to let KenLM know that it's a
>>>>>> backward model?
>>>>>>
>>>>>> If I just reverse the words in each sentence and run
>>>>>> lmplz/build_binary, will Moses do the right thing with the model? Do I
>>>>>> need to do anything special with <s> and </s>?
>>>>>>
>>>>>> Best,
>>>>>> Michael
>>>>>>
>>>>>> _______________________________________________
>>>>>> Moses-support mailing list
>>>>>> Moses-support@mit.edu
>>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> When a place gets crowded enough to require ID's, social collapse is
>>>>> not
>>>>> far away. It is time to go elsewhere. The best thing about space
>>>>> travel
>>>>> is that it made it possible to go elsewhere.
>>>>> -- R.A. Heinlein, "Time Enough For Love"
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> When a place gets crowded enough to require ID's, social collapse is not
>>>> far away. It is time to go elsewhere. The best thing about space
>>>> travel
>>>> is that it made it possible to go elsewhere.
>>>> -- R.A. Heinlein, "Time Enough For Love"
>>>>
>>>
>>>
>>>
>>> --
>>> When a place gets crowded enough to require ID's, social collapse is not
>>> far away. It is time to go elsewhere. The best thing about space travel
>>> is that it made it possible to go elsewhere.
>>> -- R.A. Heinlein, "Time Enough For Love"
>>>
>>
>>
>>
>> --
>> When a place gets crowded enough to require ID's, social collapse is not
>> far away. It is time to go elsewhere. The best thing about space travel
>> is that it made it possible to go elsewhere.
>> -- R.A. Heinlein, "Time Enough For Love"
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160311/98c28442/attachment-0001.html

------------------------------

Message: 3
Date: Fri, 11 Mar 2016 18:08:20 +0000
From: Matthias Huck <mhuck@inf.ed.ac.uk>
Subject: Re: [Moses-support] Compiling with ./bjam problem
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <1457719700.3234.203.camel@portedgar>
Content-Type: text/plain; charset="UTF-8"

Hi Despina,

It seems to me that bjam doesn't use the boost build in your home
directory, but some other boost version installed on the system.

Maybe you should try

./bjam --with-boost=/home/despina/boost_1_55_0 -j4 -a

Cheers,
Matthias


On Fri, 2016-03-11 at 16:29 +0000, Hieu Hoang wrote:
> compiled ok for me:
> ./bjam --with-boost=/Users/hieu/workspace/boost/boost_1_60_0 -j4 -a
> Try git pull to get the latest code and add the -a to your bjam command
> to forced recompilation of all files
>
> On 11/03/2016 13:07, Despina Mouratidi wrote:
> > Hello again, i am trying to compile moses throught ./bjam as follows
> >
> > ./bjam --with-boost=~/boost_1_55_0 -j7
> >
> >
> > and it gives error.
> >
> > Best Despina
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support



--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 37
**********************************************

Tweet