Moses-support Digest, Vol 113, Issue 36

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Training backward LM? (Lane Schwartz)
2. Re: Compiling with ./bjam problem (Hieu Hoang)
3. Re: Training backward LM? (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Fri, 11 Mar 2016 10:26:23 -0600
From: Lane Schwartz <dowobeha@gmail.com>
Subject: Re: [Moses-support] Training backward LM?
To: Michael Denkowski <michael.j.denkowski@gmail.com>, Hieu Hoang
<hieuhoang@gmail.com>
Cc: Moses Support <moses-support@mit.edu>
Message-ID:
<CABv3vZn9yVQZoLy-QpC7sZ8RP-nSau9kX79V8Bwxf-KUnmmc8Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hieu,

What happened to moses/LM/Factory.cpp? It's not there anymore.

Lane


On Fri, Mar 11, 2016 at 10:22 AM, Lane Schwartz <dowobeha@gmail.com> wrote:

> You'll also need to tell the moses.ini file that you want a BackwardLM.
>
> For example, see the code at revision
> 8459a86137f7d15834009557a62c4278479da088 in moses/LM/Factory.cpp:
>
> + case BackwardLM:
>> + return ConstructBackwardLM(languageModelFile, factorTypes[0],
>> lmImplementation == LazyKen);
>> + break;
>
>
> If that code has been removed, it will need to be re-added.
>
>
> On Fri, Mar 11, 2016 at 10:16 AM, Lane Schwartz <dowobeha@gmail.com>
> wrote:
>
>> I see ngrams in the backward.arpa file that look like this:
>>
>> -1.263617 we </s>
>>> -1.263617 we when
>>> -0.6615573 when </s>
>>
>>
>> -1.48317 <s> . rights
>>
>> -1.48317 <s> . works
>>
>>
>> Based on that, and on my recollection, I think you just have to reverse
>> the order of the words in each sentence, and then just run that modified
>> corpus through your LM trainer.
>>
>>
>>
>> On Fri, Mar 11, 2016 at 10:12 AM, Lane Schwartz <dowobeha@gmail.com>
>> wrote:
>>
>>> I'm the one who wrote that code. I don't remember off hand exactly what
>>> was necessary, but I believe that I left notes in the git commit log.
>>> Somewhere in my archives I think I have the actual scripts that I used, but
>>> I don't have those easily accessible right now. I'll try to find them.
>>>
>>> In the meantime, the best way to figure it out is to run git log within
>>> the moses repo, and search for all mentioned of the word "backward". That
>>> will show you my commits. I did create unit tests for the backward LM, so I
>>> would advise looking at the unit tests.
>>>
>>> I have checked in a trained backward LM. I believe it's a backward
>>> trigram model trained on the text of the GNU GPL license file.
>>>
>>> That file is in the moses repo at moses/LM/backward.arpa. There is a
>>> corresponding unit test at moses/LM/BackwardTest.cpp that tests the
>>> correctness of the code when querying moses/LM/backward.arpa for certain
>>> specific n-grams.
>>>
>>> I suspect that looking at those two files should be sufficient to answer
>>> your questions. If it's not, let me know and I can spend some time digging
>>> through my old archived files.
>>>
>>>
>>>
>>> On Thu, Mar 10, 2016 at 3:33 PM, Michael Denkowski <
>>> michael.j.denkowski@gmail.com> wrote:
>>>
>>>> Hi Moses LM enthusiasts,
>>>>
>>>> This may be a silly question. If I want to use the BackwardLanguageModel
>>>> feature, what (if anything) should I do to let KenLM know that it's a
>>>> backward model?
>>>>
>>>> If I just reverse the words in each sentence and run
>>>> lmplz/build_binary, will Moses do the right thing with the model? Do I
>>>> need to do anything special with <s> and </s>?
>>>>
>>>> Best,
>>>> Michael
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>
>>>
>>> --
>>> When a place gets crowded enough to require ID's, social collapse is not
>>> far away. It is time to go elsewhere. The best thing about space travel
>>> is that it made it possible to go elsewhere.
>>> -- R.A. Heinlein, "Time Enough For Love"
>>>
>>
>>
>>
>> --
>> When a place gets crowded enough to require ID's, social collapse is not
>> far away. It is time to go elsewhere. The best thing about space travel
>> is that it made it possible to go elsewhere.
>> -- R.A. Heinlein, "Time Enough For Love"
>>
>
>
>
> --
> When a place gets crowded enough to require ID's, social collapse is not
> far away. It is time to go elsewhere. The best thing about space travel
> is that it made it possible to go elsewhere.
> -- R.A. Heinlein, "Time Enough For Love"
>



--
When a place gets crowded enough to require ID's, social collapse is not
far away. It is time to go elsewhere. The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, "Time Enough For Love"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160311/6bc69f93/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 11 Mar 2016 16:29:21 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Compiling with ./bjam problem
To: Despina Mouratidi <dmouratidi@gmail.com>, Moses-support@mit.edu
Message-ID: <56E2F261.7020808@gmail.com>
Content-Type: text/plain; charset="windows-1252"

compiled ok for me:
./bjam --with-boost=/Users/hieu/workspace/boost/boost_1_60_0 -j4 -a
Try git pull to get the latest code and add the -a to your bjam command
to forced recompilation of all files

On 11/03/2016 13:07, Despina Mouratidi wrote:
> Hello again, i am trying to compile moses throught ./bjam as follows
>
> ./bjam --with-boost=~/boost_1_55_0 -j7
>
>
> and it gives error.
>
> Best Despina
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160311/2aaac542/attachment-0001.html

------------------------------

Message: 3
Date: Fri, 11 Mar 2016 16:30:50 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Training backward LM?
To: Lane Schwartz <dowobeha@gmail.com>
Cc: Moses Support <moses-support@mit.edu>
Message-ID:
<CAEKMkbisvepHC07gkqg6JStcQ1LU7cFYacQa_r-LEAFY=bWozw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

FF/Factory.cpp

There never was a LM/Factory.cpp

Hieu Hoang
http://www.hoang.co.uk/hieu

On 11 March 2016 at 16:26, Lane Schwartz <dowobeha@gmail.com> wrote:

> Hieu,
>
> What happened to moses/LM/Factory.cpp? It's not there anymore.
>
> Lane
>
>
> On Fri, Mar 11, 2016 at 10:22 AM, Lane Schwartz <dowobeha@gmail.com>
> wrote:
>
>> You'll also need to tell the moses.ini file that you want a BackwardLM.
>>
>> For example, see the code at revision
>> 8459a86137f7d15834009557a62c4278479da088 in moses/LM/Factory.cpp:
>>
>> + case BackwardLM:
>>> + return ConstructBackwardLM(languageModelFile, factorTypes[0],
>>> lmImplementation == LazyKen);
>>> + break;
>>
>>
>> If that code has been removed, it will need to be re-added.
>>
>>
>> On Fri, Mar 11, 2016 at 10:16 AM, Lane Schwartz <dowobeha@gmail.com>
>> wrote:
>>
>>> I see ngrams in the backward.arpa file that look like this:
>>>
>>> -1.263617 we </s>
>>>> -1.263617 we when
>>>> -0.6615573 when </s>
>>>
>>>
>>> -1.48317 <s> . rights
>>>
>>> -1.48317 <s> . works
>>>
>>>
>>> Based on that, and on my recollection, I think you just have to reverse
>>> the order of the words in each sentence, and then just run that modified
>>> corpus through your LM trainer.
>>>
>>>
>>>
>>> On Fri, Mar 11, 2016 at 10:12 AM, Lane Schwartz <dowobeha@gmail.com>
>>> wrote:
>>>
>>>> I'm the one who wrote that code. I don't remember off hand exactly what
>>>> was necessary, but I believe that I left notes in the git commit log.
>>>> Somewhere in my archives I think I have the actual scripts that I used, but
>>>> I don't have those easily accessible right now. I'll try to find them.
>>>>
>>>> In the meantime, the best way to figure it out is to run git log within
>>>> the moses repo, and search for all mentioned of the word "backward". That
>>>> will show you my commits. I did create unit tests for the backward LM, so I
>>>> would advise looking at the unit tests.
>>>>
>>>> I have checked in a trained backward LM. I believe it's a backward
>>>> trigram model trained on the text of the GNU GPL license file.
>>>>
>>>> That file is in the moses repo at moses/LM/backward.arpa. There is a
>>>> corresponding unit test at moses/LM/BackwardTest.cpp that tests the
>>>> correctness of the code when querying moses/LM/backward.arpa for certain
>>>> specific n-grams.
>>>>
>>>> I suspect that looking at those two files should be sufficient to
>>>> answer your questions. If it's not, let me know and I can spend some time
>>>> digging through my old archived files.
>>>>
>>>>
>>>>
>>>> On Thu, Mar 10, 2016 at 3:33 PM, Michael Denkowski <
>>>> michael.j.denkowski@gmail.com> wrote:
>>>>
>>>>> Hi Moses LM enthusiasts,
>>>>>
>>>>> This may be a silly question. If I want to use the BackwardLanguageModel
>>>>> feature, what (if anything) should I do to let KenLM know that it's a
>>>>> backward model?
>>>>>
>>>>> If I just reverse the words in each sentence and run
>>>>> lmplz/build_binary, will Moses do the right thing with the model? Do I
>>>>> need to do anything special with <s> and </s>?
>>>>>
>>>>> Best,
>>>>> Michael
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> When a place gets crowded enough to require ID's, social collapse is not
>>>> far away. It is time to go elsewhere. The best thing about space
>>>> travel
>>>> is that it made it possible to go elsewhere.
>>>> -- R.A. Heinlein, "Time Enough For Love"
>>>>
>>>
>>>
>>>
>>> --
>>> When a place gets crowded enough to require ID's, social collapse is not
>>> far away. It is time to go elsewhere. The best thing about space travel
>>> is that it made it possible to go elsewhere.
>>> -- R.A. Heinlein, "Time Enough For Love"
>>>
>>
>>
>>
>> --
>> When a place gets crowded enough to require ID's, social collapse is not
>> far away. It is time to go elsewhere. The best thing about space travel
>> is that it made it possible to go elsewhere.
>> -- R.A. Heinlein, "Time Enough For Love"
>>
>
>
>
> --
> When a place gets crowded enough to require ID's, social collapse is not
> far away. It is time to go elsewhere. The best thing about space travel
> is that it made it possible to go elsewhere.
> -- R.A. Heinlein, "Time Enough For Love"
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160311/c39ae391/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 36
**********************************************

Tweet