Moses-support Digest, Vol 113, Issue 34

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Reseting data structures for each new sentence
(Jasneet Sabharwal)
2. Compiling with ./bjam problem (Despina Mouratidi)
3. Re: Training backward LM? (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Fri, 11 Mar 2016 01:03:04 -0800
From: Jasneet Sabharwal <jasneet.sabharwal@sfu.ca>
Subject: Re: [Moses-support] Reseting data structures for each new
sentence
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <510A0D0E-3B47-4BFF-B3EF-0257AE0C033E@sfu.ca>
Content-Type: text/plain; charset="utf-8"

Hi Hieu,

Thank you for your reply. I tried both of these approaches.

In first case, I get an exception at NOT_FOUND. When I try to print the words range array, the minimum is always "wordsRange: [0..0]?.

In second case, "cur_hypo.GetWordsBitmap().GetNumWordsCovered() == 0? is never true as the minimum I get is equal to 1.

As, InitializeForInput() cannot be useful in my current situation, is there any other way to know when I start processing a new sentence?

Thank you and regards,
Jasneet
> On Mar 9, 2016, at 3:41 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>
> i get ya. You can do
>
> EvaluateWhenApplied(Hypothesis cur_hypo, FFState, ScoreComponenetCollection) {
> If (cur_hypo.GetCurrSourceWordsRange() == NOT_FOUND) then {
> LMState = CoarseLM->BeginSentenceState()
> }
> }
>
> or
>
> EvaluateWhenApplied(Hypothesis cur_hypo, FFState, ScoreComponenetCollection) {
> If (cur_hypo.GetWordsBitmap().GetNumWordsCovered() == 0) then {
> LMState = CoarseLM->BeginSentenceState()
> }
> }
>
> Each FF can also override
> InitializeForInput()
>
> This might not be suitable for you on this occasion, but it's worth bearing in mind
>
>
> On 09/03/2016 23:20, Jasneet Sabharwal wrote:
>> Hi Hieu,
>>
>> Thanks for replying. For example:
>>
>> EvaluateWhenApplied(Hypothesis, FFState, ScoreComponenetCollection) {
>> If (processing a new source sentence), then {
>> LMState = CoarseLM->BeginSentenceState()
>> }
>> }
>>
>> Here, I am trying to check if I am processing a new source sentence, so I should reset my language model states that I calling from my feature function.
>>
>> Does this give an idea of what I am trying to do?
>>
>> Regards,
>> Jasneet
>>
>>> On Mar 9, 2016, at 2:51 PM, Hieu Hoang < <mailto:hieuhoang@gmail.com>hieuhoang@gmail.com <mailto:hieuhoang@gmail.com>> wrote:
>>>
>>> can you give an example
>>>
>>> Hieu Hoang
>>> http://www.hoang.co.uk/hieu <http://www.hoang.co.uk/hieu>
>>>
>>> On 9 March 2016 at 22:36, Jasneet Sabharwal < <mailto:jasneet.sabharwal@sfu.ca>jasneet.sabharwal@sfu.ca <mailto:jasneet.sabharwal@sfu.ca>> wrote:
>>> Hi Everyone,
>>>
>>> I have added a feature function in Moses. Is it possible to know through the Hypothesis parameter in ?EvaluateWhenApplied? function that I am now processing the first state in a new source sentence. I would like to reset certain states whenever we start translating a new source sentence.
>>>
>>> Thank you for the help.
>>>
>>> Regards,
>>> Jasneet
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>> http://mailman.mit.edu/mailman/listinfo/moses-support <http://mailman.mit.edu/mailman/listinfo/moses-support>
>>>
>>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160311/0c36eea7/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 11 Mar 2016 15:07:06 +0200
From: Despina Mouratidi <dmouratidi@gmail.com>
Subject: [Moses-support] Compiling with ./bjam problem
To: Moses-support@mit.edu
Message-ID:
<CAJJG54no6OFvUeBcJPLAp3+uX4dgVkxCH24aTdjjarwc20ikpw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello again, i am trying to compile moses throught ./bjam as follows

./bjam --with-boost=~/boost_1_55_0 -j7


and it gives error.

Best Despina
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.gz
Type: application/x-gzip
Size: 2279 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20160311/cb3e2383/attachment-0001.gz

------------------------------

Message: 3
Date: Fri, 11 Mar 2016 15:56:47 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Training backward LM?
To: Michael Denkowski <michael.j.denkowski@gmail.com>, Moses Support
<moses-support@mit.edu>
Message-ID: <56E2EABF.1010101@gmail.com>
Content-Type: text/plain; charset="windows-1252"

I remember there is compilation issues with it. I guess at some point
someone must have gotten tired of looking after it and took it out of
the build.

On 10/03/2016 23:36, Michael Denkowski wrote:
> As a follow-up, how exactly does one activate the
> BackwardLanguageModel feature? It doesn't seem to be registered
> anywhere although it's been in Moses for awhile. Still work in progress?
>
> Best,
> Michael
>
> On Thu, Mar 10, 2016 at 4:33 PM, Michael Denkowski
> <michael.j.denkowski@gmail.com <mailto:michael.j.denkowski@gmail.com>>
> wrote:
>
> Hi Moses LM enthusiasts,
>
> This may be a silly question. If I want to use the
> BackwardLanguageModel feature, what (if anything) should I do to
> let KenLM know that it's a backward model?
>
> If I just reverse the words in each sentence and run
> lmplz/build_binary, will Moses do the right thing with the model?
> Do I need to do anything special with <s> and </s>?
>
> Best,
> Michael
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160311/2fee8782/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 34
**********************************************

Tweet