Moses-support Digest, Vol 115, Issue 13

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Target phrase collection (Prashant Mathur)
2. Re: Target phrase collection (Hieu Hoang)
3. Re: Target phrase collection (Prashant Mathur)
4. Re: Target phrase collection (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 12 May 2016 19:31:23 +0200
From: Prashant Mathur <prashant@fbk.eu>
Subject: [Moses-support] Target phrase collection
To: moses-support <moses-support@mit.edu>
Message-ID: <D14A3A1C-BB94-4EBB-86F7-CEADD2CF3FBD@fbk.eu>
Content-Type: text/plain; charset="us-ascii"

Hi All,

Two questions:
1. Is it okay to pass the sentence ID to PhraseDictionary* via InitializeForInput function? or is it not thread safe?

2. The auxiliary document level tags at sentence level (<dlt>) does not seem to be thread safe so I would like to have the sentence id information pass on to the GetTargetPhraseCollection function.
Is there already something that I can use?


Thanks,
Prashant
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160512/1044562a/attachment-0001.html

------------------------------

Message: 2
Date: Thu, 12 May 2016 18:57:12 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Target phrase collection
To: Prashant Mathur <prashant@fbk.eu>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbgknJj4bjyQA2BPOdAsM2twCh72DRSNxRXPQ6W+_kNANg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hieu Hoang
http://www.hoang.co.uk/hieu

On 12 May 2016 at 18:31, Prashant Mathur <prashant@fbk.eu> wrote:

> Hi All,
>
> Two questions:
> 1. Is it okay to pass the sentence ID to PhraseDictionary* via
> InitializeForInput function? or is it not thread safe?
>
InitializeForInput() is given the task object, which contains the input,
which contains the id.
ttask->GetSource()->GetTranslationId()
it's threadsafe.

>
> 2. The auxiliary document level tags at sentence level (<dlt>) does not
> seem to be thread safe so I would like to have the sentence id information
> pass on to the GetTargetPhraseCollection function.
> Is there already something that I can use?
>
>
>
> Thanks,
> Prashant
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160512/4e15cba6/attachment-0001.html

------------------------------

Message: 3
Date: Thu, 12 May 2016 20:16:10 +0200
From: Prashant Mathur <prashant@fbk.eu>
Subject: Re: [Moses-support] Target phrase collection
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <DA1184F0-50B1-4680-895C-83D7C36C48E1@fbk.eu>
Content-Type: text/plain; charset="us-ascii"

ok.. I got the first one.

What about the second one? is there a way to tell PhraseDictionary* which sentence is in question? So that the target phrases are only calculated for that sentence, while moses being multi-threaded at the same time.

Can I override this function in PhraseDictionary.h?
virtual void GetTargetPhraseCollectionBatch
(ttasksptr const& ttask, InputPathList const& inputPathQueue) const{
GetTargetPhraseCollectionBatch(inputPathQueue);
}

> On May 12, 2016, at 7:57 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>
>
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu <http://www.hoang.co.uk/hieu>
>
> On 12 May 2016 at 18:31, Prashant Mathur <prashant@fbk.eu <mailto:prashant@fbk.eu>> wrote:
> Hi All,
>
> Two questions:
> 1. Is it okay to pass the sentence ID to PhraseDictionary* via InitializeForInput function? or is it not thread safe?
> InitializeForInput() is given the task object, which contains the input, which contains the id.
> ttask->GetSource()->GetTranslationId()
> it's threadsafe.
>
> 2. The auxiliary document level tags at sentence level (<dlt>) does not seem to be thread safe so I would like to have the sentence id information pass on to the GetTargetPhraseCollection function.
> Is there already something that I can use?
>
>
> Thanks,
> Prashant
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support <http://mailman.mit.edu/mailman/listinfo/moses-support>
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160512/acea73ac/attachment-0001.html

------------------------------

Message: 4
Date: Thu, 12 May 2016 21:12:09 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Target phrase collection
To: Prashant Mathur <prashant@fbk.eu>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <a0c76772-ae55-63c9-a6b1-7275f479ad36@gmail.com>
Content-Type: text/plain; charset="windows-1252"

I don't understand your question, but GetTargetPhraseCollectionBatch()
is marked as virtual so you are encourage to override it

On 12/05/2016 19:16, Prashant Mathur wrote:
> ok.. I got the first one.
>
> What about the second one? is there a way to tell PhraseDictionary*
> which sentence is in question? So that the target phrases are only
> calculated for that sentence, while moses being multi-threaded at the
> same time.
>
> Can I override this function in PhraseDictionary.h?
> virtual void GetTargetPhraseCollectionBatch
> (ttasksptr const& ttask, InputPathList const& inputPathQueue) const{
> GetTargetPhraseCollectionBatch(inputPathQueue);
> }
>
>> On May 12, 2016, at 7:57 PM, Hieu Hoang <hieuhoang@gmail.com
>> <mailto:hieuhoang@gmail.com>> wrote:
>>
>>
>>
>> Hieu Hoang
>> http://www.hoang.co.uk/hieu
>>
>> On 12 May 2016 at 18:31, Prashant Mathur <prashant@fbk.eu
>> <mailto:prashant@fbk.eu>> wrote:
>>
>> Hi All,
>>
>> Two questions:
>> 1. Is it okay to pass the sentence ID to PhraseDictionary* via
>> InitializeForInput function? or is it not thread safe?
>>
>> InitializeForInput() is given the task object, which contains the
>> input, which contains the id.
>> ttask->GetSource()->GetTranslationId()
>> it's threadsafe.
>>
>>
>> 2. The auxiliary document level tags at sentence level (<dlt>)
>> does not seem to be thread safe so I would like to have the
>> sentence id information pass on to the GetTargetPhraseCollection
>> function.
>> Is there already something that I can use?
>>
>>
>> Thanks,
>> Prashant
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160512/2005a47e/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 115, Issue 13
**********************************************

Tweet