Home » Uncategories » Moses-support Digest, Vol 82, Issue 49

Moses-support Digest, Vol 82, Issue 49

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: New parameter "const std::string &line" in
FeatureFunction (Lane Schwartz)
2. Re: Stuck when running moses (Jelita Asian)
3. Re: Stuck when running moses (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Wed, 28 Aug 2013 13:45:59 -0400
From: Lane Schwartz <dowobeha@gmail.com>
Subject: Re: [Moses-support] New parameter "const std::string &line"
in FeatureFunction
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CABv3vZm37Z15=hrB9tYzx7TvzK_u8v0xxSfssNmbK-xxvEWLJg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

OK. This was for a unit test.


On Wed, Aug 28, 2013 at 4:27 AM, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:

> line contains the string that is specified in the [feature] section for
> the feature. eg.
> KENLM lazyken=0 name=LM0 factor=0 path=../interpolated-binlm.1 order=3
> the line variable should be passed to the FeatureFunction base class
> during construction.
>
> you can then parse it for your feature-specific variables. Best to do this
> by
> 1. call ReadParameters() in your constructor
> 2. Implement
> SetParameter(const std::string& key, const std::string& value)
>
> see class PhraseBoundaryState for a good example, or the irstlm or srilm
> in about 2 yrs after i've cleaned them up...
>
>
>
> On 27 August 2013 19:22, Lane Schwartz <dowobeha@gmail.com> wrote:
>
>> I'm doing some LM tinkering, and I noticed that there's a new parameter
>> in FeatureFunction and its descendents.
>>
>> What is the following parameter represent?
>>
>> "const std::string &line"
>>
>> Thanks,
>> Lane
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>


--
When a place gets crowded enough to require ID's, social collapse is not
far away. It is time to go elsewhere. The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, "Time Enough For Love"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20130828/16da7086/attachment-0001.htm

------------------------------

Message: 2
Date: Thu, 29 Aug 2013 16:10:08 +0700
From: Jelita Asian <jelitayang@gmail.com>
Subject: Re: [Moses-support] Stuck when running moses
To: moses-support@MIT.EDU
Message-ID:
<CAOmUaap4NPZAe0sN-beF-SmO+F_FXBx2FO6gt1sD0D1dwSiw4A@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hello, any pointer what's wrong? I need to press enter for it to go through
to the next line. Is that something wrong with the phrase table?

Best regards,

Jelita


On Wed, Aug 28, 2013 at 5:52 PM, Jelita Asian <jelitayang@gmail.com> wrote:

> When I run the moses command, it suddenly stops with this error:
>
> Defined parameters (per moses.ini or switch):
> config: bin_id/moses.ini
> distortion-file: 0-0 wbe-msd-bidirectional-fe-allff 6
> bin_id/reordering-
> table.Corpus27August2013.for_train.id-en.wbe-msd-bidirectional-fe
> distortion-limit: 6
> input-factors: 0
> lmodel-file: 1 0 4
> bin_id/en.LM-Corpus27August2013.for_train-IRSTLM-4-1-
> improved-kneser-ney-0-1.blm.mm
> mapping: 0 T 0
> ttable-file: 1 0 0 5 bin_id/
> phrase-table.Corpus27August2013.for_train.id
> -en
> ttable-limit: 20
> weight-d: 0.3 0.3 0.3 0.3 0.3 0.3 0.3
> weight-l: 0.8
> weight-t: 1 0.2 0.2 0.2 0.2
> weight-w: -1
> .
> ScoreProducer: Distortion start: 0 end: 1
> ScoreProducer: WordPenalty start: 1 end: 2
> ScoreProducer: !UnknownWordPenalty start: 2 end: 3
> Loading lexical distortion models...have 1 models
> ScoreProducer: LexicalReordering_wbe-msd-bidirectional-fe-allff start: 3
> end: 9
> Creating lexical reordering...
> weights: 0.300 0.300 0.300 0.300 0.300 0.300
> binary file loaded, default OFF_T: -1
> Start loading LanguageModel
> bin_id/en.LM-Corpus27August2013.for_train-IRSTLM-4-1
> -improved-kneser-ney-0-1.blm.mm : [0.322] seconds
> In LanguageModelIRST::Load: nGramOrder = 4
> Language Model Type of
> bin_id/en.LM-Corpus27August2013.for_train-IRSTLM-4-1-impr
> oved-kneser-ney-0-1.blm.mm is 1
> Language Model Type is 1
> blmt
> loadbin()
> lmtable::loadbin_dict()
> dict->size(): 52515
> loadbin_level (level 1)
> mapping 52515 1-grams
> tableOffs 543479 tableGaps19191-grams
> done (level 1)
> loadbin_level (level 2)
> mapping 758553 2-grams
> tableOffs 1331204 tableGaps20484-grams
> done (level 2)
> loadbin_level (level 3)
> mapping 1690187 3-grams
> tableOffs 12709499 tableGaps61051-grams
> done (level 3)
> loadbin_level (level 4)
> mapping 2146354 4-grams
> tableOffs 38062304 tableGaps51424-grams
> done (level 4)
> done
> OOV code is 52514
> IRST: m_unknownId=52514
> ScoreProducer: LM start: 9 end: 10
> Finished loading LanguageModels : [0.630] seconds
> Start loading PhraseTable
> bin_id/phrase-table.Corpus27August2013.for_train.id-en
> : [0.634] seconds
> filePath: bin_id/phrase-table.Corpus27August2013.for_train.id-en
> ScoreProducer: PhraseModel start: 10 end: 15
> Finished loading phrase tables : [0.641] seconds
> IO from STDOUT/STDIN
> Created input-output object : [0.645] seconds
>
>
> However, sometime when I run the same code without changing anything, it
> seems OK. Why is that?
> Thanks.
>
> Best regards
>
> Jelita
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20130829/8576a16d/attachment-0001.htm

------------------------------

Message: 3
Date: Thu, 29 Aug 2013 10:17:28 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Stuck when running moses
To: Jelita Asian <jelitayang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbjZOuz3w391LVj6LP3DG2f8BRbK++W=xYwKU5-dq1xyRw@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

what is the EXACT command you entered? Can you also please attach your ini
file.

did you provide the decoder with a file of sentences you wish to translate?
if not, it wait for you to enter a sentence to decode



On 29 August 2013 10:10, Jelita Asian <jelitayang@gmail.com> wrote:

> Hello, any pointer what's wrong? I need to press enter for it to go
> through to the next line. Is that something wrong with the phrase table?
>
> Best regards,
>
> Jelita
>
>
> On Wed, Aug 28, 2013 at 5:52 PM, Jelita Asian <jelitayang@gmail.com>wrote:
>
>> When I run the moses command, it suddenly stops with this error:
>>
>> Defined parameters (per moses.ini or switch):
>> config: bin_id/moses.ini
>> distortion-file: 0-0 wbe-msd-bidirectional-fe-allff 6
>> bin_id/reordering-
>> table.Corpus27August2013.for_train.id-en.wbe-msd-bidirectional-fe
>> distortion-limit: 6
>> input-factors: 0
>> lmodel-file: 1 0 4
>> bin_id/en.LM-Corpus27August2013.for_train-IRSTLM-4-1-
>> improved-kneser-ney-0-1.blm.mm
>> mapping: 0 T 0
>> ttable-file: 1 0 0 5 bin_id/
>> phrase-table.Corpus27August2013.for_train.id
>> -en
>> ttable-limit: 20
>> weight-d: 0.3 0.3 0.3 0.3 0.3 0.3 0.3
>> weight-l: 0.8
>> weight-t: 1 0.2 0.2 0.2 0.2
>> weight-w: -1
>> .
>> ScoreProducer: Distortion start: 0 end: 1
>> ScoreProducer: WordPenalty start: 1 end: 2
>> ScoreProducer: !UnknownWordPenalty start: 2 end: 3
>> Loading lexical distortion models...have 1 models
>> ScoreProducer: LexicalReordering_wbe-msd-bidirectional-fe-allff start: 3
>> end: 9
>> Creating lexical reordering...
>> weights: 0.300 0.300 0.300 0.300 0.300 0.300
>> binary file loaded, default OFF_T: -1
>> Start loading LanguageModel
>> bin_id/en.LM-Corpus27August2013.for_train-IRSTLM-4-1
>> -improved-kneser-ney-0-1.blm.mm : [0.322] seconds
>> In LanguageModelIRST::Load: nGramOrder = 4
>> Language Model Type of
>> bin_id/en.LM-Corpus27August2013.for_train-IRSTLM-4-1-impr
>> oved-kneser-ney-0-1.blm.mm is 1
>> Language Model Type is 1
>> blmt
>> loadbin()
>> lmtable::loadbin_dict()
>> dict->size(): 52515
>> loadbin_level (level 1)
>> mapping 52515 1-grams
>> tableOffs 543479 tableGaps19191-grams
>> done (level 1)
>> loadbin_level (level 2)
>> mapping 758553 2-grams
>> tableOffs 1331204 tableGaps20484-grams
>> done (level 2)
>> loadbin_level (level 3)
>> mapping 1690187 3-grams
>> tableOffs 12709499 tableGaps61051-grams
>> done (level 3)
>> loadbin_level (level 4)
>> mapping 2146354 4-grams
>> tableOffs 38062304 tableGaps51424-grams
>> done (level 4)
>> done
>> OOV code is 52514
>> IRST: m_unknownId=52514
>> ScoreProducer: LM start: 9 end: 10
>> Finished loading LanguageModels : [0.630] seconds
>> Start loading PhraseTable
>> bin_id/phrase-table.Corpus27August2013.for_train.id-en
>> : [0.634] seconds
>> filePath: bin_id/phrase-table.Corpus27August2013.for_train.id-en
>> ScoreProducer: PhraseModel start: 10 end: 15
>> Finished loading phrase tables : [0.641] seconds
>> IO from STDOUT/STDIN
>> Created input-output object : [0.645] seconds
>>
>>
>> However, sometime when I run the same code without changing anything, it
>> seems OK. Why is that?
>> Thanks.
>>
>> Best regards
>>
>> Jelita
>>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20130829/e36cb78d/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 82, Issue 49
*********************************************

0 Response to "Moses-support Digest, Vol 82, Issue 49"

Post a Comment

Subscribe to: Post Comments (Atom)