Home » Uncategories » Moses-support Digest, Vol 123, Issue 12

Moses-support Digest, Vol 123, Issue 12

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Feature name PhraseDictionaryCompact is not registered
(Hieu Hoang)
2. Re: Feature name PhraseDictionaryCompact is not registered
(Hongzheng Li)


----------------------------------------------------------------------

Message: 1
Date: Sun, 22 Jan 2017 09:00:07 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Feature name PhraseDictionaryCompact is
not registered
To: Hongzheng Li <lihongzheng1990@gmail.com>, moses-support
<moses-support@mit.edu>
Message-ID:
<CAEKMkbh3Xdggh-2WU2fGWwYdwW3gv7FCPGiW57cDWftGddJPQA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

if you successfully compiled with cmph, then Moses will have
PhraseDictionaryCompact as a phrase-table, guaranteed. This is my
compilation
./bjam -j11 --with-cmph=/home/hieu/workspace/cmph/cmph-2.0
Getting a list of available feature functions:
# ./bin/moses
.....
Available feature functions:
BleuScoreFeature ConstrainedDecoding ControlRecombination CorrectionPattern
CountNonTerms CoveredReferenceFeature DeleteRules DesegModel Distortion
DynamicCacheBasedLanguageModel EditOps Generation GlobalLexicalModel
HyperParameterAsWeight InMemoryPerSentenceOnDemandLM InputFeature KENLM
LexicalReordering MaxSpanFreeNonTermSource Model1Feature NieceTerminal
OpSequenceModel PhraseBoundaryFeature PhraseDictionaryALSuffixArray
PhraseDictionaryBinary *PhraseDictionaryCompact*
PhraseDictionaryDynamicCacheBased PhraseDictionaryFuzzyMatch
PhraseDictionaryGroup PhraseDictionaryMemory
PhraseDictionaryMemoryPerSentence PhraseDictionaryMemoryPerSentenceOnDemand
PhraseDictionaryMultiModel PhraseDictionaryMultiModelCounts
PhraseDictionaryOnDisk PhraseDictionaryScope3
PhraseDictionaryTransliteration PhraseDistanceFeature PhraseLengthFeature
PhraseOrientationFeature PhrasePairFeature PhrasePenalty ProbingPT
ReferenceComparison ReloadingLM RulePairUnlexicalizedSource RuleScope
RuleTable SetSourcePhrase SkeletonLM SkeletonPT SkeletonStatefulFF
SkeletonStatelessFF SkeletonTranslationOptionListFeature
SoftMatchingFeature SoftSourceSyntacticConstraintsFeature
SourceGHKMTreeInputMatchFeature SourceWordDeletionFeature SpanLength
SparseHieroReorderingFeature SyntaxInputWeight SyntaxRHS
TargetBigramFeature TargetConstituentAdjacencyFeature TargetNgramFeature
TargetPreferencesFeature TargetWordInsertionFeature TreeStructureFeature
UnalignedWordCountFeature UnknownWordPenalty WordPenalty
WordTranslationFeature

Have you edited the code at all? Are you sure you are using the decoder you
just compiled? Go back a retrace your steps.

ps. Please always cc the mailing list so others can join in and see the
discussion for future reference


Hieu Hoang
http://moses-smt.org/

On 22 January 2017 at 01:50, Hongzheng Li <lihongzheng1990@gmail.com> wrote:

> PS: I guess I should also attach the output log file to you, thanks!
>
> 2017-01-21 20:46 GMT-05:00 Hongzheng Li <lihongzheng1990@gmail.com>:
>
>> Hello Hieu,
>>
>> following is the command I ran for testing:
>>
>> nohup nice ~/Desktop/Moses/mosesdecoder/bin/moses -f
>> filtered-UNtestset/moses.ini < /data/rali5/Tmp/lihongzh/Moses-data/test/UNtestset.true.zh
>> > ~/Desktop/Moses/working/UNtest0121.out 2>
>> ~/Desktop/Moses/working/UNtest0121out.log
>>
>>
>> Attached are moses.ini under mert-work/ and the one under filtered
>> directory. Thank you!
>>
>> Best,
>>
>> Hongzheng Li
>>
>> 2017-01-21 18:20 GMT-05:00 Hieu Hoang <hieuhoang@gmail.com>:
>>
>>> what is the EXACT command you used to run the decoder? Can you please
>>> attach your moses.ini file so I can check it.
>>>
>>> Hieu Hoang
>>> http://moses-smt.org/
>>>
>>> On 21 January 2017 at 23:00, Hongzheng Li <lihongzheng1990@gmail.com>
>>> wrote:
>>>
>>>> Hi there:
>>>>
>>>> I'm testing the moses following the instructions on the website, but I
>>>> got the following errors:
>>>> *Exception: moses/FF/Factory.cpp:386 in void
>>>> Moses::FeatureRegistry::Construct(const string&, const string&) threw
>>>> UnknownFeatureException because `i == registry_.end()'.*
>>>> *Feature name PhraseDictionaryCompact is not registered*
>>>>
>>>> Although I have already compiled moses with cmph, I still recompiled it
>>>> again with the command:
>>>> ./bjam --with-cmph=/u/lihongzh/Desktop/Moses/cmph-2.0/
>>>> Compiling succeeded, but testing failed.
>>>> I then tried "./bjam --with-cmph=/u/lihongzh/Desktop/Moses/cmph-2.0/
>>>> -a " once again. Compiling succeeded, but testing still failed, with the
>>>> same above error.
>>>>
>>>> I'm so confused now, What should I do to solve the problem?
>>>>
>>>> Best,
>>>>
>>>> Hongzheng Li
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170122/a18d7fbb/attachment-0001.html

------------------------------

Message: 2
Date: Sun, 22 Jan 2017 10:14:16 -0500
From: Hongzheng Li <lihongzheng1990@gmail.com>
Subject: Re: [Moses-support] Feature name PhraseDictionaryCompact is
not registered
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAAjZO5b6DjfeFPaZBLHCiLP5sEXM-dDnLWwA5ar5GWXJSaC6jg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello Hieu,

I haven't changed any moses codes at all, I just followed the instructions
to build a base line system. And I'm sure I used the decoder compiled.

Following are features in ./bin/moses
BleuScoreFeature ConstrainedDecoding ControlRecombination CorrectionPattern
CountNonTerms CoveredReferenceFeature DeleteRules DesegModel Distortion
DynamicCacheBasedLanguageModel EditOps Generation GlobalLexicalModel
HyperParameterAsWeight InputFeature KENLM LexicalReordering
MaxSpanFreeNonTermSource Model1Feature NieceTerminal OpSequenceModel
PhraseBoundaryFeature PhraseDictionaryALSuffixArray PhraseDictionaryBinary
*PhraseDictionaryCompact* PhraseDictionaryDynamicCacheBased
PhraseDictionaryFuzzyMatch PhraseDictionaryGroup PhraseDictionaryMemory
PhraseDictionaryMemoryPerSentence PhraseDictionaryMemoryPerSentenceOnDemand
PhraseDictionaryMultiModel PhraseDictionaryMultiModelCounts
PhraseDictionaryOnDisk PhraseDictionaryScope3
PhraseDictionaryTransliteration PhraseDistanceFeature PhraseLengthFeature
PhraseOrientationFeature PhrasePairFeature PhrasePenalty ProbingPT
ReferenceComparison ReloadingLM RulePairUnlexicalizedSource RuleScope
RuleTable SetSourcePhrase SkeletonLM SkeletonPT SkeletonStatefulFF
SkeletonStatelessFF SkeletonTranslationOptionListFeature
SoftMatchingFeature SoftSourceSyntacticConstraintsFeature
SourceGHKMTreeInputMatchFeature SourceWordDeletionFeature SpanLength
SparseHieroReorderingFeature SyntaxInputWeight SyntaxRHS
TargetBigramFeature TargetConstituentAdjacencyFeature TargetNgramFeature
TargetPreferencesFeature TargetWordInsertionFeature TreeStructureFeature
UnalignedWordCountFeature UnknownWordPenalty WordPenalty
WordTranslationFeature

Best,

Hongzheng Li

2017-01-22 4:00 GMT-05:00 Hieu Hoang <hieuhoang@gmail.com>:

> if you successfully compiled with cmph, then Moses will have
> PhraseDictionaryCompact as a phrase-table, guaranteed. This is my
> compilation
> ./bjam -j11 --with-cmph=/home/hieu/workspace/cmph/cmph-2.0
> Getting a list of available feature functions:
> # ./bin/moses
> .....
> Available feature functions:
> BleuScoreFeature ConstrainedDecoding ControlRecombination
> CorrectionPattern CountNonTerms CoveredReferenceFeature DeleteRules
> DesegModel Distortion DynamicCacheBasedLanguageModel EditOps Generation
> GlobalLexicalModel HyperParameterAsWeight InMemoryPerSentenceOnDemandLM
> InputFeature KENLM LexicalReordering MaxSpanFreeNonTermSource Model1Feature
> NieceTerminal OpSequenceModel PhraseBoundaryFeature
> PhraseDictionaryALSuffixArray PhraseDictionaryBinary
> *PhraseDictionaryCompact* PhraseDictionaryDynamicCacheBased
> PhraseDictionaryFuzzyMatch PhraseDictionaryGroup PhraseDictionaryMemory
> PhraseDictionaryMemoryPerSentence PhraseDictionaryMemoryPerSentenceOnDemand
> PhraseDictionaryMultiModel PhraseDictionaryMultiModelCounts
> PhraseDictionaryOnDisk PhraseDictionaryScope3 PhraseDictionaryTransliteration
> PhraseDistanceFeature PhraseLengthFeature PhraseOrientationFeature
> PhrasePairFeature PhrasePenalty ProbingPT ReferenceComparison ReloadingLM
> RulePairUnlexicalizedSource RuleScope RuleTable SetSourcePhrase SkeletonLM
> SkeletonPT SkeletonStatefulFF SkeletonStatelessFF
> SkeletonTranslationOptionListFeature SoftMatchingFeature
> SoftSourceSyntacticConstraintsFeature SourceGHKMTreeInputMatchFeature
> SourceWordDeletionFeature SpanLength SparseHieroReorderingFeature
> SyntaxInputWeight SyntaxRHS TargetBigramFeature
> TargetConstituentAdjacencyFeature TargetNgramFeature
> TargetPreferencesFeature TargetWordInsertionFeature TreeStructureFeature
> UnalignedWordCountFeature UnknownWordPenalty WordPenalty
> WordTranslationFeature
>
> Have you edited the code at all? Are you sure you are using the decoder
> you just compiled? Go back a retrace your steps.
>
> ps. Please always cc the mailing list so others can join in and see the
> discussion for future reference
>
>
> Hieu Hoang
> http://moses-smt.org/
>
> On 22 January 2017 at 01:50, Hongzheng Li <lihongzheng1990@gmail.com>
> wrote:
>
>> PS: I guess I should also attach the output log file to you, thanks!
>>
>> 2017-01-21 20:46 GMT-05:00 Hongzheng Li <lihongzheng1990@gmail.com>:
>>
>>> Hello Hieu,
>>>
>>> following is the command I ran for testing:
>>>
>>> nohup nice ~/Desktop/Moses/mosesdecoder/bin/moses -f
>>> filtered-UNtestset/moses.ini < /data/rali5/Tmp/lihongzh/Moses-data/test/UNtestset.true.zh
>>> > ~/Desktop/Moses/working/UNtest0121.out 2>
>>> ~/Desktop/Moses/working/UNtest0121out.log
>>>
>>>
>>> Attached are moses.ini under mert-work/ and the one under filtered
>>> directory. Thank you!
>>>
>>> Best,
>>>
>>> Hongzheng Li
>>>
>>> 2017-01-21 18:20 GMT-05:00 Hieu Hoang <hieuhoang@gmail.com>:
>>>
>>>> what is the EXACT command you used to run the decoder? Can you please
>>>> attach your moses.ini file so I can check it.
>>>>
>>>> Hieu Hoang
>>>> http://moses-smt.org/
>>>>
>>>> On 21 January 2017 at 23:00, Hongzheng Li <lihongzheng1990@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi there:
>>>>>
>>>>> I'm testing the moses following the instructions on the website, but I
>>>>> got the following errors:
>>>>> *Exception: moses/FF/Factory.cpp:386 in void
>>>>> Moses::FeatureRegistry::Construct(const string&, const string&) threw
>>>>> UnknownFeatureException because `i == registry_.end()'.*
>>>>> *Feature name PhraseDictionaryCompact is not registered*
>>>>>
>>>>> Although I have already compiled moses with cmph, I still recompiled
>>>>> it again with the command:
>>>>> ./bjam --with-cmph=/u/lihongzh/Desktop/Moses/cmph-2.0/
>>>>> Compiling succeeded, but testing failed.
>>>>> I then tried "./bjam --with-cmph=/u/lihongzh/Desktop/Moses/cmph-2.0/
>>>>> -a " once again. Compiling succeeded, but testing still failed, with the
>>>>> same above error.
>>>>>
>>>>> I'm so confused now, What should I do to solve the problem?
>>>>>
>>>>> Best,
>>>>>
>>>>> Hongzheng Li
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170122/17657dd6/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 123, Issue 12
**********************************************

0 Response to "Moses-support Digest, Vol 123, Issue 12"

Post a Comment

Subscribe to: Post Comments (Atom)