Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Fwd: moses help (Hieu Hoang)
2. Re: differences between moses and moses2 output (Vito Mandorino)
----------------------------------------------------------------------
Message: 1
Date: Wed, 28 Sep 2016 11:09:32 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: [Moses-support] Fwd: moses help
To: gaojin35@mail.ustc.edu.cn, moses-support <moses-support@mit.edu>
Message-ID: <4f076a83-64fd-1f9b-83ad-94225d42dbf2@gmail.com>
Content-Type: text/plain; charset="utf-8"
Please subscribe to the Moses mailing list before posting to it. You can
subscribe here:
http://mailman.mit.edu/mailman/listinfo/moses-support
To answer your question, you must compile moses with the flag
./bjam --with-cmph=[wherever the cmph library is]
This will add the PhraseDictionaryCompact to Moses
-------- Forwarded Message --------
Subject: moses help
Date: Tue, 27 Sep 2016 14:56:30 +0800
From: gaojin35 <gaojin35@mail.ustc.edu.cn>
To: moses-support <moses-support@mit.edu>
Look forward to hearing from you ! Thanks!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160928/5eba3329/attachment-0001.html
-------------- next part --------------
Hello,
I've been following the Moses manual to create a Baseline System but I am
now stuck at the Testing section. I get this strange message as i tried to
run moses.ini. Appreciate any help thanks.
gaojin@gaojin-Dell-System-Inspiron-M4110:~/working$ ~/mosesdecoder/bin/moses -f ~/working/binarised-model/moses.ini
Defined parameters (per moses.ini or switch):
config: /home/gaojin/working/binarised-model/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryCompact name=TranslationModel0 num-features=4 home/gaojin/working/binarised-model/phrase-table.minphr input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0 num-features=6 type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0 home/gaojin/working/binarised-model/reordering-table.minlexr Distortion KENLM name=LM0 factor=0 path=/home/gaojin/lm/news-commentary-v8.fr-en.blm.en order=3
input-factors: 0
mapping: 0 T 0
threads: 4
weight: LexicalReordering0= 0.208594 0.0638358 0.0566092 0.0204888 0.034497 0.019643 Distortion0= 0.0558739 LM0= 0.0997565 WordPenalty0= 0.118491 PhrasePenalty0= 0.179373 TranslationModel0= 0.045094 0.0446332 0.038174 -0.0149363 UnknownWordPenalty0= 1
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryCompact name=TranslationModel0 num-features=4 home/gaojin/working/binarised-model/phrase-table.minphr input-factor=0 output-factor=0
Exception: moses/FF/Factory.cpp:384 in void Moses::FeatureRegistry::Construct(const string&, const string&) threw UnknownFeatureException because `i == registry_.end()'.
Feature name PhraseDictionaryCompact is not registered.
------------------------------
Message: 2
Date: Wed, 28 Sep 2016 15:22:46 +0200
From: Vito Mandorino <vito.mandorino@linguacustodia.com>
Subject: Re: [Moses-support] differences between moses and moses2
output
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CA+8mSmF7vEuqgRes7rnD3-nW0HzQRzMB64=Tng=4FOY+STZZnw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
We are able to replicate the issue with the probingPT version of this
phrase-table:
' ||| ' ||| 1 1 1 1 ||| 0-0 ||| 1 1 1 ||| |||
& ||| & ||| 1 1 1 1 ||| 0-0 ||| 1 1 1 ||| |||
> ||| > ||| 1 1 1 1 ||| 0-0 ||| 1 1 1 ||| |||
< ||| < ||| 1 1 1 1 ||| 0-0 ||| 1 1 1 ||| |||
" ||| " ||| 1 1 1 1 ||| 0-0 ||| 1 1 1 ||| |||
||| ||| 1 1 1 1 ||| 0-0 ||| 1 1 1 ||| |||
  |||   ||| 1 1 1 1 ||| 0-0 ||| 1 1 1 ||| |||
If we understand well, the origin of the issue is in the function
strconv_escape in ./contrib/moses2/pugixml.cpp which replaces some of
these entities with the actual symbol. Commenting out that part seems to
fix the problem, but we wonder if this may cause any issues elsewhere since
we don't know the purpose of the entity replacement.
Best regards,
Vito
2016-09-28 11:19 GMT+02:00 Hieu Hoang <hieuhoang@gmail.com>:
> Can you make your model files available for download?
>
> Moses and Moses2 aren't guaranteed to give exactly the same answer.
> However, they should be the same quality overall
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 28 September 2016 at 09:53, Vito Mandorino <vito.mandorino@
> linguacustodia.com> wrote:
>
>> Hi,
>>
>> we are testing moses2 and we find a decrease in quality which seems to be
>> related to apostrophes. For instance:
>>
>> Source segment 1:
>> mise ? disposition des actionnaires des documents d' information
>> relatifs ? la sicav
>>
>> MT Moses:
>> provision shareholders of the briefing material for the sicav
>>
>> MT Moses2:
>> provision of shareholders documents d' information concerning the fund
>>
>>
>> Source segment 2:
>> tout titre qui deviendrait sp?culatif ? la suite d' une
>> r?trogradation apr?s son acquisition par le fonds ne sera pas liquid? , ?
>> moins que le conseiller en investissement n' estime qu' il y va
>> de l' int?r?t des actionnaires .
>>
>> MT Moses:
>> any security that would become speculative following a downgrading after
>> its takeover by the fund will not be liquidated , unless the investment
>> adviser believes it is in the interest of shareholders .
>>
>> MT Moses2:
>> any security that would become speculative following a possible downgrade
>> d' by the fund after its acquisition will not be liquidated , unless the
>> investment advisor believes n' stake qu' l' interest of shareholders .
>>
>> It is actually strange that the raw MT output contains the apostrophe
>> symbol instead of the ' entity . What could the reason be?
>>
>> Best regards,
>> Vito
>>
>>
>> --
>> *M**. Vito MANDORINO -- Chief Scientist*
>>
>>
>> [image: Description : Description : lingua_custodia_final full logo]
>>
>> *The Translation Trustee*
>>
>> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
>>
>> *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89
>> <%2B33%206%2084%2065%2068%2089>*
>>
>> *Email :* *vito.mandorino@linguacustodia.com
>> <massinissa.ahmim@linguacustodia.com>*
>>
>> *Website :*
>> *www.linguacustodia.finance <http://www.linguacustodia.com/>*
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
--
*M**. Vito MANDORINO -- Chief Scientist*
[image: Description : Description : lingua_custodia_final full logo]
*The Translation Trustee*
*1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux*
*Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89*
*Email :* *vito.mandorino@linguacustodia.com
<massinissa.ahmim@linguacustodia.com>*
*Website :*
*www.linguacustodia.finance <http://www.linguacustodia.com/>*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160928/ebc060ef/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20160928/ebc060ef/attachment.jpg
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 119, Issue 40
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 119, Issue 40"
Post a Comment