Moses-support Digest, Vol 90, Issue 15

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. problem compiling Moses (Mac OS X 10.9.2) (kamel nebhi)
2. Re: how to integrate a long-span LM into moses (David Mrva)
3. English to French Translations are different by GUI and
command line (Steven)


----------------------------------------------------------------------

Message: 1
Date: Fri, 4 Apr 2014 15:51:01 +0100
From: kamel nebhi <k.nebhi@sheffield.ac.uk>
Subject: [Moses-support] problem compiling Moses (Mac OS X 10.9.2)
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAG66Y3c5a_CB0Zj-Ttq6=ft-4bEjCRhEVN5yCxmzmawjdx0DDw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

I have some problem to make Moses works with MacPorts installed versions of
Boost and g++.

I have executed this command line: ./bjam --with-macports=/opt/local/ -j8

In attachment you'll find the build.log.

Thanks for your help
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140404/69757c1f/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.gz
Type: application/x-gzip
Size: 233 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140404/69757c1f/attachment-0001.bin

------------------------------

Message: 2
Date: Fri, 04 Apr 2014 16:14:00 +0100
From: David Mrva <davidm@cantabresearch.com>
Subject: Re: [Moses-support] how to integrate a long-span LM into
moses
To: moses-support@mit.edu
Message-ID: <533ECC38.4070706@cantabresearch.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed


>> end of the hypothesis.
> Your LM state is dependent on the entire target phrase? ie. these
> target phrases have difference states:
> a b c d e f g h i j
> z b c d e f g h i j
> This would probably negatively impact search as the stacks will have
> to be pruned more often, leading to search errors.
>
> I think this is also the experience of people trying to add syntactic
> LM to SMT decoders

Hi Hieu,

How does moses use the LM state? If I used the same state for both
phrases in your example and different LM scores, would moses keep both
hypotheses in its search space immediately after appending your two
phrases or would it discard one of them? Is this behaviour dependant on
the choice of the search-algorithm?

David

>> And when a hypothesis is being extended, its LM
>> state is extended by one target word at a time in a loop over the new
>> phrase from start to finish. Ngram LM implementation does not work in
>> this way and it seems to harm ngram performance. Can anyone shed some
>> light on the motivation behind the behaviour described above in
>> points 1-3?
>>
>> I used moses with its default, a.k.a. "normal", search algorithm (no
>> [search-algorithm] variable specified in my config). For completeness,
>> my config when using moses with its Kenlm class is pasted below.
>>
>> Best regards,
>> David
>>
>>
>> # input factors
>> [input-factors]
>> 0
>>
>> # mapping steps
>> [mapping]
>> 0 T 0
>>
>> [distortion-limit]
>> 6
>>
>> # feature functions
>> [feature]
>> UnknownWordPenalty
>> WordPenalty
>> PhrasePenalty
>> PhraseDictionaryMemory name=TranslationModel0 table-limit=20
>> num-features=4 path=model/phrase-table.1.gz input-factor=0
>> output-factor=0
>> LexicalReordering name=LexicalReordering0 num-features=6
>> type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
>> path=model/reordering-table.1.wbe-msd-bidirectional-fe.gz
>> Distortion
>> KENLM lazyken=1 name=LM0 factor=0 path=lm/europarl.binlm.1 order=5
>>
>> # dense weights for feature functions
>> [weight]
>> UnknownWordPenalty0= 1
>> WordPenalty0= -1
>> PhrasePenalty0= 0.2
>> TranslationModel0= 0.2 0.2 0.2 0.2
>> LexicalReordering0= 0.3 0.3 0.3 0.3 0.3 0.3
>> Distortion0= 0.3
>> LM0= 0.5
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>



------------------------------

Message: 3
Date: Fri, 4 Apr 2014 11:37:01 -0400
From: "Steven" <steven.xu@lba.ca>
Subject: [Moses-support] English to French Translations are different
by GUI and command line
To: <moses-support@mit.edu>
Message-ID: <030101cf501b$b9437a60$2bca6f20$@xu@lba.ca>
Content-Type: text/plain; charset="iso-8859-1"

Hi, All,
I am running Moses on Windows 7. I installed the Release 2.1 build by
Capita TI: Release 2.1 MSI Installer with GUI for Windows 32bit (Maximum
6-gram LM).

I translated same English Text into French through GUI and command line.
I don?t understand where I get different translations since everything is
same for Moses.

Those translations are consistent among multiple runs by GUI or command
line.

1) Original English Text:
The whole purpose of these Wikies is to encourage the sharing of knowledge
within the organization. Everyone can and should contribute content,
corrections or comments. If we all contribute, then with time and little
effort, we will have developped a pretty good documentation database that
should help us all.

2) Translated through GUI:
Le but de ces Wikies est d'encourager le partage des connaissances au sein
de l'organisation. Tout le monde peut et doit contribuer contenu, de
corrections - ou d'observations. Si nous tous contribuer, avec peu de temps
et d'efforts, nous aurons une tr?s bonne base de donn?es developped
documents qui devrait nous aider ? tous.

3) Translated though command line ( Command:
C:\Users\steven.xu\mosesgui\Model_2014-03-21_153233\model>moses-cmd -f
moses.ini )
L' ensemble de ces Wikies objectif est d' encourager le partage des
connaissances dans le organization. Toute personne peut et doit contribuer
content, corrections ou comments. Si nous tous contribute, ensuite avec le
temps et peu effort, nous aurons une tr?s bonne base de donn?es developped
documents qui devrait nous aider nos


Thanks.

Steven.








------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 90, Issue 15
*********************************************

Tweet