Moses-support Digest, Vol 94, Issue 16

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. phrase table probabilities (Read, James C)
2. Re: phrase table probabilities (Maarten van Gompel)
3. xmlrpc problem (Sandipan Dandapat)


----------------------------------------------------------------------

Message: 1
Date: Wed, 13 Aug 2014 09:50:49 +0000
From: "Read, James C" <jcread@essex.ac.uk>
Subject: [Moses-support] phrase table probabilities
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<F00840E41983C645928E21E3C35F4EB101881E22D6@mbx1-node2.essex.ac.uk>
Content-Type: text/plain; charset="iso-8859-1"

Hi,

here are two example lines from my Moses training script generated bg-cs phrase table:

! ) ||| ! ) , ||| 1 0.546988 0.125 0.116138 ||| 0-0 1-1 ||| 1 8 1 |||
! ) ||| ! ) ||| 0.666667 0.546988 0.5 0.604804 ||| 0-0 1-1 ||| 6 8 4 |||

Note that the probabilities of the translation are 1 and 0.67. I thought probabilities were supposed to add up to 1?

James
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140813/874ff699/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 13 Aug 2014 12:27:27 +0200
From: Maarten van Gompel <proycon@anaproy.nl>
Subject: Re: [Moses-support] phrase table probabilities
To: moses-support@mit.edu
Message-ID: <20140813102727.18988.25889@roma.anaproy.nl>
Content-Type: text/plain; charset="utf-8"

Quoting Read, James C (2014-08-13 11:50:49)
> Hi,
>
> here are two example lines from my Moses training script generated bg-cs phrase table:
>
> ! ) ||| ! ) , ||| 1 0.546988 0.125 0.116138 ||| 0-0 1-1 ||| 1 8 1 |||
> ! ) ||| ! ) ||| 0.666667 0.546988 0.5 0.604804 ||| 0-0 1-1 ||| 6 8 4 |||
>
> Note that the probabilities of the translation are 1 and 0.67. I thought probabilities were supposed to add up to 1?

Hi James,

The first probability is P(source|target) rather than P(target|source), so my guess is "! ) ," occurs only
once in the second column, and maps to "! )" with probability 1.

The third column holds p(target|source), so that's 0.125 + 0.5 = 0.625,
which means there are probably more translation options for "! )" that
cover the remaining 0.375, adding up to one.

Regards,

--

Maarten van Gompel
Centre for Language Studies
Radboud Universiteit Nijmegen

proycon@anaproy.nl
http://proycon.anaproy.nl
http://github.com/proycon

GnuPG key: 0x1A31555C XMPP: proycon@anaproy.nl
Bitcoin: 1BRptZsKQtqRGSZ5qKbX2azbfiygHxJPsd



------------------------------

Message: 3
Date: Wed, 13 Aug 2014 14:04:30 +0100
From: Sandipan Dandapat <sandipandandapat@gmail.com>
Subject: [Moses-support] xmlrpc problem
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAGr2oZToo=o5yGsNDHrMhN26Sy7e-x_qVqR80_kmjKbCyPjqgQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,
I am using inc-giza-pp, xmlrpc-c. All of them successfully compiled and my
xmlrpc in installed in a local directory and the library files are located
in /home/sdandapat/Moses/xmlrpc-c/lib64.

Moses decoder also compiled fine with inc-giza-pp.

During building the translation model, it fails with following error:

/home/sdandapat/Moses/mosesdecoder/tools/GIZA++: error while loading shared
libraries: libxmlrpc_server_abyss++.so.8: cannot open shared object file:
No such file or directory
Exit code: 127
ERROR: Giza did not produce the output file
/home/sdandapat/Moses_retrain/EnPl/train/giza.en-pl/en-pl.Ahmm.5. Is your
corpus clean (reasonably-sized sentences)? at
/home/sdandapat/Moses/mosesdecoder/scripts/training/train-model.perl line
1199.

I am attaching the entire log. What am I doing wrong?
I found similar post in
http://blog.gmane.org/gmane.comp.nlp.moses.user/month=20111201 but could
not find the end solution.

Thanks and regards,
sandipan


--------------------------------
Sandipan Dandapat
Postdoctoral Researcher
CNGL, School of Computing
Dublin City University
Google Scholar Profile:
http://scholar.google.co.in/citations?user=DWD_FiQAAAAJ&hl=en
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140813/87a1e517/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: translation.log
Type: text/x-log
Size: 6161 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140813/87a1e517/attachment-0001.bin

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 94, Issue 16
*********************************************

Tweet