Moses-support Digest, Vol 113, Issue 6

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Problem with bjam (Hieu Hoang)
2. Re: Problem building Moses on fedora 20 (Hieu Hoang)
3. Re: bleu-annotation / analysis.perl (Philipp Koehn)
4. Re: In-domain dictionary - where to include it (Philipp Koehn)


----------------------------------------------------------------------

Message: 1
Date: Fri, 4 Mar 2016 20:47:33 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Problem with bjam
To: Despina Mouratidi <dmouratidi@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbjTNkjxD9ppQ78EMKfebFV-D23Coj3OiwAQHopViROJ3w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

There doesn't seem to be an error. It's not building the server 'cos the
xmlrpc-c library was not found.

You don't need the server unless you want to deploy moses as a service

Hieu Hoang
http://www.hoang.co.uk/hieu

On 4 March 2016 at 11:29, Despina Mouratidi <dmouratidi@gmail.com> wrote:

> Hello everyone,
> I am trying to install Moses on Ubuntu 14 (i have
> studied the instructions of the site (statmt.org) about Moses). I
> installed boost and then I wrote ./bjam but it showed like this
> (bjam.png). What can i do?
>
> Thanks in advance!
> Despina
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160304/75383be8/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 4 Mar 2016 20:48:19 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Problem building Moses on fedora 20
To: Mai Uy?n ??ng <uyendm@viegrid.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbhjMkOuQ-nsX3nv+g-ghwbJq-8GZcacC_d-d=xADB0k-Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

is the file in empty?

Hieu Hoang
http://www.hoang.co.uk/hieu

On 4 March 2016 at 07:42, Mai Uy?n ??ng <uyendm@viegrid.com> wrote:

> Hello guys,
> I have successfully built Moses on Fedora 20 (32 bit) by following the
> guide on this page: http://www.statmt.org/moses/?n=Development.GetStarted
> However, in the "Run Moses for the first time" part, I run this:
>
> cd ~/mosesdecoder/sample-models
> ~/mosesdecoder/bin/moses -f phrase-model/moses.ini < phrase-model/in > out
>
> Nothing happened and the file out is empty. I don't know what's wrong
>
> Pls help.
>
> Thanks in advance
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160304/1ff79c1b/attachment-0001.html

------------------------------

Message: 3
Date: Fri, 4 Mar 2016 15:59:43 -0500
From: Philipp Koehn <phi@jhu.edu>
Subject: Re: [Moses-support] bleu-annotation / analysis.perl
To: Vincent Nguyen <vnguyen@neuf.fr>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDAkgpCz_nGCZxSXDSQx7b3+pcg6UTqWmEvZJdg1o_r5dg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

this BLEU calculation happens in the function bleu_annotation in lines
224ff in scripts/ems/support/analysis.perl

You could convert the system translation $system and the reference
translations to $REFERENCE[$i] to lowercase (lc) if you prefer that.

The code suggests that n-gram precision for sentences of length < n is
treated as 100% - which may be not what you want, but it is a degenerate
case, so treating it is a bit undefined.

-phi

On Sat, Feb 27, 2016 at 6:20 AM, <vnguyen@neuf.fr> wrote:

> Ok obviously this is a modified bleu+ algorithm, similar to what
> sentence-bleu does.
> However I believe this is still not right for unigram sentences.
>
>
>
> ____________________
>
> De : "Vincent Nguyen"
> Date : 26 f?vr. 2016 22:21:59
> A : moses-support@mit.edu
>
> Sujet : Re: [Moses-support] bleu-annotation / analysis.perl
>
>
>
> Am I correct saying that when sentences length is less or equal to 4
> tokens then the BLEU score should be 1 for exact matches and 0 when not
> exact match ?
> (by definition of http://www1.cs.columbia.edu/nlp/sgd/bleu.pdf)
>
>
> Le 26/02/2016 10:02, Vincent Nguyen a ?crit :
> > Hi,
> >
> > I would like to understand better the analysis.perl script that
> > generates the bleu-annotation file.
> >
> > Is there an easy way to get the uncased bleu score of each line instead
> > of the cased calculation ?
> > Am I right that this script recompute its own Bleu score without calling
> > the Nist-Bleu nor Multi-Bleu external scripts ?
> >
> >
> > Also I find it strange sometimes when there is only one or two words :
> >
> > Translation / reference / score
> > Contents / Content / 0.8409
> > Ireland / Irish / 0.8409
> > Issuer / Italie / 0.8409
> > PT / US / 0.8409
> > .....
> > and so on, two words, unrelated will always generate similar 0.8409
> scores.
> >
> > for 2-grams
> > Very strong / Very high / 0.7598
> > Public sector / Public Sector / 0.7598
> > However : / But : / 0.7598
> >
> > so, for 2-grams, when one word only is good it will generate a score of
> > 0.7598
> >
> >
> > Thanks,
> >
> > Vincent
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160304/af84073c/attachment-0001.html

------------------------------

Message: 4
Date: Fri, 4 Mar 2016 17:03:05 -0500
From: Philipp Koehn <phi@jhu.edu>
Subject: Re: [Moses-support] In-domain dictionary - where to include
it
To: Joze Kadivec <joze.kadivec@zop-cr.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDDt0C-wv+nE_bp_QWLOOkP+ExHZaYDF01Ym9RiGsOZ3yA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

the most straight-forward way is to add it to the phrase table.

You could add it multiple times, if you want it to be given more weight
than the regular parallel corpus.

-phi

On Tue, Feb 23, 2016 at 3:10 PM, Joze Kadivec <joze.kadivec@zop-cr.com>
wrote:

> Hello,
>
> I just recently installed Moses and would like to use it as part of my
> masters thesis on Domain adaptation for less-resourced Slovenian language.
> I
> was given some domain specific dictionaries for which I need your advice.
> Where should I include it? Should I simply paste their contents to the end
> of aligned corpora files used to create translation model? Is there another
> way to use the dictionaries more efficiently?
>
> Thank you.
>
> Kind regards,
> Jo?e Kadivec
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160304/b73b5f6b/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 6
*********************************************

Tweet