Moses-support Digest, Vol 84, Issue 40

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Running moses fills up hard disk space.. (Tom Hoar)
2. Re: getting WER metrics (Philipp Koehn)
3. Re: getting WER metrics (Francis Tyers)


----------------------------------------------------------------------

Message: 1
Date: Mon, 28 Oct 2013 18:43:40 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] Running moses fills up hard disk space..
To: moses-support@mit.edu
Message-ID: <526E4DEC.3040105@precisiontranslationtools.com>
Content-Type: text/plain; charset="iso-8859-1"

Your description is a bit unclear. Are you talking about running the
Moses binary? Running Moses with binarized phrase table, reordering
table and language model (or hierarchical equivalent) -- and configuring
the moses.ini file to use them -- should not consume any additional hard
disk space. So, what exactly did you binarize and what are you running?

If you're talking about running train-model.perl or mert-moses.pl, these
two scripts can consume considerable hard drive space while they do
their work. It's not uncommon to consume 100-200 GB of hard drive space
if you have a large, complex corpus.



On 10/28/2013 10:09 AM, Andrew Shin wrote:
> Hello,
>
>
> I'm running Moses after binarising it,
> and while it's reading from phrase table,
> it rapidly fills up hard disk space until there is no more space..
> I had 21GB and it wasn't enough..
> Once I quit terminal, the space is freed again..
> I successfully ran Moses before, so I don't understand why this happens..
> Is this natural? If so, how much reserve space do I need?
> and If not, what could have gone wrong?
>
> Thank you very much for your help in advance.
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131028/bfa421c5/attachment-0001.htm

------------------------------

Message: 2
Date: Mon, 28 Oct 2013 11:33:13 -0400
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] getting WER metrics
To: Andrew Shin <ravenyj@hotmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDDrHbWW0DNd9by2MgMsK5SuAxLf3sXQZ=zYvpKCjz5DYA@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1

Hi,

Moses currently does not include a tool to measure WER.
It should be simple to write, so I would encourage you to
implement it and contribute it back.

-phi

On Sun, Oct 27, 2013 at 11:11 PM, Andrew Shin <ravenyj@hotmail.com> wrote:
> Hello,
> sorry to ask another question..
>
> I've done getting BLEU score in the past following the baseline tutorial,
> but is there a way to also get WER given a reference text?
>
> Thank you very much for your help.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

Message: 3
Date: Mon, 28 Oct 2013 15:37:12 +0000
From: Francis Tyers <ftyers@prompsit.com>
Subject: Re: [Moses-support] getting WER metrics
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <1382974632.8730.7.camel@eki.dlsi.ua.es>
Content-Type: text/plain; charset="UTF-8"

There is a package in Apertium which is a simple perl script which
calculates WER and PER:

https://svn.code.sf.net/p/apertium/svn/trunk/apertium-eval-translator

http://wiki.apertium.org/wiki/Evaluation#Using_apertium-eval-translator_for_WER_and_PER

Fran

El dl 28 de 10 de 2013 a les 11:33 -0400, en/na Philipp Koehn va
escriure:
> Hi,
>
> Moses currently does not include a tool to measure WER.
> It should be simple to write, so I would encourage you to
> implement it and contribute it back.
>
> -phi
>
> On Sun, Oct 27, 2013 at 11:11 PM, Andrew Shin <ravenyj@hotmail.com> wrote:
> > Hello,
> > sorry to ask another question..
> >
> > I've done getting BLEU score in the past following the baseline tutorial,
> > but is there a way to also get WER given a reference text?
> >
> > Thank you very much for your help.
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support





------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 84, Issue 40
*********************************************

Tweet