Moses-support Digest, Vol 106, Issue 21

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: how much disk sapce for the Giga fr-en corpus ? (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Sat, 8 Aug 2015 14:06:14 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] how much disk sapce for the Giga fr-en
corpus ?
To: Vincent Nguyen <vnguyen@neuf.fr>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbgHRDMKV0xic-Jv_NBh5gWTg-BoUCtXmRYiOwOWyLr=mA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

i don't think anyone's measured it. If you have any measurements, perhaps
you can let us know.

if you have a fairly recent version of unix sort, you can also add
[TRAINING]
training-options = "-sort-compress gzip"
to reduce disk space requirement.

however, i would say you need PLENTY of space. If you just have enough to
do extraction and no more, you're gonna have a hard time doing the rest of
the experiments.


Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu

On 8 August 2015 at 13:55, Vincent Nguyen <vnguyen@neuf.fr> wrote:

> Hi,
> I keep adding 100GB on my space, even at 400GB it crashed at sorting
> time after the extract tables....
> now trying 500GB
> Will I need more ?
> is there a rule ?
> cheers,
> Vincent
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150808/26c46081/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 106, Issue 21
**********************************************

Tweet