Moses-support Digest, Vol 85, Issue 40

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Estimating probabilities with KenLM (Prasanth K)
2. Re: Segfault when using sigtest-filtering for hierarchical mt
(Hieu Hoang)
3. Re: Moses-support Digest, Vol 85, Issue 39 (khchen)
4. Re: default beam size (Lane Schwartz)


----------------------------------------------------------------------

Message: 1
Date: Mon, 25 Nov 2013 07:40:01 +0100
From: Prasanth K <prasanthk.ms09@gmail.com>
Subject: Re: [Moses-support] Estimating probabilities with KenLM
To: Kenneth Heafield <moses@kheafield.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CA+n+9-iBmekuq_0H82C0G7=Ap9ZwS_F0x4do8eW_ao40LJSoKA@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi Kenneth,

Thanks for the clarification w.r.t. calculating the memory size. But I am
running these on a Mac (10.9 Mavericks). Do you think I should still port
the lmplz code to Mac for the estimation of probabilities?

One thing though, I did change the default clang compiler that comes with
this new Mac to a gcc-4.8 (not sure that changes anything in this context).

- Prasanth




On Fri, Nov 22, 2013 at 6:50 PM, Kenneth Heafield <moses@kheafield.com>wrote:

> Hi,
>
> What OS are you on? Cygwin? Apparently every OS reports memory
> size
> in a different way:
>
>
> http://git.savannah.gnu.org/gitweb/?p=gnulib.git;a=blob;f=lib/physmem.c;h=2629936146e3042f927523322f18aca76996cd7f;hb=HEAD
>
> The good news is that the above code is LGPLv2:
>
>
> http://git.savannah.gnu.org/gitweb/?p=gnulib.git;a=blob;f=modules/physmem;h=9644522e0493a85a9fb4ae7c4449741c2c1500ea;hb=HEAD
>
> But currently I'm just using this short function that will fail on some
> platforms:
>
> uint64_t GuessPhysicalMemory() {
> #if defined(_WIN32) || defined(_WIN64)
> return 0;
> #elif defined(_SC_PHYS_PAGES) && defined(_SC_PAGESIZE)
> long pages = sysconf(_SC_PHYS_PAGES);
> if (pages == -1) return 0;
> long page_size = sysconf(_SC_PAGESIZE);
> if (page_size == -1) return 0;
> return static_cast<uint64_t>(pages) * static_cast<uint64_t>(page_size);
> #else
> return 0;
>

Tweet