Moses-support Digest, Vol 100, Issue 76

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Moses with SRILM Compile Error (TinTin Kalaw)
2. kenlm Using slower read() instead of mmap() (koormoosh)
3. Re: kenlm Using slower read() instead of mmap() (Jon D.)


----------------------------------------------------------------------

Message: 1
Date: Mon, 23 Feb 2015 11:28:16 +0800
From: TinTin Kalaw <tintin.kalaw@gmail.com>
Subject: Re: [Moses-support] Moses with SRILM Compile Error
To: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Cc: moses-support@mit.edu
Message-ID:
<CAPSQ0ofVZXpF9GX2vvo7ZivSKZpjKt33H719g-vy4ri=-ocy_A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello,

Attached here is the *build.log.gz* after conducting the clean build. The
command I used was *./bjam --with-boost=/usr/local --with-srilm=$SRILM*.

Thanks.

Regards,



*Kristine Ma. Dominique F. KalawContact No.: 0927.854.4201Email:
tintin.kalaw@gmail.com <tintin.kalaw@gmail.com>*

On Mon, Feb 23, 2015 at 5:32 AM, Barry Haddow <bhaddow@staffmail.ed.ac.uk>
wrote:

> Hi TinTin
>
> First, make sure you do a clean build, and that you're absolutely sure
> Moses is linking against SRILM V1.6. If the build still fails, then post
> your log to the list,
>
> cheers - Barry
>
> Quoting TinTin Kalaw <tintin.kalaw@gmail.com> on Sun, 22 Feb 2015
> 22:48:03 +0800:
>
> It is because this other tool that I need (a thesis project of an
>> upperclassmen) was made with SRILM. To run their project, SRILM must work.
>>
>> I used an older version of SRILM (v1.6.0). The build still failed.
>>
>> Thank you for your fast reply.
>>
>> Regards,
>>
>>
>>
>> *Kristine Ma. Dominique F. KalawContact No.: 0927.854.4201Email:
>> tintin.kalaw@gmail.com <tintin.kalaw@gmail.com>*
>>
>> On Sun, Feb 22, 2015 at 5:30 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>
>> use a older version of SRILM.
>>>
>>> Can I ask why you use SRILM in more detail? Do you use it to create
>>> language models, or within the decoder to look up LM scores? In both
>>> cases,
>>> there are now better tools to use than SRILM
>>>
>>>
>>> On 22/02/15 07:22, TinTin Kalaw wrote:
>>>
>>> Good day!
>>>
>>> Whenever I try to compile Moses with the *--with-srilm=/my/path/to/
>>> srilm*,
>>> I get a compilation error. If I compile it with the
>>> *--with-boost=/my/path/to/boost* or with just *./bjam*, it is a success.
>>> Unfortunately I cannot use an alternative to SRILM because this other
>>> tool
>>> that I am using makes use of SRILM and Moses.
>>>
>>> I have already successfully installed/compiled the other
>>> tools/packages/dependencies that Moses needs. My machine is running on a
>>> dual-boot OS of *Windows 8.1* and *Ubuntu 14.04 LTS 64-bit*. I am
>>> currently using Ubuntu. I used *Giza v1.0.7*, *SRILM v1.7.1*, *Boost
>>> 1_57_0*, and the version of *Moses* as of Feb 7 2015.
>>>
>>> Attached here is the *build.log.gz* of the command *./bjam
>>> --with-srilm=$SRILM*.
>>>
>>> I am hoping for your swift response regarding this issue. Thank you.
>>>
>>> --
>>> Regards,
>>>
>>>
>>>
>>> *Kristine Ma. Dominique F. Kalaw Contact No.: 0927.854.4201 Email:
>>> tintin.kalaw@gmail.com <tintin.kalaw@gmail.com>*
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing listMoses-support@mit.eduhttp://
>>> mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>> --
>>> Hieu Hoang
>>> Research Associate (until March 2015)
>>> ** searching for interesting commercial MT position **
>>> University of Edinburghhttp://www.hoang.co.uk/hieu
>>>
>>>
>>>
>>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150223/8b9c1518/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.gz
Type: application/x-gzip
Size: 6880 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150223/8b9c1518/attachment-0001.bin

------------------------------

Message: 2
Date: Mon, 23 Feb 2015 23:34:29 +1100
From: koormoosh <koormoosh@gmail.com>
Subject: [Moses-support] kenlm Using slower read() instead of mmap()
To: moses-support@mit.edu
Message-ID:
<CAN3_CDjsP+G7L0qAaAqMz7W9FQRC5V778_U7mm0AmWZ+bDXM1A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

I am doing some experiment with KenLM over a few GBs of text:

bin/lmplz -o 2 training.data training.arpa

It somehow gives the following message and gets stuck

=== 1/5 Counting and sorting n-grams ===
File /dev/pts/1 isn't normal. Using slower read() instead of mmap(). No
progress bar.

What does it mean by /dev/pts/1 not being normal and why is it actually
looking at that directory?

Thanks,
Koorm
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150223/76738133/attachment-0001.htm

------------------------------

Message: 3
Date: Mon, 23 Feb 2015 13:51:12 +0100
From: "Jon D." <jonsafari@gmail.com>
Subject: Re: [Moses-support] kenlm Using slower read() instead of
mmap()
To: koormoosh <koormoosh@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CA+Y6dkcx535nFOQ4zLsLvLxjxD6nZswvTkdA+pX2vaxYhchf2A@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

Hi Koormoosh,
lmplz is looking for training data from stdin instead of a normal
file. Make sure the command-line argument structure is correct.
lmplz prints out the arpa file to stdout, so redirect it as:
bin/lmplz -o 2 training.data > training.arpa

or alternatively:
bin/lmplz -o 2 < training.data > training.arpa

Best,
-Jon


On Mon, Feb 23, 2015 at 1:34 PM, koormoosh <koormoosh@gmail.com> wrote:
> I am doing some experiment with KenLM over a few GBs of text:
>
> bin/lmplz -o 2 training.data training.arpa
>
> It somehow gives the following message and gets stuck
>
> === 1/5 Counting and sorting n-grams ===
> File /dev/pts/1 isn't normal. Using slower read() instead of mmap(). No
> progress bar.
>
> What does it mean by /dev/pts/1 not being normal and why is it actually
> looking at that directory?
>
> Thanks,
> Koorm
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>

On Mon, Feb 23, 2015 at 1:34 PM, koormoosh <koormoosh@gmail.com> wrote:
> I am doing some experiment with KenLM over a few GBs of text:
>
> bin/lmplz -o 2 training.data training.arpa
>
> It somehow gives the following message and gets stuck
>
> === 1/5 Counting and sorting n-grams ===
> File /dev/pts/1 isn't normal. Using slower read() instead of mmap(). No
> progress bar.
>
> What does it mean by /dev/pts/1 not being normal and why is it actually
> looking at that directory?
>
> Thanks,
> Koorm
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 100, Issue 76
**********************************************

Tweet