Moses-support Digest, Vol 98, Issue 47

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Getting OOV (Rico Sennrich)
2. An error when compiling moses (Amon Moc? Rodolphe BAZONGO)
3. bjam level of parallelism for various moses binaries
(Martin Li?ka)
4. Re: bjam level of parallelism for various moses binaries
(Prashant Mathur)
5. Re: bjam level of parallelism for various moses binaries
(Kenneth Heafield)


----------------------------------------------------------------------

Message: 1
Date: Thu, 18 Dec 2014 17:54:56 +0000 (UTC)
From: Rico Sennrich <rico.sennrich@gmx.ch>
Subject: Re: [Moses-support] Getting OOV
To: moses-support@mit.edu
Message-ID: <loom.20141218T185205-993@post.gmane.org>
Content-Type: text/plain; charset=us-ascii

Fatemeh Eskandari <fatemeh.eskandari.69@...> writes:

> I need to have list of oov words in text file, is there any way to get
them in moses?

Hi Fatemeh,

the moses option '-output-unknowns <filename>' might be what you want.

It's also possible to get the OOV words without translating the text;
there's a script in mosesdecoder/scripts/analysis/oov.pl that should do this
if you run it with the option '--verbose'.

best wishes,
Rico



------------------------------

Message: 2
Date: Fri, 19 Dec 2014 04:31:48 +0000 (UTC)
From: Amon Moc? Rodolphe BAZONGO <amonmoce@yahoo.fr>
Subject: [Moses-support] An error when compiling moses
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<1664276447.535242.1418963508501.JavaMail.yahoo@jws11102.mail.ir2.yahoo.com>

Content-Type: text/plain; charset="utf-8"

Hi. I follow the tutorial on this link http://www.statmt.org/moses_steps.html and I have an error when I run the command that compiles moses:./bjam --with-srilm=/home/.../srilm --with-irstlm=/home/.../irstlm --with-giza=/home/.../bin -j2

Thanks for support.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141219/30bd455d/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.gz
Type: application/x-gzip
Size: 2151 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141219/30bd455d/attachment-0001.bin

------------------------------

Message: 3
Date: Fri, 19 Dec 2014 13:54:09 +0100
From: Martin Li?ka <marxin.liska@gmail.com>
Subject: [Moses-support] bjam level of parallelism for various moses
binaries
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAObPJ3OPHMDbbEFrc__Td-cAOk+LKjM9EwaARRmwBLwO6p76ZQ@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

Hello.

I've been just building Moses with enabled LTO (-flto) and compilation
process runs for quite long time just in one thread:

There're are many of:

gcc.link phrase-extract/bin/gcc-5.0.0/release/debug-symbols-on/link-static/threading-multi/relax-parse
gcc.link phrase-extract/bin/gcc-5.0.0/release/debug-symbols-on/link-static/threading-multi/consolidate-reverse
phrase-extract/bin/gcc-5.0.0/release/debug-symbols-on/link-static/threading-multi/extract

...

And my question is if there are any dependencies between these
executables that potentially block parallel build?

Thanks,
Martin


------------------------------

Message: 4
Date: Fri, 19 Dec 2014 14:30:22 +0100
From: Prashant Mathur <prashant@fbk.eu>
Subject: Re: [Moses-support] bjam level of parallelism for various
moses binaries
To: Martin Li?ka <marxin.liska@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAK3pNh+GmHcz53GQCjpk2X7WVUPnX9tWerGm_ObP1yD6vvtsnA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Adding to this..
Can we have a mode for selective compilation for development purpose?
For building moses executable, we don't need these relax-parse,
consolidate-parse, extract .. and so on..

On Fri, Dec 19, 2014 at 1:54 PM, Martin Li?ka <marxin.liska@gmail.com>
wrote:

> Hello.
>
> I've been just building Moses with enabled LTO (-flto) and compilation
> process runs for quite long time just in one thread:
>
> There're are many of:
>
> gcc.link
> phrase-extract/bin/gcc-5.0.0/release/debug-symbols-on/link-static/threading-multi/relax-parse
> gcc.link
> phrase-extract/bin/gcc-5.0.0/release/debug-symbols-on/link-static/threading-multi/consolidate-reverse
>
> phrase-extract/bin/gcc-5.0.0/release/debug-symbols-on/link-static/threading-multi/extract
>
> ...
>
> And my question is if there are any dependencies between these
> executables that potentially block parallel build?
>
> Thanks,
> Martin
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141219/c2b21542/attachment-0001.htm

------------------------------

Message: 5
Date: Fri, 19 Dec 2014 08:36:00 -0500
From: Kenneth Heafield <moses@kheafield.com>
Subject: Re: [Moses-support] bjam level of parallelism for various
moses binaries
To: moses-support@mit.edu
Message-ID: <549429C0.3000105@kheafield.com>
Content-Type: text/plain; charset=windows-1252

You can run bjam and name a specific target. It's also fair to complain
that these executables draw in way more dependencies than they need,
which is slowing down compilation.

Kenneth

On 12/19/2014 08:30 AM, Prashant Mathur wrote:
> Adding to this..
> Can we have a mode for selective compilation for development purpose?
> For building moses executable, we don't need these relax-parse,
> consolidate-parse, extract .. and so on..
>
> On Fri, Dec 19, 2014 at 1:54 PM, Martin Li?ka <marxin.liska@gmail.com
> <mailto:marxin.liska@gmail.com>> wrote:
>
> Hello.
>
> I've been just building Moses with enabled LTO (-flto) and compilation
> process runs for quite long time just in one thread:
>
> There're are many of:
>
> gcc.link
> phrase-extract/bin/gcc-5.0.0/release/debug-symbols-on/link-static/threading-multi/relax-parse
> gcc.link
> phrase-extract/bin/gcc-5.0.0/release/debug-symbols-on/link-static/threading-multi/consolidate-reverse
> phrase-extract/bin/gcc-5.0.0/release/debug-symbols-on/link-static/threading-multi/extract
>
> ...
>
> And my question is if there are any dependencies between these
> executables that potentially block parallel build?
>
> Thanks,
> Martin
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 98, Issue 47
*********************************************

0 Response to "Moses-support Digest, Vol 98, Issue 47"

Post a Comment