Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Fail to build and compile moses (Jeroen Vermeulen)
2. Re: Moses infinite loop (Hieu Hoang)
3. Renaming aux.m4m (Jeroen Vermeulen)
4. Re: Renaming aux.m4m (Ulrich Germann)
----------------------------------------------------------------------
Message: 1
Date: Tue, 02 Jun 2015 08:11:49 +0700
From: Jeroen Vermeulen <jtv@precisiontranslationtools.com>
Subject: Re: [Moses-support] Fail to build and compile moses
To: Hieu Hoang <hieuhoang@gmail.com>, Davood Mohammadifar
<davood_mf@hotmail.com>, moses-support <moses-support@mit.edu>
Message-ID:
<6B1B158D-F094-45D5-8BD3-1BB3B0E7BCB8@precisiontranslationtools.com>
Content-Type: text/plain; charset="utf-8"
On June 1, 2015 10:08:23 PM GMT+07:00, Hieu Hoang <hieuhoang@gmail.com> wrote:
>What is the exact version of the compiler you're using? It seems
>similar to
>this problem, so try upgrading your compiler or entire OS:
> https://github.com/shogun-toolbox/shogun/issues/2111
>
>it sounds like you have a small computer. How much memory and cores do
>you
>have? You should decrease the number of cores you use, eg.
> ./bjam -j2
>
>Hieu Hoang
>Researcher
>New York University, Abu Dhabi
>http://www.hoang.co.uk/hieu
>
>On 1 June 2015 at 18:58, Davood Mohammadifar <davood_mf@hotmail.com>
>wrote:
>
>> My OS: Linux Ubuntu 12.04 32-bit.
>>
>> One thing that i noticed in that execution:
>> Virtual memory exhausted: Cannot allocate memory
>>
>> For solving the problem, I created swap file using commands in:
>> http://www.cyberciti.biz/faq/linux-add-a-swap-file-howto/
>>
>> I deleted the old /mosesdecoder and copy "clean and fresh"
>/mosesdecoder
>> (that i backed up after executing git clone
>> https://github.com/moses-smt/mosesdecoder.git) to Home directory.
>>
>> Then I executed
>> ./bjam -j8
>>
>> At the end, number of failed targets decreased, But i faced the same
>error
>> again. The new log file has been attached.
>>
>> I don't know about doing weird by sysadmin. How can i check that?
>>
>> ------------------------------
>> Date: Mon, 1 Jun 2015 10:25:50 +0400
>> From: hieuhoang@gmail.com
>> To: moses-support@mit.edu; davood_mf@hotmail.com
>> Subject: Re: [Moses-support] Fail to build and compile moses
>>
>>
>> that's a slightly crazy compile error i've never seen before. What
>> operating system and version are you using? Is it a standard
>installation,
>> or do you know if the sysadmin did anything weird to the system?
>>
>> On 30/05/2015 17:17, Davood Mohammadifar wrote:
>>
>> Hello
>> After downloading moses (according to command git clone
>> https://github.com/moses-smt/mosesdecoder.git
>> in manualI file), I executed the following command for compiling and
>> building moses.
>> ./bjam -j8
>>
>> and got error.
>>
>> It's likely the problems are related to GCC.
>> The log file is in attachment.
>> Ubuntu Version: 12.04
>>
>> Thank you for your helping
>>
>>
>> _______________________________________________
>> Moses-support mailing
>listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>> --
>> Hieu Hoang
>> Researcher
>> New York University, Abu Dhabihttp://www.hoang.co.uk/hieu
>>
>>
>
>
>------------------------------------------------------------------------
>
>_______________________________________________
>Moses-support mailing list
>Moses-support@mit.edu
>http://mailman.mit.edu/mailman/listinfo/moses-support
By the way, if adding swap files is too much of a hassle, try Swapspace. It's a little daemon that watches if you're running low on memory and if so, automatically gets you some more swap.
(There are other tools that do the same job. I didn't like any of them and wrote Swapspace myself. It's packaged in some of the major distros.)
Jeroen
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150602/85ad0cde/attachment-0001.htm
------------------------------
Message: 2
Date: Tue, 02 Jun 2015 16:05:49 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Moses infinite loop
To: "Bc. Robert ADAMEC" <adamecr@students.zcu.cz>, moses-support
<moses-support@mit.edu>
Message-ID: <556D9C1D.8090901@gmail.com>
Content-Type: text/plain; charset=utf-8; format=flowed
please subscribe to the mailing list before posting to it. You can
subscribe here:
http://mailman.mit.edu/mailman/listinfo/moses-support
To answer your question - how do you know it is in an inifinite loop,
rather than just taking a very long time? From the moses.ini file, it
seems the phrase tables are not binarized. This will cause loading to
take a very long time and use a lot of memory. You should binarize your
phrase-table, reordering model and LM.
Also, if you are new to moses, please work through the tutorial here to
get a better understanding of what moses is doing
http://www.statmt.org/moses/?n=Moses.Baseline
On 29/05/2015 14:35, Bc. Robert ADAMEC wrote:
> Hello,
>
> I have encountered some trouble while working with Moses 3.0 optimization.
>
> When I use the configuration which you can see in the attached moses.ini the Moses tool runs infinitely long in the run 1 and is stuck on the Loading table into memory line. Do you know what could be the problem? For the "-v 100" log see the atached log.txt
>
> When I tweak some of the config options in the moses.ini file I get segfault, for example if I change the GenerationModel from current 1 -> 0 to 0,1 -> 0.
>
> The source corpus has the "word|factor" format for both used languages so there should be no problems, the factor is an int number.
>
> Can you imagine any reason why it could be behaving this way and what could have gone wrong?
>
> I launch the optimization via this command:
>
> /opt/moses-3.0/scripts/training/mert-moses.pl /root/faktor_6/corpus/heldout.src /root/faktor_6/corpus/heldout.ref \
> /opt/moses-3.0/bin/moses /root/faktor_6/experiment/model/moses.ini \
> --working-dir /root/faktor_6/tmp \
> --decoder-flags "-threads 6 -v 0" \
> --rootdir /opt/moses-3.0/scripts -mertdir /opt/moses-3.0/bin \
> --maximum-iterations 10
>
> Best regards,
>
> Robert Adamec
--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu
------------------------------
Message: 3
Date: Tue, 02 Jun 2015 19:51:39 +0700
From: Jeroen Vermeulen <jtv@precisiontranslationtools.com>
Subject: [Moses-support] Renaming aux.m4m
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <556DA6DB.8030704@precisiontranslationtools.com>
Content-Type: text/plain; charset=utf-8
Would anyone mind if I renamed aux.m4m to auxiliary.m4m, and make the
corresponding adjustments in the other makefiles? I wouldn't mind
"util.m4m" except that might look as if it were related to the util
directory.
The reason is Windows, where any filename "aux" or "aux.*" has a special
meaning, a bit like a device file on Unix. When I check out Moses on
Windows, I simply can't see the file. I've also heard of Git choking on
it when trying to work with the Moses repo on Windows.
Jeroen
------------------------------
Message: 4
Date: Tue, 2 Jun 2015 14:44:06 +0100
From: Ulrich Germann <ulrich.germann@gmail.com>
Subject: Re: [Moses-support] Renaming aux.m4m
To: Jeroen Vermeulen <jtv@precisiontranslationtools.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAHQSRUr-kLtitPx6vg5z-hYPxVyTxbtECq_jsJA=x911kmJfVw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Nope. Hardly anyone (if anyone except me) is using it anyway, and as far as
I'm concerned, it's on its way to a separate repo anyway (so that I can
clone it into an experimental directory without pulling in the whole moses
saussage. aux.m4m has no external user exposure, so it should be safe to
rename.
- Uli
On Tue, Jun 2, 2015 at 1:51 PM, Jeroen Vermeulen <
jtv@precisiontranslationtools.com> wrote:
> Would anyone mind if I renamed aux.m4m to auxiliary.m4m, and make the
> corresponding adjustments in the other makefiles? I wouldn't mind
> "util.m4m" except that might look as if it were related to the util
> directory.
>
> The reason is Windows, where any filename "aux" or "aux.*" has a special
> meaning, a bit like a device file on Unix. When I check out Moses on
> Windows, I simply can't see the file. I've also heard of Git choking on
> it when trying to work with the Moses repo on Windows.
>
>
> Jeroen
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
--
Ulrich Germann
Senior Researcher
School of Informatics
University of Edinburgh
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150602/a4e2ce8b/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 104, Issue 4
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 104, Issue 4"
Post a Comment