Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Segfault from moses while tuning (Per Starb?ck )
2. Re: EMS fails with Transliteration option (Hieu Hoang)
3. Re: Segfault from moses while tuning (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Wed, 17 May 2017 11:18:12 +0200
From: starback@stp.lingfil.uu.se (Per Starb?ck )
Subject: [Moses-support] Segfault from moses while tuning
To: moses-support@mit.edu
Message-ID: <sa5r2znyh7v.fsf@numerus.lingfil.uu.se>
Content-Type: text/plain
Hi! When following the examples at
http://www.statmt.org/moses/?n=Moses.Baseline I get a segmentation faul.
I wonder what the problem is.
I use the prebuilt binaries at
http://www.statmt.org/moses/RELEASE-3.0/binaries/linux-64bit/linux-64bit.tgz
(on a Centos 7 system) and it's during the Tuning step, when I run
training/mert-moses.pl I get an error. The command was:
.../scripts/training/mert-moses.pl ../corpus/news-test2008.tc.de
../corpus/news-test2008.tc.en .../moses/bin/moses
train/model/moses.ini --mertdir .../moses/bin/ &> mert.out
(with some absolute paths here replaced with "...")
That script is running
.../moses -config filtered/moses.ini -weight-overwrite 'PhrasePenalty0= 0.043478 WordPenalty0= -0.217391 TranslationModel0= 0.043478 0.043478 0.043478 0.043478 Distortion0= 0.065217 LM0= 0.108696 LexicalReordering0= 0.065217 0.065217 0.065217 0.065217 0.065217 0.065217' -n-best-list run1.best100.out 100 distinct -input-file .../corpus/news-test2008.tc.de > run1.out
which segfaults. When run under debugger I get the following backtrace:
======================================================================
(gdb) bt
#0 0x0000000000597a99 in Moses::TargetPhrase::SetAlignmentInfo (this=this@entry=0xcf92040, alignString=...) at moses/TargetPhrase.cpp:194
#1 0x000000000060813c in Moses::RuleTableLoaderStandard::Load (input=std::vector of length 1, capacity 1 = {...}, output=std::vector of length 1, capacity 1 = {...}, inFile=..., ruleTable=..., this=<optimized out>, format=Moses::MosesFormat) at moses/TranslationModel/RuleTable/LoaderStandard.cpp:226
#2 0x00000000006048bd in Moses::RuleTableTrie::Load (this=0x132c000) at moses/TranslationModel/RuleTable/Trie.cpp:48
#3 0x000000000041fcf6 in Moses::StaticData::LoadFeatureFunctions (this=this@entry=0xaa4c20 <Moses::StaticData::s_instance>) at moses/StaticData.cpp:901
#4 0x0000000000426e53 in Moses::StaticData::LoadData (this=this@entry=0xaa4c20 <Moses::StaticData::s_instance>, parameter=parameter@entry=0x7fffffffd600) at moses/StaticData.cpp:499
#5 0x0000000000427d3c in Moses::StaticData::LoadDataStatic (parameter=parameter@entry=0x7fffffffd600, execPath="/local/ling/moses/bin/moses") at moses/StaticData.cpp:98
#6 0x000000000040d185 in main (argc=11, argv=0x7fffffffdc78) at moses-cmd/Main.cpp:105
======================================================================
Next I'll try compiling moses myself, to see if will be the same,
but meanwhile I'd like to ask what this can be about (and at the same
time report this, if it is of interest).
I should add that I'm not a computational linguist, but a system
administrator trying to help one, so maybe I don't know what I'm actually
doing. :-) Actually she did the commands that led up to this. I only
repeated the last step under a debugger.
------------------------------
Message: 2
Date: Wed, 17 May 2017 10:57:40 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] EMS fails with Transliteration option
To: Rofael Behnam <rofaelemil@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbhxyLSDxdWs2=fNGexLuVHZEjk4_8MVY+x-ugxRJ3L-0A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
delete the code you added.
When running the script, add the argument
-external-bin-dir [path]
where [path] is the directory that contains the executables mkcls, GIZA++
or mgiza, and snt2cooc
* Looking for MT/NLP opportunities *
Hieu Hoang
http://moses-smt.org/
On 17 May 2017 at 09:10, Rofael Behnam <rofaelemil@gmail.com> wrote:
> Hello,
> Kindly find train-model.perl attached.
> I only added this line
> my $_EXTERNAL_BINDIR = '/home/rbehnam/mosesdecoder/external-bin-dir';
> at line 149 to try to solve the error during running EMS with
> transliteration option.
>
> I appreciate your understanding.
> Thanks in advance.
>
> Best Regards,
> *Rofael Emil Fayez Behnam*
> Bachelor of Science in Computer and Systems Engineering,
> Faculty of Engineering,
> Alexandria University,
> Egypt.
>
> On 17 May 2017 at 10:55, Hieu Hoang <hieuhoang@gmail.com> wrote:
>
>> what is the exact command you run to get the error? Can you please send
>> me the file
>> /home/rbehnam/mosesdecoder/scripts/training/train-model.perl
>>
>> * Looking for MT/NLP opportunities *
>> Hieu Hoang
>> http://moses-smt.org/
>>
>>
>> On 17 May 2017 at 08:45, Rofael Behnam <rofaelemil@gmail.com> wrote:
>>
>>> Hello,
>>> I have downloaded it from https://github.com/moses-smt/mosesdecoder
>>> This month. I only use Moses, I didn't change anything in code.
>>>
>>> I appreciate your understanding.
>>> Thanks in advance.
>>>
>>> Best Regards,
>>> *Rofael Emil Fayez Behnam*
>>> Bachelor of Science in Computer and Systems Engineering,
>>> Faculty of Engineering,
>>> Alexandria University,
>>> Egypt.
>>>
>>> On 17 May 2017 at 00:59, Hieu Hoang <hieuhoang@gmail.com> wrote:
>>>
>>>> approximately when and where did you download the Moses code from? Or
>>>> have you changed the code?
>>>>
>>>> Line 149 in your script doesn't seem to correspond to line 149 in the
>>>> script on github
>>>>
>>>>
>>>> * Looking for MT/NLP opportunities *
>>>> Hieu Hoang
>>>> http://moses-smt.org/
>>>>
>>>>
>>>> On 16 May 2017 at 14:05, Rofael Behnam <rofaelemil@gmail.com> wrote:
>>>>
>>>>> Hello,
>>>>> Hope all is good.
>>>>> I got that error
>>>>> Error
>>>>> *****
>>>>> "my" variable $_EXTERNAL_BINDIR masks earlier declaration in same
>>>>> scope at /home/rbehnam/mosesdecoder/scripts/training/train-model.perl
>>>>> line 149.
>>>>> Using SCRIPTS_ROOTDIR: /home/rbehnam/mosesdecoder/scripts
>>>>> Using multi-thread GIZA
>>>>> using gzip
>>>>> Use of uninitialized value $GIZA in -x at
>>>>> /home/rbehnam/mosesdecoder/scripts/training/train-model.perl line 491.
>>>>> ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in
>>>>> /home/rbehnam/mosesdecoder/external-bin-dir.
>>>>> You MUST specify the parameter -external-bin-dir at
>>>>> /home/rbehnam/mosesdecoder/scripts/training/train-model.perl line 491.
>>>>> *****************************
>>>>> The files: mkcls, GIZA++, & snt2cooc.out, are in external-bin-dir
>>>>> and EMS works well but on adding transliteration option, this error occurs,
>>>>> although train-model.perl is also called with EMS without Transliteration
>>>>> option.
>>>>>
>>>>> Please, help me use transliteration option with EMS.
>>>>> Thanks in advance.
>>>>>
>>>>> Best Regards,
>>>>> *Rofael Emil Fayez Behnam*
>>>>> Bachelor of Science in Computer and Systems Engineering,
>>>>> Faculty of Engineering,
>>>>> Alexandria University,
>>>>> Egypt.
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170517/9ccb1b30/attachment-0001.html
------------------------------
Message: 3
Date: Wed, 17 May 2017 11:06:56 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Segfault from moses while tuning
To: Per Starb?ck <starback@stp.lingfil.uu.se>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbh0hUMM9EXy_7q_n1gfw6Ap4Yvatth6y2WRgnY5+AuXAw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
It may be you're mixing up the phrase-based with the syntax/hiero model.
Can you please attach the file
filtered/moses.ini
and perhaps the first few lines of the phrase-table that's used
* Looking for MT/NLP opportunities *
Hieu Hoang
http://moses-smt.org/
On 17 May 2017 at 10:18, Per Starb?ck <starback@stp.lingfil.uu.se> wrote:
> Hi! When following the examples at
> http://www.statmt.org/moses/?n=Moses.Baseline I get a segmentation faul.
> I wonder what the problem is.
>
> I use the prebuilt binaries at
> http://www.statmt.org/moses/RELEASE-3.0/binaries/linux-
> 64bit/linux-64bit.tgz
> (on a Centos 7 system) and it's during the Tuning step, when I run
> training/mert-moses.pl I get an error. The command was:
>
> .../scripts/training/mert-moses.pl ../corpus/news-test2008.tc.de
> ../corpus/news-test2008.tc.en .../moses/bin/moses
> train/model/moses.ini --mertdir .../moses/bin/ &> mert.out
>
> (with some absolute paths here replaced with "...")
> That script is running
>
> .../moses -config filtered/moses.ini -weight-overwrite 'PhrasePenalty0=
> 0.043478 WordPenalty0= -0.217391 TranslationModel0= 0.043478 0.043478
> 0.043478 0.043478 Distortion0= 0.065217 LM0= 0.108696 LexicalReordering0=
> 0.065217 0.065217 0.065217 0.065217 0.065217 0.065217' -n-best-list
> run1.best100.out 100 distinct -input-file .../corpus/news-test2008.tc.de
> > run1.out
>
> which segfaults. When run under debugger I get the following backtrace:
>
> ======================================================================
> (gdb) bt
> #0 0x0000000000597a99 in Moses::TargetPhrase::SetAlignmentInfo
> (this=this@entry=0xcf92040, alignString=...) at moses/TargetPhrase.cpp:194
> #1 0x000000000060813c in Moses::RuleTableLoaderStandard::Load
> (input=std::vector of length 1, capacity 1 = {...}, output=std::vector of
> length 1, capacity 1 = {...}, inFile=..., ruleTable=..., this=<optimized
> out>, format=Moses::MosesFormat) at moses/TranslationModel/
> RuleTable/LoaderStandard.cpp:226
> #2 0x00000000006048bd in Moses::RuleTableTrie::Load (this=0x132c000) at
> moses/TranslationModel/RuleTable/Trie.cpp:48
> #3 0x000000000041fcf6 in Moses::StaticData::LoadFeatureFunctions
> (this=this@entry=0xaa4c20 <Moses::StaticData::s_instance>) at
> moses/StaticData.cpp:901
> #4 0x0000000000426e53 in Moses::StaticData::LoadData (this=this@entry=0xaa4c20
> <Moses::StaticData::s_instance>, parameter=parameter@entry=0x7fffffffd600)
> at moses/StaticData.cpp:499
> #5 0x0000000000427d3c in Moses::StaticData::LoadDataStatic
> (parameter=parameter@entry=0x7fffffffd600, execPath="/local/ling/moses/bin/moses")
> at moses/StaticData.cpp:98
> #6 0x000000000040d185 in main (argc=11, argv=0x7fffffffdc78) at
> moses-cmd/Main.cpp:105
> ======================================================================
>
> Next I'll try compiling moses myself, to see if will be the same,
> but meanwhile I'd like to ask what this can be about (and at the same
> time report this, if it is of interest).
>
> I should add that I'm not a computational linguist, but a system
> administrator trying to help one, so maybe I don't know what I'm actually
> doing. :-) Actually she did the commands that led up to this. I only
> repeated the last step under a debugger.
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170517/4db401d4/attachment.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 127, Issue 23
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 127, Issue 23"
Post a Comment