Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Request for problem solving errors in moses installation
(Hnin Thu Zar Aye)
2. Re: kbmira died with SIGABRT when tuning (Barry Haddow)
3. BLEU score becomes different (??)
4. Re: Request for problem solving errors in moses installation
(Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Sun, 17 Jan 2016 23:35:59 -0800
From: Hnin Thu Zar Aye <hninthuzar44@googlemail.com>
Subject: [Moses-support] Request for problem solving errors in moses
installation
To: moses-support@mit.edu
Message-ID:
<CAL9OGmwxvbasf5uR2sQWHO4+pPA1p=U5rVszTBV7cxu9EvT_8A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hello ,
I have try to install moses to test on my laptop computer but I have
got fail message in building.
So, I'd like to request the problem solving methods, please tell me
how to solve my problem.
The information of my linux version and the sequences of command
executed in installation process is as follow :
I have installed " centOS linux version 6.7 " on dell core i7 laptop
on virtual machine 10
that is installed in windows 8.1.
The installed centOS linux is run with " 2 GB memory and 40 GB hardisk " .
And I have already installed the gcc version 4.4.7 20120313 (Red Hat
4.4.7-16) (GCC) .
Firstly, as a root user, I installed the following required packages
for moses that are described
in Manual :
git
subversion
automake
libtool
gcc-c++
zlib-devel
python-devel
bzip2-devel
And then I , as a root user, have installed boost (version 1_55_0)
with four commands:
wget http://downloads.sourceforge.net/project/boost/boost/1.55.0/boost_1_55_0.tar.gz?r=http%3A%2F%2Fsourceforge.net%2Fprojects%2Fboost%2Ffiles%2Fboost%2F1.55.0%2F&ts=1389613041&tar
zxvf boost_1_55_0.tar.gz
cd boost_1_55_0/
./bootstrap.sh
./b2 -j4 --prefix=$PWD --libdir=$PWD/lib64 --layout=system link=static
install || echo FAILURE
Then, boost_1_55_0 is installed in root directory.
And then , after executing the following 3 commands as a root user
in root home directory, I have occured the error message as in "
build.log.gz "
git clone https://github.com/moses-smt/mosesdecoder.git
cd mosesdecoder/
./bjam -j4
I'm waiting for your reply with thanks.
Best regard,
hnin hnin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.gz
Type: application/x-gzip
Size: 221 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20160118/41965ccb/attachment-0001.gz
------------------------------
Message: 2
Date: Mon, 18 Jan 2016 08:43:22 +0000
From: Barry Haddow <bhaddow@inf.ed.ac.uk>
Subject: Re: [Moses-support] kbmira died with SIGABRT when tuning
To: Dingyuan Wang <abcdoyle888@gmail.com>, Hieu Hoang
<hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <569CA5AA.50203@inf.ed.ac.uk>
Content-Type: text/plain; charset=utf-8; format=flowed
Hi Dingyuan
Is it possible to attach the features.dat file that is causing the
error? Almost certainly Moses is failing to parse the line because of
the Asian characters in the feature names,
cheers - Barry
On 16/01/16 15:58, Dingyuan Wang wrote:
> I ran
>
> ~/software/moses/bin/kbmira -J 75 --dense-init run7.dense --sparse-init
> run7.sparse-weights --ffile run1.features.dat --ffile run2.features.dat
> --ffile run3.features.dat --ffile run4.features.dat --ffile
> run5.features.dat --ffile run6.features.dat --ffile run7.features.dat
> --scfile run1.scores.dat --scfile run2.scores.dat --scfile
> run3.scores.dat --scfile run4.scores.dat --scfile run5.scores.dat
> --scfile run6.scores.dat --scfile run7.scores.dat -o /tmp/mert.out
>
> in the tuning/tmp.1 directory, which will certainly replicate the error.
>
> ? 2016?01?16? 23:42, Hieu Hoang ??:
>> The mert script prints out every command it runs. You should be able to
>> replicate the error by running the last command
>>
>> On 16 Jan 2016 14:18, "Dingyuan Wang" <abcdoyle888@gmail.com
>> <mailto:abcdoyle888@gmail.com>> wrote:
>>
>> Sorry, but I can't reliably replicate the same problem when running
>> TUNING_tune.1 alone. There is no character '_' in the test set or top50
>> list.
>>
>> I'm using sparse-features = "target-word-insertion top 50,
>> source-word-deletion top 50, word-translation top 50 50, phrase-length"
>>
>> I've attached some related files from EMS and the EMS config.
>>
>> https://mega.nz/#!xs0SFKxL!M_RTBp1JGX24-b4xlYYLP-bLXKiC_Sl-p96x55avAB4
>>
>> ? 2016?01?16? 02:45, Hieu Hoang ??:
>> > could you make your model files available for download so I can
>> > replicate this problem.
>> >
>> > it seems like you're using a feature function with sparse scores. I
>> > think the character '_' must be escaped.
>> >
>> >
>> > On 12/01/16 04:00, Dingyuan Wang wrote:
>> >> Hi all,
>> >>
>> >> I'm using EMS for doing experiments. Every time the kbmira died with
>> >> SIGABRT when turning on one direction, while tuning on the opposite
>> >> direction (same config and test set) was successful.
>> >>
>> >> The mert.log (stderr) shows follows:
>> >>
>> >>
>> >> kbmira with c=0.01 decay=0.999 no_shuffle=0
>> >> Initialising random seed from system clock
>> >> Found 15323 initial sparse features
>> >> ....terminate called after throwing an instance of
>> >> 'MosesTuning::FileFormatException'
>> >> what(): Error in line "-4.51933 0 0 -6.09733 0 0 0 -121.556 2
>> -20 12
>> >> -31.6201 -38.5211 -26.5112 -60.6166 WT_?~?=2 WT_?~?=1 PL_s1=4
>> >> PL_s3=1 PL_3,3=1 PL_2,2=3 PL_1,2=1 PL_2,1=3 PL_t1=6 PL_t2=4 PL_t3=2
>> >> PL_2,3=1 PL_s2=7 PL_1,1=3 WT_?~??=1 WT_?~??=1 WT_?~?=1
>> WT_?~?
>> >> ?=1 WT_?~?=1 WT_?~?=2 WT_?~?=1 WT_?~?=1 WT_?~??=1 WT_
>> ?~?=1
>> >> WT_?~??=1 WT_?~?=1 WT_?~??=1 WT_?~??=1 WT_?~??=1 WT_?~
>> >> ?=1 WT_?~??=1 " of run7.features.dat
>> >> Aborted
>> >>
>> >>
>> >> I think since run7.scores.dat is generated by some scripts, I
>> wouldn't
>> >> be responsible for making the bad format. Last time it also died, I
>> >> removed the likely offending line in the test set, but this time
>> another
>> >> line appears.
>> >>
>> >> --
>> >> Dingyuan Wang
>> >> _______________________________________________
>> >> Moses-support mailing list
>> >> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> >> http://mailman.mit.edu/mailman/listinfo/moses-support
>> >
>>
>> --
>> Dingyuan Wang (gumblex)
>>
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
------------------------------
Message: 3
Date: Mon, 18 Jan 2016 17:01:29 +0800 (CST)
From: ?? <yaoliang310@163.com>
Subject: [Moses-support] BLEU score becomes different
To: moses-support@mit.edu
Message-ID: <53a842ce.a44e.15253f7b6ac.Coremail.yaoliang310@163.com>
Content-Type: text/plain; charset="gbk"
Dear Moses Support Team?
I added a source context-dependent translation feature in moses baseline system.
In order to avoid modifying the source code, i append a unique identifier to every word in the test/dev source file.
for example, a source file with two lines like the following:
this is sentence 1
. sentence 2
would become this~~1 is~~2 sentence~~3 1~~4, .~~5 sentence~~6 2~~7.
Then, i generate my sentence-specific phrase tables for each sentence, use the same IDs as the source file words in those phrase table entries.
I concatenate all the phrase tables together, then MERT and Decoder as usual.
I do my experiments on Chinese2English translation tasks, and I found that in the output file the oov words still have IDs .
E.g. the translation of one NIST03 sentence are as follows:
published by the british science weekly , according to the study by the 14th on chromosome sequencing of genes and gene segments ?????~~97 .
?????~~97 ~~97 is the ID of word " ?????"
I found that when i remove IDs in the output file, the BLEU scores are significantly difference. I have no idea what happens ? could you give me some advices?
I use mteval-v13a.pl scripts to calculate BLEU scores in my experiment .
Thanks,
Liang
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160118/cee8e9d6/attachment-0001.html
------------------------------
Message: 4
Date: Mon, 18 Jan 2016 10:07:35 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Request for problem solving errors in
moses installation
To: Hnin Thu Zar Aye <hninthuzar44@googlemail.com>,
moses-support@mit.edu
Message-ID: <569CB967.9040804@gmail.com>
Content-Type: text/plain; charset="windows-1252"
On 18/01/16 07:35, Hnin Thu Zar Aye wrote:
> Hello ,
>
> I have try to install moses to test on my laptop computer but I have
> got fail message in building.
> So, I'd like to request the problem solving methods, please tell me
> how to solve my problem.
>
> The information of my linux version and the sequences of command
> executed in installation process is as follow :
> I have installed " centOS linux version 6.7 " on dell core i7 laptop
> on virtual machine 10
> that is installed in windows 8.1.
> The installed centOS linux is run with " 2 GB memory and 40 GB hardisk " .
2GB ram is probably not enough to run Moses with any reasonable size
corpora. I would recommend at least 8GB ram. 500GB disk space is also
advisable
>
> And I have already installed the gcc version 4.4.7 20120313 (Red Hat
> 4.4.7-16) (GCC) .
>
> Firstly, as a root user, I installed the following required packages
> for moses that are described
> in Manual :
> git
> subversion
> automake
> libtool
> gcc-c++
> zlib-devel
> python-devel
> bzip2-devel
>
> And then I , as a root user, have installed boost (version 1_55_0)
> with four commands:
>
> wget http://downloads.sourceforge.net/project/boost/boost/1.55.0/boost_1_55_0.tar.gz?r=http%3A%2F%2Fsourceforge.net%2Fprojects%2Fboost%2Ffiles%2Fboost%2F1.55.0%2F&ts=1389613041&tar
> zxvf boost_1_55_0.tar.gz
>
> cd boost_1_55_0/
>
> ./bootstrap.sh
> ./b2 -j4 --prefix=$PWD --libdir=$PWD/lib64 --layout=system link=static
> install || echo FAILURE
>
> Then, boost_1_55_0 is installed in root directory.
>
> And then , after executing the following 3 commands as a root user
> in root home directory, I have occured the error message as in "
> build.log.gz "
>
> git clone https://github.com/moses-smt/mosesdecoder.git
> cd mosesdecoder/
> ./bjam -j4
you need to tell bjam where the boost library are held:
./bjam -j4 --with-boost=<full path to the boost directory>
>
> I'm waiting for your reply with thanks.
>
> Best regard,
> hnin hnin
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Hieu Hoang
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160118/c2f22471/attachment.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 111, Issue 50
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 111, Issue 50"
Post a Comment