Home » Uncategories » Moses-support Digest, Vol 89, Issue 62

Moses-support Digest, Vol 89, Issue 62

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Issue while installing Moses and Boost (Apurv Nagvenkar)
2. Help: Issues while installing Moses and Boost (Apurv Nagvenkar)
3. Is it possible to use -xml-input flag with the recaser ?
(kamel nebhi)
4. Error with Feature function Translation Model
(cyrine.nasri@univ-lorraine.fr)


----------------------------------------------------------------------

Message: 1
Date: Sun, 23 Mar 2014 22:09:11 +0530
From: Apurv Nagvenkar <apurv.nagvenkar@gmail.com>
Subject: [Moses-support] Issue while installing Moses and Boost
To: moses-support@mit.edu
Message-ID:
<CAMFkW=oxSYaRD90_DhcQvieoXPLT7wADwSQ9gSEmVu2aoRZD2A@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hello Sir,

I am trying to install moses on Fedora 18 64-bit system.
Following are the commands or instructions which I followed from numerous
tutorials.

***************-Build SRILM-******************
cd srilm
MAKE_PIC=1
export SRILM=$PWD
export MACHINE_TYPE=i686-m64
export PATH=${PATH}:$SRILM/bin/$MACHINE_TYPE
export PATH=${PATH}:$SRILM/bin
export MANPATH=$SRILM/man
make World
make test
make cleanest

**********---------Installing external directories----------**************
PREFIX=$HOME/usr
LIBDIR=$PREFIX/lib64
export PATH=$PREFIX/bin${PATH:+:$PATH}
export LD_LIBRARY_PATH=$LIBDIR${LD_LIBRARY_PATH:+:$LD_LIBRARY_PATH}
export LIBRARY_PATH=$LIBDIR${LIBRARY_PATH:+:$LIBRARY_PATH}
export CPATH=$PREFIX/include${CPATH:+:$CPATH}


#For autotools packages e.g. xmlrpc-c and zlib

./configure --prefix=$PREFIX --libdir=$LIBDIR [other options here]

*********Installing Boost****************
cd boost_1_55_0
./bootstrap.sh
./b2 --prefix=$PWD --libdir=$PWD/lib64 --layout=tagged link=static,shared
threading=multi,single install || echo FAILURE
./b2 install --prefix=/usr/share/boost-build

export BOOST_ROOT=$PWD
export BOOST_BUILD_PATH=/usr/share/boost-build


In mosesdecoder I entered following command

./bjam --with-boost=$BOOST_ROOT --with-srilm=$SRILM

The above commands lead to some error. I am attaching a build.log file.

Kindly go through it and please try to fix it
Regards,
Apurv Nagvenkar
DCST, Goa University
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140323/25a694cd/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.gz
Type: application/x-gzip
Size: 2655 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140323/25a694cd/attachment-0001.bin

------------------------------

Message: 2
Date: Sun, 23 Mar 2014 22:11:13 +0530
From: Apurv Nagvenkar <apurv.nagvenkar@gmail.com>
Subject: [Moses-support] Help: Issues while installing Moses and Boost
To: moses-support@mit.edu, Moses-support-request@mit.edu
Message-ID:
<CAMFkW=rs-FQBEp6LHMiP85kiDd99SEKUO6iwDr=BRU7oLbJ02g@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hello Sir,

I am trying to install moses on Fedora 18 64-bit system.
Following are the commands or instructions which I followed from numerous
tutorials.

***************-Build SRILM-******************
cd srilm
MAKE_PIC=1
export SRILM=$PWD
export MACHINE_TYPE=i686-m64
export PATH=${PATH}:$SRILM/bin/$MACHINE_TYPE
export PATH=${PATH}:$SRILM/bin
export MANPATH=$SRILM/man
make World
make test
make cleanest

**********---------Installing external directories----------**************
PREFIX=$HOME/usr
LIBDIR=$PREFIX/lib64
export PATH=$PREFIX/bin${PATH:+:$PATH}
export LD_LIBRARY_PATH=$LIBDIR${LD_LIBRARY_PATH:+:$LD_LIBRARY_PATH}
export LIBRARY_PATH=$LIBDIR${LIBRARY_PATH:+:$LIBRARY_PATH}
export CPATH=$PREFIX/include${CPATH:+:$CPATH}


#For autotools packages e.g. xmlrpc-c and zlib

./configure --prefix=$PREFIX --libdir=$LIBDIR [other options here]

*********Installing Boost****************
cd boost_1_55_0
./bootstrap.sh
./b2 --prefix=$PWD --libdir=$PWD/lib64 --layout=tagged link=static,shared
threading=multi,single install || echo FAILURE
./b2 install --prefix=/usr/share/boost-build

export BOOST_ROOT=$PWD
export BOOST_BUILD_PATH=/usr/share/boost-build


In mosesdecoder I entered following command

./bjam --with-boost=$BOOST_ROOT --with-srilm=$SRILM

The above commands lead to some error. I am attaching a build.log file.

Kindly go through it and please try to fix it

Regards,
Apurv Nagvenkar
DCST, Goa University
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140323/57faa682/attachment-0001.htm

------------------------------

Message: 3
Date: Sun, 23 Mar 2014 20:53:35 +0000
From: kamel nebhi <k.nebhi@sheffield.ac.uk>
Subject: [Moses-support] Is it possible to use -xml-input flag with
the recaser ?
To: moses-support@mit.edu
Message-ID:
<CAG66Y3cHCQcTd6H=oCoX4JqnLTNWwDVoDH3g_S0Z8ik4_Q8O=g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hello,

I'm actually use the recaser provided by Moses. I want to ignore some part
of the corpus and i'm looking for a solution such as the -xml-input flag
(see at http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc9).

Is it possible to use this feature with the recaser ? If no, how can i
ignore some part of the corpus ?

Best
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140323/ac6f4e00/attachment-0001.htm

------------------------------

Message: 4
Date: Mon, 24 Mar 2014 11:14:47 +0100
From: "cyrine.nasri@univ-lorraine.fr" <cyrine.nasri@gmail.com>
Subject: [Moses-support] Error with Feature function Translation Model
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAPg_V0h14xST_minU50JmBOvGTArbfQ8QX9tPpDHEchC4Yqm7g@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hello,

I have a strange error with translation feauture in the config file :

This is my moses.ini file :



#########################
### MOSES CONFIG FILE ###
#########################

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0
1 T 1
[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryBinary name=TranslationModel0 table-limit=20 num-features=4
path=/home/cyrine/work/model/phrase-table input-factor=0 output-factor=0
PhraseDictionaryBinary name=TranslationModel0 table-limit=20 num-features=4
path=/home/cyrine/work/resultaTT0.000009.txt input-factor=0 output-factor=0
#LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/cyrine/work/model/reordering-table.wbe-#msd-bidirectional-fe
Distortion
KENLM name=LM0 factor=0 path=/home/cyrine/corpus/EN5GR.lm order=5

# dense weights for feature functions
[weight]
UnknownWordPenalty0= 1
WordPenalty0= -1
PhrasePenalty0= 0.2
*TranslationModel0= 0.2 0.2 0.2 0.2*
#LexicalReordering0= 0.3
#0.3 0.3 0.3 0.3 0.3
Distortion0= 0.3
LM0= 0.5



When i run the Mert script i got this error :



*Exception: moses/ScoreComponentCollection.cpp:242 in void
Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*,
const std::vector<float>&) threw util::Exception'.Feature function
TranslationModel0 specified 4 dense scores or weights. Actually has 8Exit
code: 1*



and the run1.moses.ini :


# MERT optimized configuration
# decoder /home/cyrine/moses/bin/decoder/bin/moses
# BLEU --not-estimated-- on dev /home/cyrine/corpus/Developpement/
news-test2008.tok.true.clean.low.fr
# We were before running iteration 1
# finished lundi 24 mars 2014, 11:13:12 (UTC+0100)
### MOSES CONFIG FILE ###
#########################

# input factors
[input-factors]
0

# mapping steps
[mapping]
0 T 0
1 T 1
[distortion-limit]
6

# feature functions
[feature]
UnknownWordPenalty
WordPenalty
PhrasePenalty
PhraseDictionaryBinary name=TranslationModel0 table-limit=20 num-features=4
path=/home/cyrine/work/model/phrase-table input-factor=0 output-factor=0
PhraseDictionaryBinary name=TranslationModel0 table-limit=20 num-features=4
path=/home/cyrine/work/resultaTT0.000008.txt input-factor=0 output-factor=0
#LexicalReordering name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0
path=/home/cyrine/work/model/reordering-table.wbe-#msd-bidirectional-fe
Distortion
KENLM name=LM0 factor=0 path=/home/cyrine/corpus/EN5GR.lm order=5

# dense weights for feature functions
[weight]

Distortion0= 0.300000
LM0= 0.500000
WordPenalty0= -1.000000
PhrasePenalty0= 0.200000
*TranslationModel0= 0.200000 0.200000 0.200000 0.200000 0.200000 0.200000
0.200000 *0.200000
UnknownWordPenalty0= 1


I don't know why i got 8 feautures in the run1.moses.in

Any idea please?


Bests

Cyrine
--

*Cyrine NASRIPh.D. Student in Computer Science*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140324/028d5fc6/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 89, Issue 62
*********************************************

0 Response to "Moses-support Digest, Vol 89, Issue 62"

Post a Comment

Subscribe to: Post Comments (Atom)