Moses-support Digest, Vol 98, Issue 56

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. issues about registering of new feature (Xiaoqiang Feng)
2. issues about registering of new feature (Xiaoqiang Feng)
3. Syntax training crashing (Massinissa Ahmim)


----------------------------------------------------------------------

Message: 1
Date: Wed, 24 Dec 2014 14:08:50 +0800
From: Xiaoqiang Feng <feng.x.q.2006@gmail.com>
Subject: [Moses-support] issues about registering of new feature
To: moses-support@mit.edu
Message-ID:
<CADHOrU6EeamNAN3JsixrTOoVXye0eLc4pBvHf3UWy_99ADMShg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi, all

I want to add a new stateful feature function to moses. This new feature is
neural network joint model which is proposed
in "Fast and robust neural network joint models for statistical machine
translation (ACL 2014)".

I added two files "NNJMStatefulFF.h, NNJMStatefulFF.cpp" into moses/FF
directory. And I have modified the Factory.cpp with
adding two lines code: "#include "moses/FF/NNJMStatefulFF.h;
MOSES_FNAME2("NNJM", NNJMStatefulFF);".
I recompile the whole project in moses root with command "./bjam -j4", and
the result showed "SUCCESS".

Then I want to test the NNJM feature, here I just want to test to see
whether this new feature works, which means I don't want to tuning the
parameter of NNJM. So I modefied the moses.ini with adding the NNJM feature
and run the command "~/home1/mosesdecoder/bin/moses -f moses-nnjm.ini". But
it did not work, the information is as follow:
"Exception: moses/FF/Factory.cpp:275 in void
Moses::FeatureRegistry::Construct(const string&, const string&) threw
UnknownFeatureException because `i == registry_.end()'.
Feature name NNJM is not registered."

I want to know how can I register this new feature. Do I need to retrain

Thanks,
Xiaoqiang Feng
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141224/d4024efe/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 24 Dec 2014 14:14:04 +0800
From: Xiaoqiang Feng <feng.x.q.2006@gmail.com>
Subject: [Moses-support] issues about registering of new feature
To: moses-support@mit.edu
Message-ID:
<CADHOrU77FkyMOkm+w3rruG_6vELWfmJhDnpUqarCe-DqezCbgg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi, all

I am sorry to resend this email, I did not finish in last email.

I want to add a new stateful feature function to moses. This new feature is
neural network joint model which is proposed
in "Fast and robust neural network joint models for statistical machine
translation (ACL 2014)".

I added two files "NNJMStatefulFF.h, NNJMStatefulFF.cpp" into moses/FF
directory. And I have modified the Factory.cpp with
adding two lines code: "#include "moses/FF/NNJMStatefulFF.h;
MOSES_FNAME2("NNJM", NNJMStatefulFF);".
I recompile the whole project in moses root with command "./bjam -j4", and
the result showed "SUCCESS".

Then I want to test the NNJM feature, here I just want to test to see
whether this new feature works, which means I don't want to tuning the
parameter of NNJM. So I modefied the moses.ini with adding the NNJM feature
and run the command "~/home1/mosesdecoder/bin/moses -f moses-nnjm.ini". But
it did not work, the information is as follow:
"Exception: moses/FF/Factory.cpp:275 in void
Moses::FeatureRegistry::Construct(const string&, const string&) threw
UnknownFeatureException because `i == registry_.end()'.
Feature name NNJM is not registered."

I want to know how can I register this new feature. Do I need to retrain
the translation model by train-model.perl ? Do I need to modify the
train-model.perl and how?

Thanks,
Xiaoqiang Feng
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141224/b4105f25/attachment-0001.htm

------------------------------

Message: 3
Date: Wed, 24 Dec 2014 15:30:53 +0100
From: Massinissa Ahmim <massinissa.ahmim@linguacustodia.com>
Subject: [Moses-support] Syntax training crashing
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CANN0mWZxa_=as2fw+DHbX8+3_QhdbotAB_KrEXvxs31nYKwkyg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear all,

I'm trying to train a syntactic model english to german. I did the
annotation on the target part using bitpar and ran :

nohup /mosesdecoder/scripts/training/train-model.perl -target-syntax
--glue-grammar --max-phrase-length 10 --extract-options="--MaxSpan 15"
--score-options="--GoodTuring" -root-dir /home/Massi/KIID_ENDE/syntax/
-corpus /home/Massi/KIID_DEEN/tagged.kiid -f en -e de -lm
0:5:/home/Massi/KIID_ENDE/LM/atelier/lm.kiid5.blm.de.mm -external-bin-dir
/root/external-bin-dir/ -mgiza -mgiza-cpus 30 >& training.out &


but the training is crashing with the following message :

ERROR: Execution of: /root/external-bin-dir/mgiza -CoocurrenceFile
/home/Massi/KIID_ENDE/syntax/giza.de-en/de-en.cooc -c
/home/Massi/KIID_ENDE/syntax/corpus/de-en-int-train.snt -m1 5 -m2 0 -m3 3
-m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -ncpus 30 -nodumps 1
-nsmooth 4 -o /home/Massi/KIID_ENDE/syntax/giza.de-en/de-en -onlyaldumps 1
-p0 0.999 -s /home/Massi/KIID_ENDE/syntax/corpus/en.vcb -t
/home/Massi/KIID_ENDE/syntax/corpus/de.vcb
died with signal 11, without coredump


I tried to look for null byts but there isn't any...

Many thanks
--

[image: Description : Description : lingua_custodia_final full logo]

*The Translation Trustee*

*1, Place Charles de Gaulle*

*78180 Montigny-le-Bretonneux*

*Tel : +33 1 30 44 04 23 Mobile : +33 7 61 44 40 84*

*Email :* *massinissa.ahmim@linguacustodia.com
<massinissa.ahmim@linguacustodia.com>*

*Website :* *www.linguacustodia.com <http://www.linguacustodia.com/> -
www.thetranslationtrustee.com <http://www.thetranslationtrustee.com>*

A Young Innovative Company recognised by the French Research Ministry and
Paris Finance Innovation cluster

[image: Logo labellis? FI small]
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141224/7461bcb8/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 4421 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141224/7461bcb8/attachment.jpg
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.jpg
Type: image/jpeg
Size: 2720 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141224/7461bcb8/attachment-0001.jpg

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 98, Issue 56
*********************************************

Tweet