Moses-support Digest, Vol 97, Issue 3

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Incremental training (Ihab Ramadan)


----------------------------------------------------------------------

Message: 1
Date: Tue, 4 Nov 2014 11:09:32 +0200
From: "Ihab Ramadan" <i.ramadan@saudisoft.com>
Subject: Re: [Moses-support] Incremental training
To: "'Raj Dabre'" <prajdabre@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <00a401cff80f$0d5f6ff0$281e4fd0$@saudisoft.com>
Content-Type: text/plain; charset="utf-8"

Dear Raj,

That?s a great work my friend,

This files make the script work but it takes long time to finish also it did not generate the model folder which contain the moses.ini file

Is this normal?

And I now try to run it again as I suspect that the server was shut down before the training was completed but i notice that it starts form the beginning and did not use the existing files generated

Thanks Raj it still a great work





From: Raj Dabre [mailto:prajdabre@gmail.com]
Sent: Thursday, October 30, 2014 4:54 PM
To: i.ramadan@saudisoft.com
Cc: moses-support@mit.edu
Subject: Re: [Moses-support] Incremental training



Ahh.... i totally forgot that part.

Sorry.

PFA.

Just place them in the folder where the shell scripts full_train.sh and align_new.sh are.

Hopefully it should run now.

Please let me know if you succeed.



On Thu, Oct 30, 2014 at 11:44 PM, Ihab Ramadan <i.ramadan@saudisoft.com> wrote:

Dear Raj,

It is a great solution

I installed MGIZA++ successfully and I am using your scripts to run training

And I followed the steps you mentioned but I faces this error when I was running the full_train.sh script



bla bla bla

.

.

.

.



Starting MGIZA

Initializing Global Paras

DEBUG: EnterDEBUG: PrefixDEBUG: LogParsing Arguments

ERROR: Cannot open configuration file configgiza.fwd!

Starting MGIZA

Initializing Global Paras

DEBUG: EnterDEBUG: PrefixDEBUG: LogParsing Arguments

ERROR: Cannot open configuration file configgiza.rev!





This two files does not exists

should they be generated from the installation?

How to get them?



From: Raj Dabre [mailto:prajdabre@gmail.com]
Sent: Sunday, October 26, 2014 6:21 PM
To: i.ramadan@saudisoft.com
Cc: moses-support@mit.edu
Subject: Re: [Moses-support] Incremental training



Hello Ihab,

I would suggest using mgiza++. http://www.kyloo.net/software/doku.php/mgiza:overview

It is very easy to use.

I also wrote some scripts to make it easy for training.
Visit the link below for my scripts.
https://drive.google.com/folderview?id=0B2gN8qfxTTUoSU43OFBhZXpPZ3M <https://drive.google.com/folderview?id=0B2gN8qfxTTUoSU43OFBhZXpPZ3M&usp=sharing> &usp=sharing

Usage:

To train basic IBM models:
bash full_train.sh <src_corpus_file_name> <tgt_corpus_file_name> <model_folder_base> <corpus_folder_base> <path_to_mgizapp_installation>

To align 2 new files using previously trained models (aka continue training).

bash align_new.sh <new_src_corpus_file_name> <new_tgt_corpus_file_name> <old_src_corpus_file_name> <old_tgt_corpus_file_name> <model_folder_base> <corpus_folder_base> <path_to_mgizapp_installation>

There is also a python script which you had better replace in the scripts folder of mgiza++. I have modified it to work with my scripts.

Hope this helps.





On Sun, Oct 26, 2014 at 11:05 PM, Ihab Ramadan <i.ramadan@saudisoft.com> wrote:

Dear All,

I just need a clear steps on how to do incremental training in moses, as the illustration in the manual is not cleared enough

Thanks



Best Regards

Ihab Ramadan| Senior Developer| <http://www.saudisoft.com/> Saudisoft - Egypt | Tel +2 02 330 320 37 Ext- 0 | Mob+201007570826 <tel:%2B201007570826> | Fax+20233032036 <tel:%2B20233032036> | Follow us on <http://www.linkedin.com/company/77017?trk=vsrp_companies_res_name&trkInfo=VSRPsearchId%3A1489659901402995947155%2CVSRPtargetId%3A77017%2CVSRPcmpt%3Aprimary> linked | <https://www.facebook.com/pages/Saudisoft-Co-Ltd/289968997768973?ref_type=bookmark> ZA102637861 | <https://twitter.com/Saudisoft> ZA102637858




_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support




--

Raj Dabre.
Research Student,

Graduate School of Informatics,
Kyoto University.

CSE MTech, IITB., 2011-2014




--

Raj Dabre.
Research Student,

Graduate School of Informatics,
Kyoto University.

CSE MTech, IITB., 2011-2014

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141104/e0e42eb5/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1314 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141104/e0e42eb5/attachment.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1317 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141104/e0e42eb5/attachment-0001.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1351 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141104/e0e42eb5/attachment-0002.gif

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 97, Issue 3
********************************************

Tweet