Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Improving SMT using RBMT (Kalyani Baruah)
2. ERROR: Lexical reordering scoring failed at
moses/scripts/training/train-model.perl line 1738.
(=?GB2312?B?wO673bvd?=)
----------------------------------------------------------------------
Message: 1
Date: Mon, 24 Feb 2014 09:38:52 +0200
From: Kalyani Baruah <kajubaruah04@gmail.com>
Subject: [Moses-support] Improving SMT using RBMT
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAJZ5LDde4zWp+4j7GUbt-muQ53YxWKNFcQ-TX-VvbpckJgKD0Q@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"
Hi all, I have built a SMT system using the moses manual for a pair of
about 2500 sentences for Assamese and English language.
I want to improve the translation quality. Is it possible to use the Rule
Based Machine Translation into my SMT system and make my system hybrid. If
it is possible, please guide me how to do so.
Regards,
*Kalyanee Kanchan Baruah*
Institute of Science and Technology,
Gauhati University,Guwahati,India
Phone- +91-9706242124
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140224/ae07c79d/attachment-0001.htm
------------------------------
Message: 2
Date: Mon, 24 Feb 2014 09:38:01 +0100
From: =?GB2312?B?wO673bvd?= <hui.li@informatik.uni-heidelberg.de>
Subject: [Moses-support] ERROR: Lexical reordering scoring failed at
moses/scripts/training/train-model.perl line 1738.
To: moses-support@mit.edu
Message-ID:
<CAOG3Tm9eAPZVcVos-gktK+k5qr_mHkBxhxO0FrhMAaLgMO-zvg@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"
Hi all,
when I was training the phrase model,
hli@themisto:~/MT$ moses/scripts/training/train-model.perl home/hli/MT
-corpus lm/1545.test.lowercased -external-bin-dir bin -e de -f ade
-alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm
0:3:/home/hli/MT/lm/1545.test.lm
I obtained this error:
scores lexical reordering models of several types (hierarchical,
phrase-based and word-based-extraction
terminate called after throwing an instance of 'util::ErrnoException'
what(): util/file.cc:67 in int util::OpenReadOrThrow(const char*) threw
ErrnoException because `-1 == (ret = open(name, 00))'.
No such file or directory while opening ./model/extract.o.sorted.gz
Aborted (core dumped)
Exit code: 134
ERROR: Lexical reordering scoring failed at
moses/scripts/training/train-model.perl line 1738.
Attached is my corpus, could you help me to find out what's wrong with it ?
Thx a lot!
Best Regards,
Hui Li
Institute of Computer Science
Heidelberg
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140224/8c28b3b3/attachment.htm
-------------- next part --------------
\data\
ngram 1=126
ngram 2=272
ngram 3=36
\1-grams:
-1.037229 , -0.3976834
-1.32178 . -0.5473039
-2.346701 1 -0.06643374
-2.346701 10 -0.06643375
-2.346701 13 -0.06643375
-2.346701 15 -0.06643375
-2.346701 17 -0.06643375
-2.346701 18 -0.06643375
-2.346701 19 -0.06643375
-2.346701 2 -0.06643375
-2.346701 20 -0.06643375
-2.346701 22 -0.06643375
-2.346701 23 -0.06643375
-2.346701 27 -0.06643375
-2.346701 3 -0.06643375
-2.346701 4 -0.06643375
-2.346701 5 -0.06643375
-2.346701 6 -0.06643375
-2.346701 7 -0.06643375
-2.346701 8 -0.06643375
-2.346701 9 -0.06643375
-2.346701 </s>
-99 <s> -0.06643374
-2.464394 <unk>
-2.346701 abend -0.06643375
-2.346701 also -0.06643374
-2.346701 am -0.06643374
-2.141096 an -0.06643374
-2.346701 ander -0.06643374
-2.346701 anfang -0.06643374
-1.738606 auff -0.1917715
-2.346701 aus -0.06643374
-2.346701 bilde -0.06643374
-1.738606 da -0.30103
-1.481994 das -0.1822732
-2.141096 dem -0.1073003
-2.141096 den -0.06643374
-1.658922 der -0.08638652
-2.346701 des -0.06643374
-1.836271 die -0.0932465
-2.346701 dritte -0.06643374
-2.070822 ein -0.06643375
-2.346701 eine -0.06643375
-2.070822 er -0.06643374
-2.070822 erde -0.06643374
-2.070822 erden -0.09671755
-2.346701 erf??llet -0.06643374
-2.346701 errege -0.06643375
-2.346701 erste -0.06643374
-2.141096 es -0.06643374
-2.346701 euch -0.06643375
-2.141096 feste -0.09671754
-2.070822 festen -0.1292724
-2.346701 finster -0.06643375
-2.141096 finsternis -0.1073003
-2.346701 fleuget -0.06643374
-2.346701 frewlin -0.06643374
-2.346701 fruchtbar -0.06643375
-2.346701 f??nffte -0.06643374
-2.346701 geist -0.06643374
-2.346701 geschach -0.06643374
-2.070822 geuogel -0.06643374
-1.962471 gott -0.06643374
-2.070822 gottes -0.06643374
-2.070822 gut -0.1292724
-2.141096 himel -0.06643374
-2.346701 himels -0.06643374
-2.346701 im -0.06643374
-2.346701 jm -0.06643374
-2.346701 jn -0.06643374
-2.346701 lebendigen -0.06643374
-2.346701 leer -0.06643374
-1.962471 liecht -0.08638653
-2.346701 liechter -0.06643375
-2.346701 machet -0.06643374
-2.346701 man -0.06643374
-2.070822 meer -0.06643374
-2.346701 mehre -0.06643375
-2.346701 mehret -0.06643374
-2.346701 menlin -0.06643375
-2.346701 menschen -0.06643374
-2.070822 mit -0.06643375
-2.346701 morgen -0.06643374
-2.070822 nacht -0.06643374
-2.141096 nennet -0.09671755
-2.346701 regierten -0.06643374
-2.346701 sahe -0.06643374
-2.346701 samle -0.06643375
-2.346701 samlung -0.06643374
-2.070822 scheidet -0.06643374
-2.346701 scheideten -0.06643374
-2.346701 scheinen -0.06643375
-2.346701 schienen -0.06643375
-1.962471 schuff -0.06643374
-2.346701 schwebet -0.06643375
-2.346701 segnet -0.06643374
-2.346701 sehe -0.06643374
-2.346701 seid -0.06643374
-2.346701 seien -0.06643374
-2.346701 setzt -0.06643374
-2.346701 sey -0.06643374
-2.141096 sich -0.1073003
-1.962471 sie -0.06643374
-2.346701 sondere -0.06643374
-2.070822 sprach -0.1292724
-1.658922 tag -0.3679768
-2.346701 thieren -0.06643374
-2.346701 tieffe -0.06643374
-2.346701 trocken -0.06643374
-2.346701 vber -0.06643374
-2.346701 vierde -0.06643374
-1.054982 vnd -0.2426882
-2.070822 vnter -0.1073003
-2.346701 vnterscheid -0.06643374
-2.346701 vom -0.06643375
-2.346701 von -0.06643375
-2.141096 war -0.06643374
-2.070822 ward -0.06643374
-2.141096 wasser -0.06643374
-2.346701 wassern -0.06643374
-2.346701 webenden -0.06643375
-2.346701 werde -0.06643374
-2.346701 w??st -0.06643375
-2.070822 zum -0.1292724
-2.070822 zwischen -0.1292724
-2.346701 ??rter -0.06643374
\2-grams:
-2.118029 , an
-1.919566 , da
-0.9840701 , das -0.09373893
-2.090003 , erde
-2.118029 , es -0.1207717
-2.118029 , himel
-2.090003 , meer
-2.090003 , nacht
-2.185117 , seid
-1.86947 , tag
-0.3076161 , vnd -0.1747931
-2.185117 , von
-2.090003 , zum
-0.1877349 . </s>
-1.403366 . da -0.2910791
-1.226848 . vnd -0.2910791
-0.8365213 1 am
-0.662631 10 vnd
-0.8026917 13 da
-0.662631 15 vnd
-0.662631 17 vnd
-0.662631 18 vnd
-0.8026917 19 da
-0.662631 2 vnd
-0.662631 20 vnd
-0.662631 22 vnd
-0.8026917 23 da
-0.662631 27 vnd
-0.662631 3 vnd
-0.662631 4 vnd
-0.662631 5 vnd
-0.662631 6 vnd
-0.8026917 7 da
-0.662631 8 vnd
-0.662631 9 vnd
-1.945849 <s> 1
-1.945849 <s> 10
-1.945849 <s> 13
-1.945849 <s> 15
-1.945849 <s> 17
-1.945849 <s> 18
-1.945849 <s> 19
-1.945849 <s> 2
-1.945849 <s> 20
-1.945849 <s> 22
-1.945849 <s> 23
-1.945849 <s> 27
-1.945849 <s> 3
-1.945849 <s> 4
-1.945849 <s> 5
-1.945849 <s> 6
-1.945849 <s> 7
-1.945849 <s> 8
-1.945849 <s> 9
-0.662631 abend vnd -0.5272647
-0.7381428 also . -0.3054159
-0.8365213 am anfang
-1.179783 an der
-1.223354 an die
-1.291207 an sondere
-0.7940786 ander tag
-0.820448 anfang schuff
-1.548409 auff dem
-1.423158 auff der
-1.481284 auff die
-0.5353395 auff erden
-0.8365213 aus abend -0.5272647
-0.8248137 bilde ,
-1.106725 bilde gottes
-1.586849 da machet
-1.554578 da scheidet
-0.3401158 da ward -0.5272647
-1.655018 das auff
-1.497636 das das
-1.827367 das es -0.2910792
-1.80368 das geuogel
-0.8868613 das liecht
-1.883064 das man
-1.76202 das sie
-1.400813 das trocken
-0.8950248 das wasser -0.120532
-1.276335 dem himel
-0.7513515 dem wasser
-1.291207 den menschen
-1.179783 den tag
-1.291207 den wassern
-1.809406 der ander
-1.809406 der dritte
-1.809406 der erste
-1.311309 der feste -0.2910792
-1.302154 der festen -0.2910792
-1.809406 der f??nffte
-1.809406 der geist
-1.809406 der tieffe
-1.809406 der vierde
-1.750973 der wasser
-0.8365213 des himels -0.1667181
-1.193385 die erde
-1.200382 die feste
-1.645618 die festen
-1.665741 die finsternis
-1.645618 die nacht
-1.712385 die samlung
-1.712385 die sey
-0.7940786 dritte tag
-1.126189 ein menlin
-1.126189 ein vnterscheid
-0.8296059 eine feste
-0.8248137 er ,
-1.126189 er jn
-0.8994671 erde ,
-1.054594 erde .
-1.271789 erde war
-0.9628865 erden ,
-0.777611 erden . -0.2910792
-1.374068 erden vnter
-0.7692191 erf??llet das
-0.8296059 errege sich
-0.7940786 erste tag
-1.617517 es errege
-1.617517 es geschach -0.3054159
-1.55982 es gut -0.2910791
-1.617517 es samle
-1.577335 es war
-1.55982 es ward
-1.617517 es werde
-0.662631 euch vnd
-0.9628865 feste ,
-0.8783557 feste des -0.3054159
-1.374068 feste zwischen
-0.4873129 festen ,
-0.8026917 finster auff
-0.9245502 finsternis ,
-0.6801374 finsternis .
-0.7381428 fleuget .
-0.7381428 frewlin .
-0.662631 fruchtbar vnd
-0.7940786 f??nffte tag
-0.8264226 geist gottes
-0.8365213 geschach also -0.3054159
-0.8248137 geuogel ,
-1.126189 geuogel mehre
-1.356089 gott das
-1.548651 gott die
-1.658337 gott himel
-1.658337 gott nennet
-1.707237 gott sahe -0.1683487
-1.60004 gott schuff
-1.707237 gott segnet
-1.707237 gott setzt
-1.637316 gott sprach -0.4303546
-1.095403 gottes schuff
-1.126189 gottes schwebet
-0.5803539 gut war -0.1690297
-0.8994671 himel ,
-1.054594 himel .
-0.910476 himel vnd
-0.8248137 himels , -0.2910791
-1.126189 himels fleuget
-0.8264226 im meer
-0.8264226 jm zum
-0.6563753 jn ,
-0.8365213 lebendigen thieren
-0.6563753 leer ,
-0.793054 liecht ,
-1.202665 liecht .
-1.514228 liecht gut
-1.018379 liecht vnd
-1.563365 liecht vom
-0.8296059 liechter an
-0.820448 machet gott
-0.7692191 man das
-0.8248137 meer ,
-0.9514496 meer .
-0.8296059 mehre sich
-0.8365213 mehret euch
-0.662631 menlin vnd
-0.8365213 menschen jm
-1.106725 mit geuogel
-1.126189 mit webenden
-0.7940786 morgen der
-0.9514496 nacht .
-1.126189 nacht regierten
-0.8093764 nennet das
-1.326708 nennet die
-1.374068 nennet er
-0.6563753 regierten ,
-0.8248137 sahe ,
-1.003453 sahe das -0.2910791
-0.8296059 samle sich
-0.7940786 samlung der
-1.003453 scheidet das
-1.095403 scheidet gott
-0.820448 scheideten liecht
-0.8026917 scheinen auff
-0.8026917 schienen auff
-1.380259 schuff den
-1.369051 schuff er
-1.348556 schuff gott
-1.348556 schuff sie
-0.8026917 schwebet auff
-0.820448 segnet sie
-0.6563753 sehe ,
-0.8365213 seid fruchtbar
-0.8365213 seien liechter
-0.820448 setzt sie
-0.8264226 sey ein
-1.210839 sich auff
-0.7047036 sich das -0.2910791
-0.9700703 sie ,
-1.461302 sie an
-1.44783 sie ein
-1.491723 sie scheinen
-1.491723 sie schienen
-0.8365213 sondere ??rter
-0.4873129 sprach , -0.3035003
-1.224755 tag ,
-0.2585879 tag . -0.5272646
-1.236391 tag vnd
-0.6563753 thieren ,
-0.6563753 tieffe ,
-0.8248137 trocken ,
-1.126189 trocken sehe
-0.7940786 vber der
-0.7940786 vierde tag
-1.635476 vnd das
-2.07413 vnd den
-1.773633 vnd der
-1.219344 vnd die
-2.038263 vnd erden
-2.162897 vnd erf??llet
-2.07413 vnd es -0.1560608
-2.07413 vnd finsternis
-2.162897 vnd frewlin
-0.5219117 vnd gott -0.2330221
-2.162897 vnd lebendigen
-2.162897 vnd leer
-2.162897 vnd mehret
-2.038263 vnd mit
-2.162897 vnd morgen -0.5272646
-2.07413 vnd nennet
-2.038263 vnd scheidet
-2.162897 vnd scheideten
-1.977433 vnd schuff
-2.162897 vnd seien
-2.038263 vnd sprach
-1.276335 vnter dem
-0.7240854 vnter der
-0.8264226 vnterscheid zwischen
-0.8296059 vom finsternis
-0.8296059 von dem
-0.942232 war ,
-1.117095 war . -0.2910792
-1.405348 war finster
-1.405348 war w??st
-1.126189 ward aus -0.5272647
-1.095403 ward liecht
-1.190126 wasser .
-1.560618 wasser im
-1.509607 wasser mit
-1.525175 wasser nennet
-1.560618 wasser vber
-1.509607 wasser vnter
-0.8248137 wassern ,
-0.9514496 wassern .
-0.662631 webenden vnd
-1.126189 werde eine
-1.095403 werde liecht
-0.662631 w??st vnd
-0.5837108 zum bilde
-0.5803539 zwischen den -0.2910792
-0.6563753 ??rter ,
\3-grams:
-0.2664163 himels , das
-0.2953138 sprach , es
-0.08287352 also . </s>
-0.08594892 erden . </s>
-0.04780488 tag . </s>
-0.08594892 war . </s>
-0.1148677 aus abend vnd
-0.2251322 geschach also .
-0.127094 ward aus abend
-0.1413484 . da ward
-0.6817768 , das sie
-0.304497 sahe das es
-0.2568364 sich das wasser
-0.2885505 zwischen den wassern
-0.2387149 feste des himels
-0.5832961 , es werde
-0.2988574 das es gut
-0.4966065 vnd es geschach
-0.2548411 der feste des
-0.1837682 der festen ,
-0.2387149 es geschach also
-1.0289 vnd gott nennet
-0.8628953 vnd gott sahe
-0.6529579 vnd gott sprach
-0.2056073 es gut war
-0.375968 des himels ,
-0.1245164 vnd morgen der
-0.4104192 gott sahe das
-0.1251462 gott sprach ,
-0.8606176 , vnd die
-0.6207225 , vnd es
-0.1923093 . vnd gott
-0.1517768 abend vnd morgen
-0.4269534 gut war .
-0.1395276 da ward aus
-0.5754681 das wasser vnter
\end\
-------------- next part --------------
1 am anfang schuff gott himel vnd erden .
2 vnd die erde war w?st vnd leer , vnd es war finster auff der tieffe , vnd der geist gottes schwebet auff dem wasser .
3 vnd gott sprach , es werde liecht , vnd es ward liecht .
4 vnd gott sahe , das das liecht gut war , da scheidet gott das liecht vom finsternis .
5 vnd nennet das liecht , tag , vnd die finsternis , nacht . da ward aus abend vnd morgen der erste tag .
6 vnd gott sprach , es werde eine feste zwischen den wassern , vnd die sey ein vnterscheid zwischen den wassern .
7 da machet gott die feste , vnd scheidet das wasser vnter der festen , von dem wasser vber der festen , vnd es geschach also .
8 vnd gott nennet die festen , himel . da ward aus abend vnd morgen der ander tag .
9 vnd gott sprach , es samle sich das wasser vnter dem himel , an sondere ?rter , das man das trocken sehe , vnd es geschach also .
10 vnd gott nennet das trocken , erde , vnd die samlung der wasser nennet er , meer . vnd gott sahe das es gut war .
13 da ward aus abend vnd morgen der dritte tag .
15 vnd seien liechter an der feste des himels , das sie scheinen auff erden , vnd es geschach also .
17 vnd gott setzt sie an die feste des himels , das sie schienen auff die erde .
18 vnd den tag vnd die nacht regierten , vnd scheideten liecht vnd finsternis . vnd gott sahe das es gut war .
19 da ward aus abend vnd morgen der vierde tag .
20 vnd gott sprach , es errege sich das wasser mit webenden vnd lebendigen thieren , vnd mit geuogel , das auff erden vnter der feste des himels fleuget .
22 vnd gott segnet sie , vnd sprach , seid fruchtbar vnd mehret euch vnd erf?llet das wasser im meer , vnd das geuogel mehre sich auff erden .
23 da ward aus abend vnd morgen der f?nffte tag .
27 vnd gott schuff den menschen jm zum bilde , zum bilde gottes schuff er jn , vnd schuff sie ein menlin vnd frewlin .
-------------- next part --------------
1 am anfang schuf gott himmel und erde .
2 und die erde war w?st und leer , und es war finster auf der tiefe ; und der geist gottes schwebte auf dem wasser .
3 und gott sprach : es werde licht ! und es ward licht .
4 und gott sah , da? das licht gut war . da schied gott das licht von der finsternis .
5 und nannte das licht tag und die finsternis nacht . da ward aus abend und morgen der erste tag .
6 und gott sprach : es werde eine feste zwischen den wassern , und die sei ein unterschied zwischen den wassern .
7 da machte gott die feste und schied das wasser unter der feste von dem wasser ?ber der feste . und es geschah also .
8 und gott nannte die feste himmel . da ward aus abend und morgen der andere tag .
9 und gott sprach : es sammle sich das wasser unter dem himmel an besondere ?rter , da? man das trockene sehe . und es geschah also .
10 und gott nannte das trockene erde , und die sammlung der wasser nannte er meer . und gott sah , da? es gut war .
13 da ward aus abend und morgen der dritte tag .
15 und seien lichter an der feste des himmels , da? sie scheinen auf erden . und es geschah also .
17 und gott setzte sie an die feste des himmels , da? sie schienen auf die erde .
18 und den tag und die nacht regierten und schieden licht und finsternis . und gott sah , da? es gut war .
19 da ward aus abend und morgen der vierte tag .
20 und gott sprach : es errege sich das wasser mit webenden und lebendigen tieren , und gev?gel fliege auf erden unter der feste des himmels .
22 und gott segnete sie und sprach : seid fruchtbar und mehrt euch und erf?llt das wasser im meer ; und das gefieder mehre sich auf erden .
23 da ward aus abend und morgen der f?nfte tag .
27 und gott schuf den menschen ihm zum bilde , zum bilde gottes schuf er ihn ; und schuf sie einen mann und ein weib .
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 88, Issue 48
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 88, Issue 48"
Post a Comment