Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Filtering Issue (Vishal Goyal (????? ????))
2. Re: Can't build moses server (Peter Kleiweg)
3. How to implement "Syntax Based Statistical Machine
Translation" (Asad A.Malik)
4. Re: Can't build moses server (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Thu, 10 Jul 2014 22:07:08 +0530
From: Vishal Goyal(????? ????) <vishal.pup@gmail.com>
Subject: Re: [Moses-support] Filtering Issue
To: Judah Schvimer <judah.schvimer@mongodb.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CADAAq5yGqpY29A+UUjH0Z0ZNQ9RkqwX6m+ouMZ3xN+O4HFFBAw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hello friends,
I have developed Hindi to Punjabi MachineTranslation System using MOSES
Toolkit and installed on dedicated Server and the web address for the same
is http://116.193.161.115/cgi-bin/hi2pu/index.cgi
This is working fine. Now, I am facing the problem is that When I tried
load testing, I mean I opened 4-5 tabs in the web browser and given input
text for translation, It started giving Internal Server Error. Then after 5
minutes it started working but it always fails to handle multiple requests.
Kindly help in resoving this issue.
On Thu, Jul 3, 2014 at 7:20 PM, Judah Schvimer <judah.schvimer@mongodb.com>
wrote:
> Hi,
>
> I have a script that basically does all of the training steps for me and
> it's worked many times before, but suddenly I got this error with a
> different corpus. It doesn't occur when I use the moses.ini file in
> train/model/ or in mert-work/, just when I use the one in filtered/. Any
> idea what's wrong? Something appears to be weird around the 39-grams step.
>
> Defined parameters (per moses.ini or switch):
> config: /home/judah/archive8/3/working/filtered/moses.ini
> distortion-limit: 6
> feature: UnknownWordPenalty WordPenalty PhrasePenalty
> PhraseDictionaryBinary name=TranslationModel0 table-limit=20 num-features=4
> path=/home/judah/archive8/3/working/filtered/phrase-table.0-0.1.1
> input-factor=0 output-factor=0 LexicalReordering name=LexicalReordering0
> num-features=6 type=hier-msd-bidirectional-fe-allff input-factor=0
> output-factor=0
> path=/home/judah/archive8/3/working/filtered/reordering-table.hier-msd-bidirectional-fe
> Distortion IRSTLM name=LM0 factor=0 path=/home/judah/archive8/3/lm/
> train.en-es.blm.es order=3
> input-factors: 0
> mapping: 0 T 0
> weight: LexicalReordering0= 0.389589 0.0418995 0.0286706 0.0187875
> 0.0287628 0.00958344 Distortion0= 0.0583275 LM0= -0.00740405 WordPenalty0=
> 0.0123212 PhrasePenalty0= 0.0413057 TranslationModel0= 0.0360237 0.040722
> 0.266723 0.0198795 UnknownWordPenalty0= 1
> /home/judah/mosesdecoder/bin
> line=UnknownWordPenalty
> FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
> line=WordPenalty
> FeatureFunction: WordPenalty0 start: 1 end: 1
> line=PhrasePenalty
> FeatureFunction: PhrasePenalty0 start: 2 end: 2
> line=PhraseDictionaryBinary name=TranslationModel0 table-limit=20
> num-features=4
> path=/home/judah/archive8/3/working/filtered/phrase-table.0-0.1.1
> input-factor=0 output-factor=0
> FeatureFunction: TranslationModel0 start: 3 end: 6
> line=LexicalReordering name=LexicalReordering0 num-features=6
> type=hier-msd-bidirectional-fe-allff input-factor=0 output-factor=0
> path=/home/judah/archive8/3/working/filtered/reordering-table.hier-msd-bidirectional-fe
> FeatureFunction: LexicalReordering0 start: 7 end: 12
> Initializing LexicalReordering..
> line=Distortion
> FeatureFunction: Distortion0 start: 13 end: 13
> line=IRSTLM name=LM0 factor=0 path=/home/judah/archive8/3/lm/
> train.en-es.blm.es order=3
> FeatureFunction: LM0 start: 14 end: 14
> Loading UnknownWordPenalty0
> Loading WordPenalty0
> Loading PhrasePenalty0
> Loading LexicalReordering0
> binary file loaded, default OFF_T: -1
> Loading Distortion0
> Loading LM0
> In LanguageModelIRST::Load: nGramOrder = 3
> Language Model Type of /home/judah/archive8/3/lm/train.en-es.blm.es is 1
> Language Model Type is 1
> mmap
> loadtxt_ram()
> 3-grams: reading 0 entries
> done level 3
> 1-grams: reading 0 entries
> done level 1
> 8-grams: reading 0 entries
> done level 8
> 2-grams: reading 0 entries
> done level 2
> 39-grams: reading 3991252117 entries
> moses: util.cpp:289: int parseline(std::istream&, int, ngram&, float&,
> float&): Assertion `howmany == (Order+ 1) || howmany == (Order + 2)' failed.
> [1] 5062 abort (core dumped) /home/judah/mosesdecoder/bin/moses -f <
> >
>
>
> Thanks,
> Judah
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
--
*Regards,*
Vishal Goyal,
Ph.D., M.Tech., MCA, M.C.S.D.
Assistant Professor(Stage III),
Department of Computer Science,
Punjabi University Patiala-147002
*[ICON 2014- http://ltrc.iiit.ac.in/icon/2014/
<http://ltrc.iiit.ac.in/icon/2014/>]*
[*Online Hindi to Punjabi Machine Translation Tool -*
http://h2p.learnpunjabi.org ]
*[Research Cell: An International Journal of Engineering Sciences,
http://ijoes.vidyapublications.com <http://ijoes.vidyapublications.com>]*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140710/d41a5b9b/attachment-0001.htm
------------------------------
Message: 2
Date: Thu, 10 Jul 2014 18:47:29 +0200 (CEST)
From: Peter Kleiweg <p.c.j.kleiweg@rug.nl>
Subject: Re: [Moses-support] Can't build moses server
To: moses-support@mit.edu
Message-ID: <alpine.DEB.2.00.1407101843360.3244@pebbe>
Content-Type: TEXT/PLAIN; charset=US-ASCII
Peter Kleiweg schreef op de 10e dag van de hooimaand van het jaar 2014:
>
> Hi,
>
> I can't build the moses server. I have tried with boost versions
> 1.42.0, 1.47.0 and 1.55.0, all give the same result.
I installed another version of xmlrpc-c, and now building
mosesserver succeeds.
--
Peter Kleiweg
http://pkleiweg.home.xs4all.nl/
------------------------------
Message: 3
Date: Thu, 10 Jul 2014 03:26:43 -0700
From: "Asad A.Malik" <asad_12204@yahoo.com>
Subject: [Moses-support] How to implement "Syntax Based Statistical
Machine Translation"
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<1404988003.79848.YahooMailNeo@web140201.mail.bf1.yahoo.com>
Content-Type: text/plain; charset="iso-8859-1"
Hi All,
I've successfully developed "Phrase Based Statistical Machine Translation" for Urdu to English. Now I wanted to move forward to the "Syntax Based". I wanted to know that how can I develop Syntax Based SMT? Do I need linguistic rules in order to develop it?
?
Thanks,
Mr. Asad
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140710/68e39dee/attachment-0001.htm
------------------------------
Message: 4
Date: Thu, 10 Jul 2014 22:13:00 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Can't build moses server
To: Peter Kleiweg <p.c.j.kleiweg@rug.nl>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbjHobkniYi-ePtb2VUDF1Ymay2S0u8f-2yjijRTzq1KTw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
great. Which version worked for you? I tried it the most recent version and
it got the same error
On 10 July 2014 17:47, Peter Kleiweg <p.c.j.kleiweg@rug.nl> wrote:
> Peter Kleiweg schreef op de 10e dag van de hooimaand van het jaar 2014:
>
> >
> > Hi,
> >
> > I can't build the moses server. I have tried with boost versions
> > 1.42.0, 1.47.0 and 1.55.0, all give the same result.
>
> I installed another version of xmlrpc-c, and now building
> mosesserver succeeds.
>
>
>
> --
> Peter Kleiweg
> http://pkleiweg.home.xs4all.nl/
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140710/3d37bdde/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 93, Issue 13
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 93, Issue 13"
Post a Comment