Moses-support Digest, Vol 89, Issue 50

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Issue about sentence segmentation (Arnaud Gicquel)
2. Re: Problem in Web Based Version of MT System using MOSES -
Please help (Hieu Hoang)
3. fail to build Moses (Tiansi Dong)
4. KenLM memory usage (Alexandra Birch)


----------------------------------------------------------------------

Message: 1
Date: Tue, 18 Mar 2014 15:20:38 +0100
From: Arnaud Gicquel <arnaud.gicquel@linguacustodia.com>
Subject: [Moses-support] Issue about sentence segmentation
To: moses-support@MIT.EDU
Message-ID:
<CAOWuFKS1wXR=2AT7zYra3H-Vhu3+h5RdaPQWRKJ1EtY4XZrhmg@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi all

I am trying to develop a specific segmenter. The goal is to send Moses
decoder sentences instead of large textual flows syntactically incoherent.
In order to integrate this segmenter in an automatic workflow of documents
translation. I would define as a sentence delimiter any character that the
decoder does not take into account in its statistics.

Is there a completely neutral character (I don't want it to be considered
unknown) that I could use as a delimiter?

Thank you for your help

Arnaud Gicquel

--
Lingua Custodia
1, Place Charles de Gaulle
78180 Montigny le Bretonneux - France
Tel : 33 1 30 44 04 23
Email : arnaud.gicquel@linguacustodia.com
Website : www.linguacustodia.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140318/710dbe9e/attachment-0001.htm

------------------------------

Message: 2
Date: Thu, 20 Mar 2014 13:49:41 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Problem in Web Based Version of MT System
using MOSES - Please help
To: Vishal Goyal(????? ????) <vishal.pup@gmail.com>
Cc: moses-support <moses-support@mit.edu>, Barry Haddow
<bhaddow@staffmail.ed.ac.uk>
Message-ID:
<CAEKMkbgUawSdh6noxxfoMemGkLMB-HDD1Jg9W7tWoxDFFsVPsg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

maybe try the code in
contrib/server/Translation-web



On 19 March 2014 17:04, Vishal Goyal(????? ????) <vishal.pup@gmail.com>wrote:

> Thanks for kind reply.
> Then kindly suggest how can we make the web translation reality? Which new
> we need to use...
>
>
>
> On Wed, Mar 19, 2014 at 2:07 PM, Barry Haddow <bhaddow@staffmail.ed.ac.uk>wrote:
>
>> Hi Vishal
>>
>> The web translation components that you mention are quite old and haven't
>> been used much in a while.
>>
>> As far as I can see, the main problem is that the translate.cgi expects
>> to have many copies of the daemon.pl running, all listening on different
>> ports. Each one should wrap a different instance of Moses. So this web
>> translation system is not multi-threaded (it was written before Moses had
>> threads) it's multi-process,
>>
>> cheers - Barry
>>
>>
>> On 18/03/14 15:02, Vishal Goyal(????? ????) wrote:
>>
>>> Respected All,
>>> Greetings
>>>
>>> We have installed the moses server and web server on a single machine on
>>> linux platform. when tested on the local host the system work fine, when we
>>> installed the system on web server for public use. The system some work
>>> fine but most of the we are not getting the translation of the input text
>>> instead the input text is transliterated in the post processing script
>>> written in transliterate.pl <http://transliterate.pl>.
>>>
>>> Moses server is running as daemon.pl <http://daemon.pl>. The index.cgi
>>> is being used to take user input and translate.cgi start the moses thread
>>> for tranlation.
>>>
>>>
>>> When error log is inspected it show that only one thread of moses is
>>> running and all other threads are terminated with the error message (error
>>> log attached.)
>>>
>>> Please also find the attached source code of daemon.pl <http://daemon.pl>,
>>> index.cgi and translate.cgi
>>>
>>>
>>>
>>> --
>>> *Regards,*
>>>
>>> Vishal Goyal,
>>> Ph.D., M.Tech., MCA, M.C.S.D.
>>> Assistant Professor(Stage III) and Placement Coordinator,
>>> Department of Computer Science,
>>> Punjabi University Patiala-147002
>>> [*Online Hindi to Punjabi Machine Translation Tool -*
>>> http://h2p.learnpunjabi.org ]
>>> *[Research Cell: An International Journal of Engineering Sciences,
>>> http://ijoes.vidyapublications.com]*
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>
>>
>> --
>> The University of Edinburgh is a charitable body, registered in
>> Scotland, with registration number SC005336.
>>
>>
>
>
> --
> *Regards,*
> Vishal Goyal,
> Ph.D., M.Tech., MCA, M.C.S.D.
> Assistant Professor(Stage III) and Placement Coordinator,
> Department of Computer Science,
> Punjabi University Patiala-147002
> [*Online Hindi to Punjabi Machine Translation Tool -*
> http://h2p.learnpunjabi.org ]
> *[Research Cell: An International Journal of Engineering Sciences,
> http://ijoes.vidyapublications.com <http://ijoes.vidyapublications.com>]*
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140320/c8a64161/attachment-0001.htm

------------------------------

Message: 3
Date: Thu, 20 Mar 2014 15:06:39 +0100
From: Tiansi Dong <tian1shi2@gmail.com>
Subject: [Moses-support] fail to build Moses
To: moses-support@MIT.EDU
Message-ID:
<CA+_6WrxVOe3t_8LTqi1dVuUizbT2smYHxtrHAeUkNZJ6TzkbMQ@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

the command I type is: ./bjam -j8

many thanks for the support

-tiansi dong
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140320/9b31a771/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.gz
Type: application/x-gzip
Size: 1530 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140320/9b31a771/attachment-0001.bin

------------------------------

Message: 4
Date: Thu, 20 Mar 2014 14:32:10 +0000
From: Alexandra Birch <lexi.birch@gmail.com>
Subject: [Moses-support] KenLM memory usage
To: moses-support@MIT.EDU
Message-ID:
<CA+h82t6p-39pOFuOg+Ut3j851gv2QN075DU=nsDgSRLZ=rv_aA@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi there,

I want to run 4 MT servers at the same time on a machine with limited
memory. Kenlm seems to reserve the amount of memory which the language
model would have taken if it had been loaded into memory. So I don't have
enough memory to run all these servers and the machine grinds to a halt if
I try. Is there any flag I could use which would limit the amount of memory
reserved?

Lexi
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140320/de6f7bc4/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 89, Issue 50
*********************************************

Tweet