Moses-support Digest, Vol 92, Issue 15

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Supporting lattice input in Moses server (Barry Haddow)
2. Re: Moses: Special Characters (Hieu Hoang)
3. Re: Supporting lattice input in Moses server (Hieu Hoang)
4. Re: Supporting lattice input in Moses server (Hala Almaghout)


----------------------------------------------------------------------

Message: 1
Date: Fri, 06 Jun 2014 11:05:40 +0100
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] Supporting lattice input in Moses server
To: Hala Almaghout <halmaghout@computing.dcu.ie>, Hieu Hoang
<Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <3vwnvv06wlhc7w7dkt1btngf.1402049140649@email.android.com>
Content-Type: text/plain; charset=utf-8

Hi Hala

I would not expect this to work. Why do you need it? It may not be that hard to add.

Cheers - Barry

Hala Almaghout <halmaghout@computing.dcu.ie> wrote:

>Hi Hieu,
>
>Yes I tried mosses server with lattice input using this command to start
>the server:
>
>mosesserver --server-port 9090 -inputtype 2 -f moses.ini -threads 8
>
>However it seems that the lattice is never recognised, it's translated
>literally with brackets and commas.
>
>I used the same moses.ini file with normal moses and the lattice was
>recognised and translated correctly.
>
>Many thanks,
>
>Best,
>
>Hala
>
>
>On 6 June 2014 09:54, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:
>
>> there's no reason it shouldn't. Have you tried it?
>>
>>
>> On 3 June 2014 14:43, Hala Almaghout <halmaghout@computing.dcu.ie> wrote:
>>
>>> Hi,
>>>
>>> Does Moses server support lattice input?
>>>
>>>
>>> Best,
>>>
>>> Hala
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>>
>> --
>> Hieu Hoang
>> Research Associate
>> University of Edinburgh
>> http://www.hoang.co.uk/hieu
>>
>>
>
>_______________________________________________
>Moses-support mailing list
>Moses-support@mit.edu
>http://mailman.mit.edu/mailman/listinfo/moses-support

--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.




------------------------------

Message: 2
Date: Fri, 6 Jun 2014 11:07:24 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Moses: Special Characters
To: Andreas Dolinsek <andreas.dolinsek@gmail.com>, moses-support
<moses-support@mit.edu>
Message-ID:
<CAEKMkbgJ=Gzah8mjeQwaxgTpWgwqy2-v1mWPEH-xhbNyT-Bu2w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

you have to escape certain characters. This is provided by the script
scripts/tokenizer/escape-special-chars.perl

You should also remove non-printing characters with the script
scripts/tokenizer/remove-non-printing-char.perl

of course, tokenize your data using the same method you used to tokenize
the training data



On 6 June 2014 10:48, Andreas Dolinsek <andreas.dolinsek@gmail.com> wrote:

> Dear Hieu Hoang,
>
> my name is Andreas and I work for a company called Sonico Mobile, which
> ships translation apps (iTranslate) to millions of people with over 4
> million translation requests per day.
> Check out our website if you are interested http://www.itranslateapp.com
> .
>
> I installed Moses on a highly scaleable platform and wrote an API for it
> (for testing), because we would like to try it out for some use cases. I
> trained it with the europarl parallel corpus.
>
> I have a really basic problem now, I don?t know how to translate special
> chars. I call via my python tornado server:
>
> echo <Text> | moses -f <config-file> -v 0 -threads all
>
> Non-ASCII chars result in an error. How is it possible to feed it with
> special chars?
>
> Thank you very much!
>
> PS: If everything works out, of course we will provide an API access :-)
> --
> Andreas Dolinsek
> http://www.sonicomobile.com
>



--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140606/b54d54c2/attachment-0001.htm

------------------------------

Message: 3
Date: Fri, 6 Jun 2014 11:08:12 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Supporting lattice input in Moses server
To: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbirgFUkSyJeAJZoB7DzRKsBXu3=tdPdWavBe40_xg17Bw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

put
[inputtype]
2
into your ini file instead


On 6 June 2014 11:05, Barry Haddow <bhaddow@staffmail.ed.ac.uk> wrote:

> Hi Hala
>
> I would not expect this to work. Why do you need it? It may not be that
> hard to add.
>
> Cheers - Barry
>
> Hala Almaghout <halmaghout@computing.dcu.ie> wrote:
>
> >Hi Hieu,
> >
> >Yes I tried mosses server with lattice input using this command to start
> >the server:
> >
> >mosesserver --server-port 9090 -inputtype 2 -f moses.ini -threads 8
> >
> >However it seems that the lattice is never recognised, it's translated
> >literally with brackets and commas.
> >
> >I used the same moses.ini file with normal moses and the lattice was
> >recognised and translated correctly.
> >
> >Many thanks,
> >
> >Best,
> >
> >Hala
> >
> >
> >On 6 June 2014 09:54, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:
> >
> >> there's no reason it shouldn't. Have you tried it?
> >>
> >>
> >> On 3 June 2014 14:43, Hala Almaghout <halmaghout@computing.dcu.ie>
> wrote:
> >>
> >>> Hi,
> >>>
> >>> Does Moses server support lattice input?
> >>>
> >>>
> >>> Best,
> >>>
> >>> Hala
> >>>
> >>> _______________________________________________
> >>> Moses-support mailing list
> >>> Moses-support@mit.edu
> >>> http://mailman.mit.edu/mailman/listinfo/moses-support
> >>>
> >>>
> >>
> >>
> >> --
> >> Hieu Hoang
> >> Research Associate
> >> University of Edinburgh
> >> http://www.hoang.co.uk/hieu
> >>
> >>
> >
> >_______________________________________________
> >Moses-support mailing list
> >Moses-support@mit.edu
> >http://mailman.mit.edu/mailman/listinfo/moses-support
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140606/c63c1150/attachment-0001.htm

------------------------------

Message: 4
Date: Fri, 6 Jun 2014 11:17:39 +0100
From: Hala Almaghout <halmaghout@computing.dcu.ie>
Subject: Re: [Moses-support] Supporting lattice input in Moses server
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>, Barry Haddow
<bhaddow@staffmail.ed.ac.uk>
Message-ID:
<CAE9fu9WVA53nc=Jc3axU7ngv9ocL=QitrVC4CF=ouZqP57Esyg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

I need to represent different source tokenisations using lattice and then
translate it using moses server.

I've put

[inputtype]
2

in the moses.ini file but also didn't work.

Best,

Hala


On 6 June 2014 11:08, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:

> put
> [inputtype]
> 2
> into your ini file instead
>
>
> On 6 June 2014 11:05, Barry Haddow <bhaddow@staffmail.ed.ac.uk> wrote:
>
>> Hi Hala
>>
>> I would not expect this to work. Why do you need it? It may not be that
>> hard to add.
>>
>> Cheers - Barry
>>
>> Hala Almaghout <halmaghout@computing.dcu.ie> wrote:
>>
>> >Hi Hieu,
>> >
>> >Yes I tried mosses server with lattice input using this command to start
>> >the server:
>> >
>> >mosesserver --server-port 9090 -inputtype 2 -f moses.ini -threads 8
>> >
>> >However it seems that the lattice is never recognised, it's translated
>> >literally with brackets and commas.
>> >
>> >I used the same moses.ini file with normal moses and the lattice was
>> >recognised and translated correctly.
>> >
>> >Many thanks,
>> >
>> >Best,
>> >
>> >Hala
>> >
>> >
>> >On 6 June 2014 09:54, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:
>> >
>> >> there's no reason it shouldn't. Have you tried it?
>> >>
>> >>
>> >> On 3 June 2014 14:43, Hala Almaghout <halmaghout@computing.dcu.ie>
>> wrote:
>> >>
>> >>> Hi,
>> >>>
>> >>> Does Moses server support lattice input?
>> >>>
>> >>>
>> >>> Best,
>> >>>
>> >>> Hala
>> >>>
>> >>> _______________________________________________
>> >>> Moses-support mailing list
>> >>> Moses-support@mit.edu
>> >>> http://mailman.mit.edu/mailman/listinfo/moses-support
>> >>>
>> >>>
>> >>
>> >>
>> >> --
>> >> Hieu Hoang
>> >> Research Associate
>> >> University of Edinburgh
>> >> http://www.hoang.co.uk/hieu
>> >>
>> >>
>> >
>> >_______________________________________________
>> >Moses-support mailing list
>> >Moses-support@mit.edu
>> >http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>> --
>> The University of Edinburgh is a charitable body, registered in
>> Scotland, with registration number SC005336.
>>
>>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140606/bafaedee/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 92, Issue 15
*********************************************

Tweet