Moses-support Digest, Vol 107, Issue 63

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Regarding Parallel Corpus Repository (Matthias Huck)
2. Re: Regarding Parallel Corpus Repository (Barry Haddow)
3. Re: Existing documentation to use own language models (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Sun, 27 Sep 2015 17:26:48 +0100
From: Matthias Huck <mhuck@inf.ed.ac.uk>
Subject: Re: [Moses-support] Regarding Parallel Corpus Repository
To: nakul sharma <nakul777@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <1443371208.2078.8.camel@inf.ed.ac.uk>
Content-Type: text/plain; charset="UTF-8"

Hi,

The Hindi-English language pair was part of the WMT shared translation
task in 2014. See the following website for download links of training
data and dev/test sets:
http://www.statmt.org/wmt14/translation-task.html

Cheers,
Matthias

On Sun, 2015-09-27 at 20:15 +0530, nakul sharma wrote:
> Dear All,
>
> Is there any online repository of parallel corpus for Indian Regional
> languages ? Bulding from scratch is very tedious task and quite error
> prone? I am looking for English-to any North Indian language pair
> (Punjabi, Hindi, Urdu).
>
>



--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

Message: 2
Date: Sun, 27 Sep 2015 20:40:16 +0100
From: Barry Haddow <bhaddow@inf.ed.ac.uk>
Subject: Re: [Moses-support] Regarding Parallel Corpus Repository
To: nakul sharma <nakul777@gmail.com>, moses-support
<moses-support@mit.edu>
Message-ID: <56084620.8040000@inf.ed.ac.uk>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

Hi Nakul

The Emille project released parallel corpora for several South Asian
languages
http://catalog.elra.info/product_info.php?products_id=696

cheers - Barry

On 27/09/15 15:45, nakul sharma wrote:
> Dear All,
>
> Is there any online repository of parallel corpus for Indian Regional
> languages ? Bulding from scratch is very tedious task and quite error
> prone? I am looking for English-to any North Indian language pair
> (Punjabi, Hindi, Urdu).
>
>


--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

Message: 3
Date: Mon, 28 Sep 2015 09:57:24 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Existing documentation to use own
language models
To: Arturo Argueta <arturoargueta@gmail.com>, moses-support
<moses-support@mit.edu>
Message-ID: <560900F4.3020602@gmail.com>
Content-Type: text/plain; charset="utf-8"

make a copy of SkeletonLM and name it xLM. Add it to Factory.cpp

In the moses.ini file, use xLM instead of KENLM or IRSTLM

On 28/09/2015 03:24, Arturo Argueta wrote:
> Thanks for reply Hieu.
> I've been digging through the moses code for the last couple of days
> trying to modify SkeletonLM, and I have a couple of questions.
>
> - on the LM/ directory there's support for other Language Models such
> as SRI,RDLM, etc. How can I debug my language model? e.g. xLM. I
> assume that I have to modify the Jamfile first to include my cpp files
> and headers, but do you have any suggestions on testing?
> - I tried finding on moses way to switch language models (I know KenLM
> is default), but is there any way to use my prototype language model
> (or SkeletonLM) for testing?
>
> Thanks for the advise.
>
> Arturo
>
>
> On Wed, Sep 23, 2015 at 7:46 AM, Hieu Hoang <hieuhoang@gmail.com
> <mailto:hieuhoang@gmail.com>> wrote:
>
> there's a example language model code
> moses/LM/SkeletonLM.*
>
>
>
> On 21/09/2015 19:24, Arturo Argueta wrote:
>> I was wondering if there's any documentation out there on how to
>> use/integrate a self-made LM on moses.
>> Any pointers will be appreciated.
>>
>> Thanks
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> --
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
>

--
Hieu Hoang
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150928/ad83c411/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 107, Issue 63
**********************************************

Tweet