Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Prepackaged MT research platform (amittai)
2. Re: Prepackaged MT research platform (Marcin Junczys-Dowmunt)
3. Re: Prepackaged MT research platform (amittai)
4. Some addition suggestions to English non-breaking prefixes
(Ozan ?a?layan)
----------------------------------------------------------------------
Message: 1
Date: Thu, 2 Jul 2015 13:29:54 -0400
From: amittai <amittai.box@gmail.com>
Subject: [Moses-support] Prepackaged MT research platform
To: moses-support@mit.edu
Message-ID: <55957512.1070608@gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Hi --
There are several free pre-packaged Moses distributions, many of which
are listed here:
http://www.statmt.org/moses/?n=Moses.Packages
However I don't know of any free hosting service; as you point out,
running a server is expensive.
I have just released Box, a pre-packaged machine on the Amazon cloud
that comes with Moses (and others[*]) already installed. This was my
personal project at the MT Marathon in May, and I guess this is the
release announcement I forgot to make :)
Box isn't free to use, but does have the advantage that you only pay for
the resources you use (and all the machines start exactly the same). The
per-hour prices are based on Amazon's basic fees, so you can do this all
yourself also but you'll save less than 10%. The per-hour advantage is
that if you have other work to do for a week (or half a day), you kill
the virtual machine and don't pay for that time. Also you can launch a
tiny machine just to decode, and a bigger one to train, and turn them
off as soon as you finish. This might help your hardware budget go
farther. Also, for the same budget, you can run bigger machines, or
simply more of them, and get more experimental throughput for your money.
Finally, I think you can also apply directly to Amazon to get research
funding in the form of free credit for use on their cloud:
https://aws.amazon.com/grants/
and that might be your best bet to get free hosting. You can of course
use the Amazon credits to run your own machine instead of one of mine,
but also of course I think my way is a little easier :)
Box is currently in stable beta (v2015-05-25).
You can join the mailing list for announcements/questions here:
https://groups.google.com/d/forum/boxresearch
Box itself you get by signing up (free) with here:
https://portal.aws.amazon.com/gp/aws/user/subscription/index.html?offeringCode=49B2A70F
(it takes a few seconds to load; don't know why).
After you sign up for Box, you can launch an instance directly via this
link:
https://console.aws.amazon.com/ec2/v2/home?region=us-east-1#LaunchInstanceWizard:ami=ami-1d678876
or by searching for the AMI code "ami-1d678876"
They're normal machines; it will boot in about a minute and then you
just ssh in as usual (or use one of the Apple or Windows interfaces) and
use your regular tools and scripts.
You have complete sudo access to the machine so you can update or add
anything you like. Privacy controls are pretty good; you control who can
can access your machine. Useful for working on restricted data.
There are general instructions here:
https://box.groovehq.com/knowledge_base/topics/box-how
along with some hints on how to avoid getting hit with some of the
Amazon fees. There are also some Moses-specific comments here:
https://box.groovehq.com/knowledge_base/topics/moses-on-box
My goal is to make it easy for everyone to get work done. As such, let
me know if you have any questions or if there's anything at all that
isn't clear about the process or instructions.
Cheers,
~amittai
[*] Also includes cdec installed. Everything is installed under /opt/
directory, so it's a neat and tidy environment. The full list of
installed tools is:
cdec, cmph, ducttape, eigen3, fast_align, giza-pp, kenlm, mgiza,
mosesdecoder, multeval, rnnlm, salm, scala, vowpal-wabbit, and word2vec,
with more on the way. Suggestions welcome!
On 7/2/15 08:00, Vishal Goyal(????? ????) wrote:
> Hello All,
> Do u know anyone providing free service of server where MOSES is pre
> installed and we can install our MT system there.
> Else It is very costly to bear the cost from own pocket.
> It approx. costs about 6k INR rupees every month for hosting MT
> systemdeveloped using MOSES.
>
>
> --
> *Regards,*
> Vishal Goyal,
> Ph.D., M.Tech., MCA, M.C.S.D.
> Assistant Professor(Stage III),
> Department of Computer Science,
> Punjabi University Patiala-147002.
>
> *_NLP International Conference on 18-19 Sept, 2015: regICON2015_*
> http://regICON2015.learnpunjabi.org
>
> *_Machine Translation Systems:_*
> [*Online Hindi to Punjabi Machine Translation Tool -*
> http://h2p.learnpunjabi.org ]
> [*Statistical Approach Based Hindi to Punjabi Machine Translation System *
> - http://statmt.org/~vishal/hp/index.cgi
> - http://tdil-dc.in/hi2pu/index.cgi
> ]
> *_Online Journal: _[Research Cell: An International Journal of
> Engineering Sciences, http://ijoes.vidyapublications.com]*
> *_Book: _A Simplified Approach to Data Structures, Shroff Publications
> and Distributors*
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
------------------------------
Message: 2
Date: Thu, 02 Jul 2015 19:45:22 +0200
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Prepackaged MT research platform
To: moses-support@mit.edu
Message-ID: <559578B2.30606@amu.edu.pl>
Content-Type: text/plain; charset=utf-8; format=flowed
Cool. What is word2vec used for in that context?
Best,
Marcin
W dniu 02.07.2015 o 19:29, amittai pisze:
> Hi --
>
> There are several free pre-packaged Moses distributions, many of which
> are listed here:
> http://www.statmt.org/moses/?n=Moses.Packages
>
> However I don't know of any free hosting service; as you point out,
> running a server is expensive.
>
> I have just released Box, a pre-packaged machine on the Amazon cloud
> that comes with Moses (and others[*]) already installed. This was my
> personal project at the MT Marathon in May, and I guess this is the
> release announcement I forgot to make :)
>
> Box isn't free to use, but does have the advantage that you only pay for
> the resources you use (and all the machines start exactly the same). The
> per-hour prices are based on Amazon's basic fees, so you can do this all
> yourself also but you'll save less than 10%. The per-hour advantage is
> that if you have other work to do for a week (or half a day), you kill
> the virtual machine and don't pay for that time. Also you can launch a
> tiny machine just to decode, and a bigger one to train, and turn them
> off as soon as you finish. This might help your hardware budget go
> farther. Also, for the same budget, you can run bigger machines, or
> simply more of them, and get more experimental throughput for your money.
>
> Finally, I think you can also apply directly to Amazon to get research
> funding in the form of free credit for use on their cloud:
> https://aws.amazon.com/grants/
> and that might be your best bet to get free hosting. You can of course
> use the Amazon credits to run your own machine instead of one of mine,
> but also of course I think my way is a little easier :)
>
> Box is currently in stable beta (v2015-05-25).
> You can join the mailing list for announcements/questions here:
> https://groups.google.com/d/forum/boxresearch
>
> Box itself you get by signing up (free) with here:
> https://portal.aws.amazon.com/gp/aws/user/subscription/index.html?offeringCode=49B2A70F
> (it takes a few seconds to load; don't know why).
>
> After you sign up for Box, you can launch an instance directly via this
> link:
> https://console.aws.amazon.com/ec2/v2/home?region=us-east-1#LaunchInstanceWizard:ami=ami-1d678876
> or by searching for the AMI code "ami-1d678876"
>
> They're normal machines; it will boot in about a minute and then you
> just ssh in as usual (or use one of the Apple or Windows interfaces) and
> use your regular tools and scripts.
> You have complete sudo access to the machine so you can update or add
> anything you like. Privacy controls are pretty good; you control who can
> can access your machine. Useful for working on restricted data.
>
> There are general instructions here:
> https://box.groovehq.com/knowledge_base/topics/box-how
> along with some hints on how to avoid getting hit with some of the
> Amazon fees. There are also some Moses-specific comments here:
> https://box.groovehq.com/knowledge_base/topics/moses-on-box
>
> My goal is to make it easy for everyone to get work done. As such, let
> me know if you have any questions or if there's anything at all that
> isn't clear about the process or instructions.
>
> Cheers,
> ~amittai
>
> [*] Also includes cdec installed. Everything is installed under /opt/
> directory, so it's a neat and tidy environment. The full list of
> installed tools is:
> cdec, cmph, ducttape, eigen3, fast_align, giza-pp, kenlm, mgiza,
> mosesdecoder, multeval, rnnlm, salm, scala, vowpal-wabbit, and word2vec,
> with more on the way. Suggestions welcome!
>
>
> On 7/2/15 08:00, Vishal Goyal(????? ????) wrote:
>> Hello All,
>> Do u know anyone providing free service of server where MOSES is pre
>> installed and we can install our MT system there.
>> Else It is very costly to bear the cost from own pocket.
>> It approx. costs about 6k INR rupees every month for hosting MT
>> systemdeveloped using MOSES.
>>
>>
>> --
>> *Regards,*
>> Vishal Goyal,
>> Ph.D., M.Tech., MCA, M.C.S.D.
>> Assistant Professor(Stage III),
>> Department of Computer Science,
>> Punjabi University Patiala-147002.
>>
>> *_NLP International Conference on 18-19 Sept, 2015: regICON2015_*
>> http://regICON2015.learnpunjabi.org
>>
>> *_Machine Translation Systems:_*
>> [*Online Hindi to Punjabi Machine Translation Tool -*
>> http://h2p.learnpunjabi.org ]
>> [*Statistical Approach Based Hindi to Punjabi Machine Translation System *
>> - http://statmt.org/~vishal/hp/index.cgi
>> - http://tdil-dc.in/hi2pu/index.cgi
>> ]
>> *_Online Journal: _[Research Cell: An International Journal of
>> Engineering Sciences, http://ijoes.vidyapublications.com]*
>> *_Book: _A Simplified Approach to Data Structures, Shroff Publications
>> and Distributors*
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
------------------------------
Message: 3
Date: Thu, 2 Jul 2015 15:15:14 -0400
From: amittai <amittai.box@gmail.com>
Subject: Re: [Moses-support] Prepackaged MT research platform
To: moses-support@mit.edu
Message-ID: <55958DC2.6060101@gmail.com>
Content-Type: text/plain; charset=utf-8; format=flowed
Whatever you want!
Some of the installed tools specifically integrate with each other (e.g.
mosesdecoder with mgiza, cmph, kenlm; also cdec with ducttape and
fast_align) -- and some of them are there in case people want to try out
ideas and come up with new things. I included word2vec and rnnlm just to
start the collection of continuous-space toolkits; I'll add more of
everything as I go figuring out how to install them.
If there's something you use for some of your work, let me know and I'll
try to include it in the next release. (Bonus if you have installation
instructions already!). You can never have too many tools, right?
~amittai
On 7/2/15 13:45, Marcin Junczys-Dowmunt wrote:
> Cool. What is word2vec used for in that context?
> Best,
> Marcin
>
> W dniu 02.07.2015 o 19:29, amittai pisze:
>> Hi --
>>
>> There are several free pre-packaged Moses distributions, many of which
>> are listed here:
>> http://www.statmt.org/moses/?n=Moses.Packages
>>
>> However I don't know of any free hosting service; as you point out,
>> running a server is expensive.
>>
>> I have just released Box, a pre-packaged machine on the Amazon cloud
>> that comes with Moses (and others[*]) already installed. This was my
>> personal project at the MT Marathon in May, and I guess this is the
>> release announcement I forgot to make :)
>>
>> Box isn't free to use, but does have the advantage that you only pay for
>> the resources you use (and all the machines start exactly the same). The
>> per-hour prices are based on Amazon's basic fees, so you can do this all
>> yourself also but you'll save less than 10%. The per-hour advantage is
>> that if you have other work to do for a week (or half a day), you kill
>> the virtual machine and don't pay for that time. Also you can launch a
>> tiny machine just to decode, and a bigger one to train, and turn them
>> off as soon as you finish. This might help your hardware budget go
>> farther. Also, for the same budget, you can run bigger machines, or
>> simply more of them, and get more experimental throughput for your money.
>>
>> Finally, I think you can also apply directly to Amazon to get research
>> funding in the form of free credit for use on their cloud:
>> https://aws.amazon.com/grants/
>> and that might be your best bet to get free hosting. You can of course
>> use the Amazon credits to run your own machine instead of one of mine,
>> but also of course I think my way is a little easier :)
>>
>> Box is currently in stable beta (v2015-05-25).
>> You can join the mailing list for announcements/questions here:
>> https://groups.google.com/d/forum/boxresearch
>>
>> Box itself you get by signing up (free) with here:
>> https://portal.aws.amazon.com/gp/aws/user/subscription/index.html?offeringCode=49B2A70F
>> (it takes a few seconds to load; don't know why).
>>
>> After you sign up for Box, you can launch an instance directly via this
>> link:
>> https://console.aws.amazon.com/ec2/v2/home?region=us-east-1#LaunchInstanceWizard:ami=ami-1d678876
>> or by searching for the AMI code "ami-1d678876"
>>
>> They're normal machines; it will boot in about a minute and then you
>> just ssh in as usual (or use one of the Apple or Windows interfaces) and
>> use your regular tools and scripts.
>> You have complete sudo access to the machine so you can update or add
>> anything you like. Privacy controls are pretty good; you control who can
>> can access your machine. Useful for working on restricted data.
>>
>> There are general instructions here:
>> https://box.groovehq.com/knowledge_base/topics/box-how
>> along with some hints on how to avoid getting hit with some of the
>> Amazon fees. There are also some Moses-specific comments here:
>> https://box.groovehq.com/knowledge_base/topics/moses-on-box
>>
>> My goal is to make it easy for everyone to get work done. As such, let
>> me know if you have any questions or if there's anything at all that
>> isn't clear about the process or instructions.
>>
>> Cheers,
>> ~amittai
>>
>> [*] Also includes cdec installed. Everything is installed under /opt/
>> directory, so it's a neat and tidy environment. The full list of
>> installed tools is:
>> cdec, cmph, ducttape, eigen3, fast_align, giza-pp, kenlm, mgiza,
>> mosesdecoder, multeval, rnnlm, salm, scala, vowpal-wabbit, and word2vec,
>> with more on the way. Suggestions welcome!
>>
>>
>> On 7/2/15 08:00, Vishal Goyal(????? ????) wrote:
>>> Hello All,
>>> Do u know anyone providing free service of server where MOSES is pre
>>> installed and we can install our MT system there.
>>> Else It is very costly to bear the cost from own pocket.
>>> It approx. costs about 6k INR rupees every month for hosting MT
>>> systemdeveloped using MOSES.
>>>
>>>
>>> --
>>> *Regards,*
>>> Vishal Goyal,
>>> Ph.D., M.Tech., MCA, M.C.S.D.
>>> Assistant Professor(Stage III),
>>> Department of Computer Science,
>>> Punjabi University Patiala-147002.
>>>
>>> *_NLP International Conference on 18-19 Sept, 2015: regICON2015_*
>>> http://regICON2015.learnpunjabi.org
>>>
>>> *_Machine Translation Systems:_*
>>> [*Online Hindi to Punjabi Machine Translation Tool -*
>>> http://h2p.learnpunjabi.org ]
>>> [*Statistical Approach Based Hindi to Punjabi Machine Translation System *
>>> - http://statmt.org/~vishal/hp/index.cgi
>>> - http://tdil-dc.in/hi2pu/index.cgi
>>> ]
>>> *_Online Journal: _[Research Cell: An International Journal of
>>> Engineering Sciences, http://ijoes.vidyapublications.com]*
>>> *_Book: _A Simplified Approach to Data Structures, Shroff Publications
>>> and Distributors*
>>>
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
------------------------------
Message: 4
Date: Thu, 2 Jul 2015 21:42:05 +0200
From: Ozan ?a?layan <ozancag@gmail.com>
Subject: [Moses-support] Some addition suggestions to English
non-breaking prefixes
To: moses-support@mit.edu
Message-ID:
<CAFub=KT1G4q7y=+HJf1zA0Yjpxt1JhXi+DJ7qSgBP3d3ofDVCA@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
Hello,
I don't know how to proceed for this but the following prefixes seem
to be nice candidates for non breaking English prefixes:
Jr // Junior
JR
etc
Etc
Inc // incorporation
ed // edition
I spotted them when looking at the IWSLT corpora.
Thanks.
--
Ozan ?a?layan
Research Assistant
Galatasaray University - Computer Engineering Dept.
http://www.ozancaglayan.com
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 105, Issue 6
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 105, Issue 6"
Post a Comment