Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. bjam compilation (Gary Hess)
2. Re: bjam compilation (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Fri, 4 Aug 2017 17:55:44 +0000
From: Gary Hess <garyhess999@hotmail.com>
Subject: [Moses-support] bjam compilation
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<VI1PR1001MB1119F539C9443E171BE668DCF6B60@VI1PR1001MB1119.EURPRD10.PROD.OUTLOOK.COM>
Content-Type: text/plain; charset="iso-8859-1"
I need to recompile Moses with SRILM because I want to use the EMS. I have already managed to compile SRILM separately.
Now I have a question about bjam: I see the "-j" option referenced (http://www.statmt.org/moses/?n=Development.GetStarted), e.g. "-j4", "-j12", "-j8". What does this option do and which value should I use?
I have SRILM in ~/workspace/srilm and Boost is installed in ~/workspace/boost_1_60_0. Moses is in ~/workspace/mosesdecoder.
Thanks!
Gary
Moses - Development/GetStarted - Machine translation<http://www.statmt.org/moses/?n=Development.GetStarted>
www.statmt.org
Getting Started with Moses. This section will show you how to install and build Moses, and how to use Moses to translate with some simple models.
________________________________
From: moses-support-bounces@mit.edu <moses-support-bounces@mit.edu> on behalf of moses-support-request@mit.edu <moses-support-request@mit.edu>
Sent: Thursday, August 3, 2017 6:00 PM
To: moses-support@mit.edu
Subject: Moses-support Digest, Vol 130, Issue 2
Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: EMS Incremental training (Tom Hoar)
----------------------------------------------------------------------
Message: 1
Date: Wed, 2 Aug 2017 23:37:42 +0700
From: Tom Hoar <tahoar@pttools.net>
Subject: Re: [Moses-support] EMS Incremental training
To: moses-support@mit.edu
Message-ID: <48fcbac6-27fd-2b7f-6c60-c18b811df806@pttools.net>
Content-Type: text/plain; charset="utf-8"
Pavan, I saved this message from a while back. We follow this advise.
From: Philipp Koehn
Subject: Re: [Moses-support] Training vs Incremental Training
To: Adel Khalifa
Cc: moses-support@mit.edu
Hi,
there are various versions of incremental training, but full re-training
from scratch will give better results, since incremental word alignment
will not be as good as full word alignment.
-phi
On 8/2/2017 11:00 PM, moses-support-request@mit.edu wrote:
> Date: Wed, 2 Aug 2017 12:13:43 +0530
> From: K Pavan<kosuru.pavan@gmail.com>
> Subject: [Moses-support] EMS Incremental training
> To:moses-support@mit.edu
> Message-ID:
> <CAAQYKL+MJiUoW1Dx_V3_aUuzWh=VV=Q598u6UfavL=jE6qKJqA@mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Hi ,
>
> I was trying to experiment with EMS incremental training. I followed
> http://www.statmt.org/moses/?n=Advanced.Incremental#ntoc1 this
Moses - Advanced/Incremental - statmt.org<http://www.statmt.org/moses/?n=Advanced.Incremental#ntoc1>
www.statmt.org
Introduction. Translation models for Moses are typically batch trained. That is, before training you have all the data you wish to use, you compute the alignments ...
> documentation to start model with 30k open source corpus parallel sentences
> corpus. But I was unable to add more training instances to this model using
> incremental training. Can you please help me with steps on working with
> incremental training process. My Idea is to add another 20k parallel
> sentences to update the model. Is there anyway I can do it without
> re-creating model from scratch.
>
>
> Thank you,
> Pavan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170802/d2a85020/attachment-0001.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 130, Issue 2
*********************************************
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170804/e992528d/attachment-0001.html
------------------------------
Message: 2
Date: Fri, 4 Aug 2017 22:33:04 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] bjam compilation
To: Gary Hess <garyhess999@hotmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAEKMkbgDCrXufDKRAGYnhQqKbEgvr6Uywua4ROzwEYxwvJdMCQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hieu Hoang
http://moses-smt.org/
On 4 August 2017 at 18:55, Gary Hess <garyhess999@hotmail.com> wrote:
> I need to recompile Moses with SRILM because I want to use the EMS. I
> have already managed to compile SRILM separately.
>
You don't need SRILM unless you are using it for LM interpolation. For
normal LM training and inference, KenLM is better in every way
>
> Now I have a question about bjam: I see the "-j" option referenced (
> http://www.statmt.org/moses/?n=Development.GetStarted), e.g. "*-j4*", "
> *-j12*", "*-j8*". What does this option do and which value should I use?
>
>
> This specify how many parallel compilation to perform. Usually, set this
to the number of cores on the machine
> I have SRILM in ~/workspace/srilm and Boost is installed in ~/workspace/boost_1_60_0.
> Moses is in ~/workspace/mosesdecoder.
>
>
> Thanks!
>
> Gary
> Moses - Development/GetStarted - Machine translation
> <http://www.statmt.org/moses/?n=Development.GetStarted>
> www.statmt.org
> Getting Started with Moses. This section will show you how to install and
> build Moses, and how to use Moses to translate with some simple models.
>
>
>
> ------------------------------
> *From:* moses-support-bounces@mit.edu <moses-support-bounces@mit.edu> on
> behalf of moses-support-request@mit.edu <moses-support-request@mit.edu>
> *Sent:* Thursday, August 3, 2017 6:00 PM
> *To:* moses-support@mit.edu
> *Subject:* Moses-support Digest, Vol 130, Issue 2
>
> Send Moses-support mailing list submissions to
> moses-support@mit.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.mit.edu/mailman/listinfo/moses-support
> or, via email, send a message with subject or body 'help' to
> moses-support-request@mit.edu
>
> You can reach the person managing the list at
> moses-support-owner@mit.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Moses-support digest..."
>
>
> Today's Topics:
>
> 1. Re: EMS Incremental training (Tom Hoar)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Wed, 2 Aug 2017 23:37:42 +0700
> From: Tom Hoar <tahoar@pttools.net>
> Subject: Re: [Moses-support] EMS Incremental training
> To: moses-support@mit.edu
> Message-ID: <48fcbac6-27fd-2b7f-6c60-c18b811df806@pttools.net>
> Content-Type: text/plain; charset="utf-8"
>
> Pavan, I saved this message from a while back. We follow this advise.
>
> From: Philipp Koehn
> Subject: Re: [Moses-support] Training vs Incremental Training
> To: Adel Khalifa
> Cc: moses-support@mit.edu
>
> Hi,
>
> there are various versions of incremental training, but full
> re-training
> from scratch will give better results, since incremental word alignment
> will not be as good as full word alignment.
>
> -phi
>
>
> On 8/2/2017 11:00 PM, moses-support-request@mit.edu wrote:
> > Date: Wed, 2 Aug 2017 12:13:43 +0530
> > From: K Pavan<kosuru.pavan@gmail.com>
> > Subject: [Moses-support] EMS Incremental training
> > To:moses-support@mit.edu
> > Message-ID:
> > <CAAQYKL+MJiUoW1Dx_V3_aUuzWh=VV=Q598u6UfavL=jE6qKJqA@mail.
> gmail.com>
> > Content-Type: text/plain; charset="utf-8"
> >
> > Hi ,
> >
> > I was trying to experiment with EMS incremental training. I followed
> > http://www.statmt.org/moses/?n=Advanced.Incremental#ntoc1 this
> Moses - Advanced/Incremental - statmt.org
> <http://www.statmt.org/moses/?n=Advanced.Incremental#ntoc1>
> www.statmt.org
> Introduction. Translation models for Moses are typically batch trained.
> That is, before training you have all the data you wish to use, you compute
> the alignments ...
>
>
> > documentation to start model with 30k open source corpus parallel
> sentences
> > corpus. But I was unable to add more training instances to this model
> using
> > incremental training. Can you please help me with steps on working with
> > incremental training process. My Idea is to add another 20k parallel
> > sentences to update the model. Is there anyway I can do it without
> > re-creating model from scratch.
> >
> >
> > Thank you,
> > Pavan
>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: http://mailman.mit.edu/mailman/private/moses-support/
> attachments/20170802/d2a85020/attachment-0001.html
>
> ------------------------------
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> End of Moses-support Digest, Vol 130, Issue 2
> *********************************************
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170804/fe9fb292/attachment.html
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 130, Issue 3
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 130, Issue 3"
Post a Comment