Moses-support Digest, Vol 104, Issue 61

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. How to tell EMS to use an existing binary LM (Lane Schwartz)
2. Re: How to tell EMS to use an existing binary LM (Rico Sennrich)
3. Re: How to tell EMS to use an existing binary LM (Lane Schwartz)
4. Re: How to tell EMS to use an existing binary LM (Rico Sennrich)
5. Re: How to tell EMS to use an existing binary LM (Lane Schwartz)


----------------------------------------------------------------------

Message: 1
Date: Fri, 19 Jun 2015 14:13:44 -0500
From: Lane Schwartz <dowobeha@gmail.com>
Subject: [Moses-support] How to tell EMS to use an existing binary LM
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CABv3vZm+jMv0Xwt0f3Ck7tM1ZKJdgbHgFe0SpxDDCnwe+i-ryg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

I've looked through experiment.meta and the samples, and I haven't been
able to figure this out. I know this is simple, but I'm missing the syntax.

How can I tell EMS to use an existing binarized LM that was trained
previously?

Thanks,
Lane
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150619/afaaf923/attachment-0001.htm

------------------------------

Message: 2
Date: Fri, 19 Jun 2015 19:17:26 +0000 (UTC)
From: Rico Sennrich <rico.sennrich@gmx.ch>
Subject: Re: [Moses-support] How to tell EMS to use an existing binary
LM
To: moses-support@mit.edu
Message-ID: <loom.20150619T211642-804@post.gmane.org>
Content-Type: text/plain; charset=us-ascii

Lane Schwartz <dowobeha@...> writes:

>
> Hi,
>
> I've looked through experiment.meta and the samples, and I haven't been
able to figure this out. I know this is simple, but I'm missing the syntax.
>
> How can I tell EMS to use an existing binarized LM that was trained
previously?
>
> Thanks,
> Lane
>

Hi Lane,

instead of

raw-corpus = /path/to/corpus

use

binlm = /path/to/lm



------------------------------

Message: 3
Date: Fri, 19 Jun 2015 14:19:56 -0500
From: Lane Schwartz <dowobeha@gmail.com>
Subject: Re: [Moses-support] How to tell EMS to use an existing binary
LM
To: Rico Sennrich <rico.sennrich@gmx.ch>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CABv3vZkzowTSUqK9PmURQ3bS=qU_E_C4fQNM58iK0FoFZQCKrA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hrm.. that's exactly what I had tried to do. It complained with the
following error:

ERROR: use --lm factor:order:filename to specify at least one language
model at /opt/moses/scripts/training/train-model.perl line 479

On Fri, Jun 19, 2015 at 2:17 PM, Rico Sennrich <rico.sennrich@gmx.ch> wrote:

> Lane Schwartz <dowobeha@...> writes:
>
> >
> > Hi,
> >
> > I've looked through experiment.meta and the samples, and I haven't been
> able to figure this out. I know this is simple, but I'm missing the syntax.
> >
> > How can I tell EMS to use an existing binarized LM that was trained
> previously?
> >
> > Thanks,
> > Lane
> >
>
> Hi Lane,
>
> instead of
>
> raw-corpus = /path/to/corpus
>
> use
>
> binlm = /path/to/lm
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>



--
When a place gets crowded enough to require ID's, social collapse is not
far away. It is time to go elsewhere. The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, "Time Enough For Love"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150619/47b0a67b/attachment-0001.htm

------------------------------

Message: 4
Date: Fri, 19 Jun 2015 20:28:00 +0100
From: Rico Sennrich <rico.sennrich@gmx.ch>
Subject: Re: [Moses-support] How to tell EMS to use an existing binary
LM
To: Lane Schwartz <dowobeha@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <55846D40.4020101@gmx.ch>
Content-Type: text/plain; charset="utf-8"

This could have to do with the language interpolation mechanics, which
'deletes' LMs from the moses.ini and makes them part of the
interpolation instead. Does adding

exclude-from-interpolation = true

help?

Alternatively: the LM should still have its own section, [LM:somename],
and you should set order, factor etc. correctly.

best wishes,
Rico

On 19/06/15 20:19, Lane Schwartz wrote:
> Hrm.. that's exactly what I had tried to do. It complained with the
> following error:
>
> ERROR: use --lm factor:order:filename to specify at least one language
> model at /opt/moses/scripts/training/train-model.perl line 479
>
>
> On Fri, Jun 19, 2015 at 2:17 PM, Rico Sennrich <rico.sennrich@gmx.ch
> <mailto:rico.sennrich@gmx.ch>> wrote:
>
> Lane Schwartz <dowobeha@...> writes:
>
> >
> > Hi,
> >
> > I've looked through experiment.meta and the samples, and I
> haven't been
> able to figure this out. I know this is simple, but I'm missing
> the syntax.
> >
> > How can I tell EMS to use an existing binarized LM that was trained
> previously?
> >
> > Thanks,
> > Lane
> >
>
> Hi Lane,
>
> instead of
>
> raw-corpus = /path/to/corpus
>
> use
>
> binlm = /path/to/lm
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
> When a place gets crowded enough to require ID's, social collapse is not
> far away. It is time to go elsewhere. The best thing about space travel
> is that it made it possible to go elsewhere.
> -- R.A. Heinlein, "Time Enough For Love"

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150619/a4371582/attachment-0001.htm

------------------------------

Message: 5
Date: Fri, 19 Jun 2015 14:29:34 -0500
From: Lane Schwartz <dowobeha@gmail.com>
Subject: Re: [Moses-support] How to tell EMS to use an existing binary
LM
To: Rico Sennrich <rico.sennrich@gmx.ch>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CABv3vZm-uwdcKR-djmaAq13HpN6YoFTYovKW1yGqiHdf3E0RwA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

It was the section. I had tried to put binlm = ... directly under [LM].
Once I put it under [LM:somename] it worked.

Thanks,
Lane


On Fri, Jun 19, 2015 at 2:28 PM, Rico Sennrich <rico.sennrich@gmx.ch> wrote:

> This could have to do with the language interpolation mechanics, which
> 'deletes' LMs from the moses.ini and makes them part of the interpolation
> instead. Does adding
>
> exclude-from-interpolation = true
>
> help?
>
> Alternatively: the LM should still have its own section, [LM:somename],
> and you should set order, factor etc. correctly.
>
> best wishes,
> Rico
>
>
> On 19/06/15 20:19, Lane Schwartz wrote:
>
> Hrm.. that's exactly what I had tried to do. It complained with the
> following error:
>
> ERROR: use --lm factor:order:filename to specify at least one language
> model at /opt/moses/scripts/training/train-model.perl line 479
>
> On Fri, Jun 19, 2015 at 2:17 PM, Rico Sennrich <rico.sennrich@gmx.ch>
> wrote:
>
>> Lane Schwartz <dowobeha@...> <dowobeha@...> writes:
>>
>> >
>> > Hi,
>> >
>> > I've looked through experiment.meta and the samples, and I haven't been
>> able to figure this out. I know this is simple, but I'm missing the
>> syntax.
>> >
>> > How can I tell EMS to use an existing binarized LM that was trained
>> previously?
>> >
>> > Thanks,
>> > Lane
>> >
>>
>> Hi Lane,
>>
>> instead of
>>
>> raw-corpus = /path/to/corpus
>>
>> use
>>
>> binlm = /path/to/lm
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
>
> --
> When a place gets crowded enough to require ID's, social collapse is not
> far away. It is time to go elsewhere. The best thing about space travel
> is that it made it possible to go elsewhere.
> -- R.A. Heinlein, "Time Enough For Love"
>
>
>


--
When a place gets crowded enough to require ID's, social collapse is not
far away. It is time to go elsewhere. The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, "Time Enough For Love"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150619/2326a69b/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 104, Issue 61
**********************************************

0 Response to "Moses-support Digest, Vol 104, Issue 61"

Post a Comment