Moses-support Digest, Vol 125, Issue 47

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. How to print out intermediate confusion networks / lattices?
(Angli Liu)
2. Re: How to print out intermediate confusion networks /
lattices? (Philipp Koehn)
3. Re: How to print out intermediate confusion networks /
lattices? (Angli Liu)
4. Re: How to print out intermediate confusion networks /
lattices? (Philipp Koehn)


----------------------------------------------------------------------

Message: 1
Date: Thu, 23 Mar 2017 15:30:59 -0700
From: Angli Liu <anglil@cs.washington.edu>
Subject: [Moses-support] How to print out intermediate confusion
networks / lattices?
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAJXA_eO27f6x75tG+nSDXhW2i+tB==sQTuBBQwvyR_fT8UaMTQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Moses community,

In decoding, is it possible to have Moses output a confusion network (CN)
or a word lattice (WL), instead of the decoded text for each sentence? I'm
aware that one parameter of the decoder is "-inputtype", so the question is
what parameter of the decoder should be used to determine the output type
(among CN, WL and plain texts)?

Also, where can I exactly find the decoder code (responsible for what the
binary "moses" does) inside https://github.com/moses-smt/mosesdecoder?

Thanks,
Angli
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170323/a82fc1f5/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 24 Mar 2017 11:00:40 -0400
From: Philipp Koehn <phi@jhu.edu>
Subject: Re: [Moses-support] How to print out intermediate confusion
networks / lattices?
To: Angli Liu <anglil@cs.washington.edu>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAAFADDA8dxQYCqCZVQzvN4RoQ=pLNG=kW-z5r5kf9iA1qt5DWg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

the option to output the search graph is called "output-search-graph"

See http://www.statmt.org/moses/?n=Advanced.Search for details.

The source code is in $MOSES/moses-cmd and $MOSES/moses

-phi



On Thu, Mar 23, 2017 at 6:30 PM, Angli Liu <anglil@cs.washington.edu> wrote:

> Hi Moses community,
>
> In decoding, is it possible to have Moses output a confusion network (CN)
> or a word lattice (WL), instead of the decoded text for each sentence? I'm
> aware that one parameter of the decoder is "-inputtype", so the question is
> what parameter of the decoder should be used to determine the output type
> (among CN, WL and plain texts)?
>
> Also, where can I exactly find the decoder code (responsible for what the
> binary "moses" does) inside https://github.com/moses-smt/mosesdecoder?
>
> Thanks,
> Angli
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170324/f79d751f/attachment-0001.html

------------------------------

Message: 3
Date: Fri, 24 Mar 2017 08:50:24 -0700
From: Angli Liu <anglil@cs.washington.edu>
Subject: Re: [Moses-support] How to print out intermediate confusion
networks / lattices?
To: Philipp Koehn <phi@jhu.edu>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAJXA_eOprZpNMq+1njeVG=JRrbuURFkzDER7Gx37c6iGYpnSkA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thanks!

Furthermore, does "output-search-graph" output the search graph only when
the default objective (posterior probability) is used, or also when minimum
bayes risk decoding / consensus decoding is used (smoothed BLEU)?

Also, is cube pruning applicable to minimum bayes risk decoding or
consensus decoding? Namely, should I turn on -search-algorithm 1 when -lmbr
or -con is on?

Thanks,
Angli

On Fri, Mar 24, 2017 at 8:00 AM, Philipp Koehn <phi@jhu.edu> wrote:

> Hi,
>
> the option to output the search graph is called "output-search-graph"
>
> See http://www.statmt.org/moses/?n=Advanced.Search for details.
>
> The source code is in $MOSES/moses-cmd and $MOSES/moses
>
> -phi
>
>
>
> On Thu, Mar 23, 2017 at 6:30 PM, Angli Liu <anglil@cs.washington.edu>
> wrote:
>
>> Hi Moses community,
>>
>> In decoding, is it possible to have Moses output a confusion network (CN)
>> or a word lattice (WL), instead of the decoded text for each sentence? I'm
>> aware that one parameter of the decoder is "-inputtype", so the question is
>> what parameter of the decoder should be used to determine the output type
>> (among CN, WL and plain texts)?
>>
>> Also, where can I exactly find the decoder code (responsible for what the
>> binary "moses" does) inside https://github.com/moses-smt/mosesdecoder?
>>
>> Thanks,
>> Angli
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170324/e4bbf1df/attachment-0001.html

------------------------------

Message: 4
Date: Fri, 24 Mar 2017 11:54:29 -0400
From: Philipp Koehn <phi@jhu.edu>
Subject: Re: [Moses-support] How to print out intermediate confusion
networks / lattices?
To: Angli Liu <anglil@cs.washington.edu>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAAFADDCHAF3idjJGavy1uFxrX6B-6gqTZXHbGE1qEQpgBeiDjw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

the search graph does not include the MBR objective, since that is computed
afterwards, on top of the n-best list extracted from the search graph.

You can mix cube pruning and MBR together. As mentioned above, the
"decision rule" (MBR vs. max-prob) is applied after search is finished.

-phi

On Fri, Mar 24, 2017 at 11:50 AM, Angli Liu <anglil@cs.washington.edu>
wrote:

> Thanks!
>
> Furthermore, does "output-search-graph" output the search graph only when
> the default objective (posterior probability) is used, or also when minimum
> bayes risk decoding / consensus decoding is used (smoothed BLEU)?
>
> Also, is cube pruning applicable to minimum bayes risk decoding or
> consensus decoding? Namely, should I turn on -search-algorithm 1 when -lmbr
> or -con is on?
>
> Thanks,
> Angli
>
> On Fri, Mar 24, 2017 at 8:00 AM, Philipp Koehn <phi@jhu.edu> wrote:
>
>> Hi,
>>
>> the option to output the search graph is called "output-search-graph"
>>
>> See http://www.statmt.org/moses/?n=Advanced.Search for details.
>>
>> The source code is in $MOSES/moses-cmd and $MOSES/moses
>>
>> -phi
>>
>>
>>
>> On Thu, Mar 23, 2017 at 6:30 PM, Angli Liu <anglil@cs.washington.edu>
>> wrote:
>>
>>> Hi Moses community,
>>>
>>> In decoding, is it possible to have Moses output a confusion network
>>> (CN) or a word lattice (WL), instead of the decoded text for each sentence?
>>> I'm aware that one parameter of the decoder is "-inputtype", so the
>>> question is what parameter of the decoder should be used to determine the
>>> output type (among CN, WL and plain texts)?
>>>
>>> Also, where can I exactly find the decoder code (responsible for what
>>> the binary "moses" does) inside https://github.com/moses-smt/m
>>> osesdecoder?
>>>
>>> Thanks,
>>> Angli
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170324/e273e44d/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 125, Issue 47
**********************************************

0 Response to "Moses-support Digest, Vol 125, Issue 47"

Post a Comment