Moses-support Digest, Vol 125, Issue 48

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: How to print out intermediate confusion networks /
lattices? (Angli Liu)
2. Re: How to print out intermediate confusion networks /
lattices? (Philipp Koehn)


----------------------------------------------------------------------

Message: 1
Date: Fri, 24 Mar 2017 09:05:27 -0700
From: Angli Liu <anglil@cs.washington.edu>
Subject: Re: [Moses-support] How to print out intermediate confusion
networks / lattices?
To: Philipp Koehn <phi@jhu.edu>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAJXA_eMZhcXwVs5Cgcb2asNty4UbECZFsBWxMsinjdxzjWX_hw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

I see! Does this mean that the default decoding algorithm and MBR/consensus
decoding are all trying to rerank the n-best list extracted from the search
graph (in different ways)? If so, does it make sense at all to try to
develop a search method to directly extract the best path from the search
graph, i.e., the lattice?

Thanks,
Angli

On Fri, Mar 24, 2017 at 8:54 AM, Philipp Koehn <phi@jhu.edu> wrote:

> Hi,
>
> the search graph does not include the MBR objective, since that is
> computed afterwards, on top of the n-best list extracted from the search
> graph.
>
> You can mix cube pruning and MBR together. As mentioned above, the
> "decision rule" (MBR vs. max-prob) is applied after search is finished.
>
> -phi
>
> On Fri, Mar 24, 2017 at 11:50 AM, Angli Liu <anglil@cs.washington.edu>
> wrote:
>
>> Thanks!
>>
>> Furthermore, does "output-search-graph" output the search graph only when
>> the default objective (posterior probability) is used, or also when minimum
>> bayes risk decoding / consensus decoding is used (smoothed BLEU)?
>>
>> Also, is cube pruning applicable to minimum bayes risk decoding or
>> consensus decoding? Namely, should I turn on -search-algorithm 1 when -lmbr
>> or -con is on?
>>
>> Thanks,
>> Angli
>>
>> On Fri, Mar 24, 2017 at 8:00 AM, Philipp Koehn <phi@jhu.edu> wrote:
>>
>>> Hi,
>>>
>>> the option to output the search graph is called "output-search-graph"
>>>
>>> See http://www.statmt.org/moses/?n=Advanced.Search for details.
>>>
>>> The source code is in $MOSES/moses-cmd and $MOSES/moses
>>>
>>> -phi
>>>
>>>
>>>
>>> On Thu, Mar 23, 2017 at 6:30 PM, Angli Liu <anglil@cs.washington.edu>
>>> wrote:
>>>
>>>> Hi Moses community,
>>>>
>>>> In decoding, is it possible to have Moses output a confusion network
>>>> (CN) or a word lattice (WL), instead of the decoded text for each sentence?
>>>> I'm aware that one parameter of the decoder is "-inputtype", so the
>>>> question is what parameter of the decoder should be used to determine the
>>>> output type (among CN, WL and plain texts)?
>>>>
>>>> Also, where can I exactly find the decoder code (responsible for what
>>>> the binary "moses" does) inside https://github.com/moses-smt/m
>>>> osesdecoder?
>>>>
>>>> Thanks,
>>>> Angli
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170324/a923a842/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 24 Mar 2017 15:58:34 -0400
From: Philipp Koehn <phi@jhu.edu>
Subject: Re: [Moses-support] How to print out intermediate confusion
networks / lattices?
To: Angli Liu <anglil@cs.washington.edu>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAAFADDDhOFgyTV=ahAwrpNB45t8uRoFOGJia7Aua3zd6j+i8cg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

yes, that's correct.
There is an implementation of "Lattice MBR".

-phi

On Fri, Mar 24, 2017 at 12:05 PM, Angli Liu <anglil@cs.washington.edu>
wrote:

> I see! Does this mean that the default decoding algorithm and
> MBR/consensus decoding are all trying to rerank the n-best list extracted
> from the search graph (in different ways)? If so, does it make sense at all
> to try to develop a search method to directly extract the best path from
> the search graph, i.e., the lattice?
>
> Thanks,
> Angli
>
> On Fri, Mar 24, 2017 at 8:54 AM, Philipp Koehn <phi@jhu.edu> wrote:
>
>> Hi,
>>
>> the search graph does not include the MBR objective, since that is
>> computed afterwards, on top of the n-best list extracted from the search
>> graph.
>>
>> You can mix cube pruning and MBR together. As mentioned above, the
>> "decision rule" (MBR vs. max-prob) is applied after search is finished.
>>
>> -phi
>>
>> On Fri, Mar 24, 2017 at 11:50 AM, Angli Liu <anglil@cs.washington.edu>
>> wrote:
>>
>>> Thanks!
>>>
>>> Furthermore, does "output-search-graph" output the search graph only
>>> when the default objective (posterior probability) is used, or also when
>>> minimum bayes risk decoding / consensus decoding is used (smoothed BLEU)?
>>>
>>> Also, is cube pruning applicable to minimum bayes risk decoding or
>>> consensus decoding? Namely, should I turn on -search-algorithm 1 when -lmbr
>>> or -con is on?
>>>
>>> Thanks,
>>> Angli
>>>
>>> On Fri, Mar 24, 2017 at 8:00 AM, Philipp Koehn <phi@jhu.edu> wrote:
>>>
>>>> Hi,
>>>>
>>>> the option to output the search graph is called "output-search-graph"
>>>>
>>>> See http://www.statmt.org/moses/?n=Advanced.Search for details.
>>>>
>>>> The source code is in $MOSES/moses-cmd and $MOSES/moses
>>>>
>>>> -phi
>>>>
>>>>
>>>>
>>>> On Thu, Mar 23, 2017 at 6:30 PM, Angli Liu <anglil@cs.washington.edu>
>>>> wrote:
>>>>
>>>>> Hi Moses community,
>>>>>
>>>>> In decoding, is it possible to have Moses output a confusion network
>>>>> (CN) or a word lattice (WL), instead of the decoded text for each sentence?
>>>>> I'm aware that one parameter of the decoder is "-inputtype", so the
>>>>> question is what parameter of the decoder should be used to determine the
>>>>> output type (among CN, WL and plain texts)?
>>>>>
>>>>> Also, where can I exactly find the decoder code (responsible for what
>>>>> the binary "moses" does) inside https://github.com/moses-smt/m
>>>>> osesdecoder?
>>>>>
>>>>> Thanks,
>>>>> Angli
>>>>>
>>>>> _______________________________________________
>>>>> Moses-support mailing list
>>>>> Moses-support@mit.edu
>>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>>
>>>>>
>>>>
>>>
>>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20170324/c663cc8c/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 125, Issue 48
**********************************************

Tweet