Moses-support Digest, Vol 102, Issue 56

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. decoding problem (joerg)
2. Re: decoding problem (Hieu Hoang)
3. Re: decoding problem (Marcin Junczys-Dowmunt)


----------------------------------------------------------------------

Message: 1
Date: Mon, 27 Apr 2015 09:00:53 +0200
From: joerg <tiedeman@gmail.com>
Subject: [Moses-support] decoding problem
To: moses-support <moses-support@mit.edu>
Message-ID: <4E9582E6-D702-49B8-BEBE-BAA22E141CA5@gmail.com>
Content-Type: text/plain; charset="iso-8859-1"


Hi,

I have a factored phrase-based model and I get this error when decoding some input that looks correct to me:

Exception: moses/Phrase.cpp:214 in void Moses::Phrase::CreateFromString(Moses::FactorDirection, const std::vector<long unsigned int, std::allocator<long unsigned int> >&, const StringPiece&, Moses::Word**) threw util::Exception because `nextPos == string::npos'.
Incorrect formatting of non-terminal. Should have 2 non-terms, eg. [X][X]. Current string: [11]

I even get the BEST TRANSLATION line for the first sentence before the decoder dies. What is going on?

Thanks for your help
J?rg

**********************************************************************************
J?rg Tiedemann http://stp.lingfil.uu.se/~joerg/



-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150427/9c8eed02/attachment-0001.htm

------------------------------

Message: 2
Date: Mon, 27 Apr 2015 11:00:06 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] decoding problem
To: joerg <tiedeman@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbiNLdojxsta-OVP3SKO-SLoG8TaA6NkmBip3ZpHGjCxkw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

there's probably [] characters in your training or test set. Get rid of
them using
scripts/tokenizer/escape-special-chars.perl
or the default moses tokenizer.



Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu

On 27 April 2015 at 11:00, joerg <tiedeman@gmail.com> wrote:

>
> Hi,
>
> I have a factored phrase-based model and I get this error when decoding
> some input that looks correct to me:
>
> Exception: moses/Phrase.cpp:214 in void
> Moses::Phrase::CreateFromString(Moses::FactorDirection, const
> std::vector<long unsigned int, std::allocator<long unsigned int> >&, const
> StringPiece&, Moses::Word**) threw util::Exception because `nextPos ==
> string::npos'.
> Incorrect formatting of non-terminal. Should have 2 non-terms, eg. [X][X].
> Current string: [11]
>
> I even get the BEST TRANSLATION line for the first sentence before the
> decoder dies. What is going on?
>
> Thanks for your help
> J?rg
>
>
> **********************************************************************************
> J?rg Tiedemann
> http://stp.lingfil.uu.se/~joerg/
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150427/031b3fff/attachment-0001.htm

------------------------------

Message: 3
Date: Mon, 27 Apr 2015 09:04:17 +0200
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] decoding problem
To: moses-support@mit.edu
Message-ID: <553DDF71.9040709@amu.edu.pl>
Content-Type: text/plain; charset="windows-1252"

Hi,
Since phrase-based and chart-based decoding have ben merged "[...]" are
reserved sequences. They are treated as non-terminals, even when the
phrase-based decoder never uses that. You need to escape the brackets.
In our WIPO branch I added a check to moses so this does not happen with
phrase-based, maybe I should put it into master.
Best,
Marcin

W dniu 27.04.2015 o 09:00, joerg pisze:
>
> Hi,
>
> I have a factored phrase-based model and I get this error when
> decoding some input that looks correct to me:
>
> Exception: moses/Phrase.cpp:214 in void
> Moses::Phrase::CreateFromString(Moses::FactorDirection, const
> std::vector<long unsigned int, std::allocator<long unsigned int> >&,
> const StringPiece&, Moses::Word**) threw util::Exception because
> `nextPos == string::npos'.
> Incorrect formatting of non-terminal. Should have 2 non-terms, eg.
> [X][X]. Current string: [11]
>
> I even get the BEST TRANSLATION line for the first sentence before the
> decoder dies. What is going on?
>
> Thanks for your help
> J?rg
>
> **********************************************************************************
> J?rg Tiedemann http://stp.lingfil.uu.se/~joerg/
> <http://stp.lingfil.uu.se/%7Ejoerg/>
>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150427/41138ed1/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 102, Issue 56
**********************************************

Tweet