Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Phrase-based moses segfaults on [...] input tokens
(Marcin Junczys-Dowmunt)
2. Re: Phrase-based moses segfaults on [...] input tokens
(Hieu Hoang)
3. Re: Phrase-based moses segfaults on [...] input tokens
(Marcin Junczys-Dowmunt)
4. Re: Phrase-based moses segfaults on [...] input tokens
(Hieu Hoang)
5. Re: Phrase-based moses segfaults on [...] input tokens
(Marcin Junczys-Dowmunt)
----------------------------------------------------------------------
Message: 1
Date: Sat, 22 Nov 2014 11:27:11 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: [Moses-support] Phrase-based moses segfaults on [...] input
tokens
To: moses-support <moses-support@mit.edu>
Message-ID: <547064FF.8040309@amu.edu.pl>
Content-Type: text/plain; charset=utf-8; format=flowed
Hi,
phrase-based moses segfaults when it encounters tokens of the form
[...], e.g. [7] or [test], I understand that for hiero or syntax-based
models those are non-terminals and they should rather by escaped.
However, for phrase-based this should not be needed. Is that something
you would bother to fix or rather say "we don't care, escape your input
properly"?.
Cheers,
Marcin
------------------------------
Message: 2
Date: Sat, 22 Nov 2014 10:31:40 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Phrase-based moses segfaults on [...]
input tokens
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbg27Fw-VKXmFAyGdgEAfaoFwZ2CfWi+TFgQHPv3psS1Jw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
escape your input properly. It's 1 pipeline for all models
On 22 November 2014 10:27, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
wrote:
> Hi,
> phrase-based moses segfaults when it encounters tokens of the form
> [...], e.g. [7] or [test], I understand that for hiero or syntax-based
> models those are non-terminals and they should rather by escaped.
> However, for phrase-based this should not be needed. Is that something
> you would bother to fix or rather say "we don't care, escape your input
> properly"?.
>
> Cheers,
> Marcin
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141122/f76054dc/attachment-0001.htm
------------------------------
Message: 3
Date: Sat, 22 Nov 2014 11:32:45 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Phrase-based moses segfaults on [...]
input tokens
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <5470664D.6000709@amu.edu.pl>
Content-Type: text/plain; charset="utf-8"
OK then. Is this new? We did not have this problem some time ago.
W dniu 22.11.2014 o 11:31, Hieu Hoang pisze:
> escape your input properly. It's 1 pipeline for all models
>
>
> On 22 November 2014 10:27, Marcin Junczys-Dowmunt <junczys@amu.edu.pl
> <mailto:junczys@amu.edu.pl>> wrote:
>
> Hi,
> phrase-based moses segfaults when it encounters tokens of the form
> [...], e.g. [7] or [test], I understand that for hiero or syntax-based
> models those are non-terminals and they should rather by escaped.
> However, for phrase-based this should not be needed. Is that something
> you would bother to fix or rather say "we don't care, escape your
> input
> properly"?.
>
> Cheers,
> Marcin
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141122/1a73e020/attachment-0001.htm
------------------------------
Message: 4
Date: Sat, 22 Nov 2014 10:36:49 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Phrase-based moses segfaults on [...]
input tokens
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbjojwZZavP=vpk-BRCRKt9aJtNvYHuYgqgutUFSVGLG4g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
i think it's been like that since the introduction of syntax models into
Moses more than 5 years ago. It's not safe to have non-terms in the
phrase-based model, there might be something new that triggered the
segfault.
On 22 November 2014 10:32, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
wrote:
> OK then. Is this new? We did not have this problem some time ago.
>
> W dniu 22.11.2014 o 11:31, Hieu Hoang pisze:
>
> escape your input properly. It's 1 pipeline for all models
>
>
> On 22 November 2014 10:27, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
> wrote:
>
>> Hi,
>> phrase-based moses segfaults when it encounters tokens of the form
>> [...], e.g. [7] or [test], I understand that for hiero or syntax-based
>> models those are non-terminals and they should rather by escaped.
>> However, for phrase-based this should not be needed. Is that something
>> you would bother to fix or rather say "we don't care, escape your input
>> properly"?.
>>
>> Cheers,
>> Marcin
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
>
>
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141122/c2a1b3cc/attachment-0001.htm
------------------------------
Message: 5
Date: Sat, 22 Nov 2014 11:39:51 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Phrase-based moses segfaults on [...]
input tokens
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <547067F7.4040208@amu.edu.pl>
Content-Type: text/plain; charset="utf-8"
Nope, we at WIPO had no problems with tokens like that with a moses
version from two years ago and moses_chart. We merged with master
recently and stuff started happening. And we have LOTS of tokens like
that, we would have noticed earlier :)
W dniu 22.11.2014 o 11:36, Hieu Hoang pisze:
> i think it's been like that since the introduction of syntax models
> into Moses more than 5 years ago. It's not safe to have non-terms in
> the phrase-based model, there might be something new that triggered
> the segfault.
>
> On 22 November 2014 10:32, Marcin Junczys-Dowmunt <junczys@amu.edu.pl
> <mailto:junczys@amu.edu.pl>> wrote:
>
> OK then. Is this new? We did not have this problem some time ago.
>
> W dniu 22.11.2014 o 11:31, Hieu Hoang pisze:
>> escape your input properly. It's 1 pipeline for all models
>>
>>
>> On 22 November 2014 10:27, Marcin Junczys-Dowmunt
>> <junczys@amu.edu.pl <mailto:junczys@amu.edu.pl>> wrote:
>>
>> Hi,
>> phrase-based moses segfaults when it encounters tokens of the
>> form
>> [...], e.g. [7] or [test], I understand that for hiero or
>> syntax-based
>> models those are non-terminals and they should rather by escaped.
>> However, for phrase-based this should not be needed. Is that
>> something
>> you would bother to fix or rather say "we don't care, escape
>> your input
>> properly"?.
>>
>> Cheers,
>> Marcin
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>>
>> --
>> Hieu Hoang
>> Research Associate
>> University of Edinburgh
>> http://www.hoang.co.uk/hieu
>>
>
>
>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141122/185843a7/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 97, Issue 67
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 97, Issue 67"
Post a Comment