Moses-support Digest, Vol 98, Issue 31

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: When does this error message occur and how to fix it
(Kenneth Heafield)
2. Re: When does this error message occur and how to fix it
(Marcin Junczys-Dowmunt)
3. Re: When does this error message occur and how to fix it
(Christian Hardmeier)
4. Re: When does this error message occur and how to fix it
(Marcin Junczys-Dowmunt)


----------------------------------------------------------------------

Message: 1
Date: Wed, 10 Dec 2014 15:27:40 -0500
From: Kenneth Heafield <moses@kheafield.com>
Subject: Re: [Moses-support] When does this error message occur and
how to fix it
To: moses-support@mit.edu
Message-ID: <5488ACBC.2040504@kheafield.com>
Content-Type: text/plain; charset=ISO-8859-1

I for one would like a version of phrase table querying that doesn't
depend on the rest of Moses. For cleanliness and for portability
(there's no reason this shouldn't kill cdec's phrase table for example).

Kenneth

On 12/10/14 13:39, Marcin Junczys-Dowmunt wrote:
> I am on it, sort of. I am waiting for Raj, to give me a stack trace. I
> admit this code is basically abandoned, but let's see what we can do.
>
> W dniu 10.12.2014 o 19:35, Hieu Hoang pisze:
>> I see. I'm not sure why the querying depends on StaticData. There may
>> be some weights is wants to read. Only Marcin will know about that.
>> You could try to debug yourself.
>>
>> If you intend to develop with Moses, I would urge you to update to the
>> master branch of Moses. People forget how old code works and often
>> can't answer your questions. The new code has also been cleaned up and
>> rationalised. For instance, the 'translation system' functionality was
>> problematic and has been deleted
>>
>> On 10 December 2014 at 15:53, Raj Dabre <prajdabre@gmail.com
>> <mailto:prajdabre@gmail.com>> wrote:
>>
>> I am not using any moses.ini because I am not translating anything.
>> My focus is on reading the phrase tables using a querying program
>> written by Marcin.
>>
>> On Thu, Dec 11, 2014 at 12:50 AM, Hieu Hoang <Hieu.Hoang@ed.ac.uk
>> <mailto:Hieu.Hoang@ed.ac.uk>> wrote:
>>
>> Are you using the translation system functionality in v1? That
>> seems to be the problem. Can I have a look @ the moses.ini.
>>
>> On 10 December 2014 at 15:44, Raj Dabre <prajdabre@gmail.com
>> <mailto:prajdabre@gmail.com>> wrote:
>>
>> I am using an older version (V1).
>> I am not running a translation experiment but using Java
>> Native Interface to call C functions.
>> Can you tell me what might be the problem ?
>> I can surely say that the root of the problem is in the
>> StaticData.cpp file.
>> It seems that I am creating 2 instances of a class trying
>> to access a background moses process.
>> Does this sound about right ?
>>
>>
>> On Thu, Dec 11, 2014 at 12:37 AM, Hieu Hoang
>> <Hieu.Hoang@ed.ac.uk <mailto:Hieu.Hoang@ed.ac.uk>> wrote:
>>
>> what version of Moses are you using? The current
>> master branch on github, or an older version (version
>> 1 etc)?
>>
>> Can I please see the moses.ini file you're using too
>>
>> On 10 December 2014 at 12:34, Raj Dabre
>> <prajdabre@gmail.com <mailto:prajdabre@gmail.com>> wrote:
>>
>> Dear all,
>>
>> I am using a JNI interface to the CPP code that
>> reads from binary phrase tables.
>>
>> I get an error like: Mismatch between number of
>> word penalties and number of translation systems
>>
>> This happens when I create 2 objects for reading
>> from 2 different tables.
>>
>> My understanding is that there is some problem
>> with Static data but I am not sure.
>>
>> Can anyone help me ?
>>
>> --
>> Raj Dabre.
>> Research Student,
>> Graduate School of Informatics,
>> Kyoto University.
>> CSE MTech, IITB., 2011-2014
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>>
>> --
>> Hieu Hoang
>> Research Associate
>> University of Edinburgh
>> http://www.hoang.co.uk/hieu
>>
>>
>>
>>
>> --
>> Raj Dabre.
>> Research Student,
>> Graduate School of Informatics,
>> Kyoto University.
>> CSE MTech, IITB., 2011-2014
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>>
>> --
>> Hieu Hoang
>> Research Associate
>> University of Edinburgh
>> http://www.hoang.co.uk/hieu
>>
>>
>>
>>
>> --
>> Raj Dabre.
>> Research Student,
>> Graduate School of Informatics,
>> Kyoto University.
>> CSE MTech, IITB., 2011-2014
>>
>>
>>
>>
>> --
>> Hieu Hoang
>> Research Associate
>> University of Edinburgh
>> http://www.hoang.co.uk/hieu
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

Message: 2
Date: Wed, 10 Dec 2014 21:38:03 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] When does this error message occur and
how to fix it
To: moses-support@mit.edu
Message-ID: <5488AF2B.3090004@amu.edu.pl>
Content-Type: text/plain; charset=windows-1252; format=flowed

I'd like that too! :)

W dniu 10.12.2014 o 21:27, Kenneth Heafield pisze:
> I for one would like a version of phrase table querying that doesn't
> depend on the rest of Moses. For cleanliness and for portability
> (there's no reason this shouldn't kill cdec's phrase table for example).
>
> Kenneth
>
> On 12/10/14 13:39, Marcin Junczys-Dowmunt wrote:
>> I am on it, sort of. I am waiting for Raj, to give me a stack trace. I
>> admit this code is basically abandoned, but let's see what we can do.
>>
>> W dniu 10.12.2014 o 19:35, Hieu Hoang pisze:
>>> I see. I'm not sure why the querying depends on StaticData. There may
>>> be some weights is wants to read. Only Marcin will know about that.
>>> You could try to debug yourself.
>>>
>>> If you intend to develop with Moses, I would urge you to update to the
>>> master branch of Moses. People forget how old code works and often
>>> can't answer your questions. The new code has also been cleaned up and
>>> rationalised. For instance, the 'translation system' functionality was
>>> problematic and has been deleted
>>>
>>> On 10 December 2014 at 15:53, Raj Dabre <prajdabre@gmail.com
>>> <mailto:prajdabre@gmail.com>> wrote:
>>>
>>> I am not using any moses.ini because I am not translating anything.
>>> My focus is on reading the phrase tables using a querying program
>>> written by Marcin.
>>>
>>> On Thu, Dec 11, 2014 at 12:50 AM, Hieu Hoang <Hieu.Hoang@ed.ac.uk
>>> <mailto:Hieu.Hoang@ed.ac.uk>> wrote:
>>>
>>> Are you using the translation system functionality in v1? That
>>> seems to be the problem. Can I have a look @ the moses.ini.
>>>
>>> On 10 December 2014 at 15:44, Raj Dabre <prajdabre@gmail.com
>>> <mailto:prajdabre@gmail.com>> wrote:
>>>
>>> I am using an older version (V1).
>>> I am not running a translation experiment but using Java
>>> Native Interface to call C functions.
>>> Can you tell me what might be the problem ?
>>> I can surely say that the root of the problem is in the
>>> StaticData.cpp file.
>>> It seems that I am creating 2 instances of a class trying
>>> to access a background moses process.
>>> Does this sound about right ?
>>>
>>>
>>> On Thu, Dec 11, 2014 at 12:37 AM, Hieu Hoang
>>> <Hieu.Hoang@ed.ac.uk <mailto:Hieu.Hoang@ed.ac.uk>> wrote:
>>>
>>> what version of Moses are you using? The current
>>> master branch on github, or an older version (version
>>> 1 etc)?
>>>
>>> Can I please see the moses.ini file you're using too
>>>
>>> On 10 December 2014 at 12:34, Raj Dabre
>>> <prajdabre@gmail.com <mailto:prajdabre@gmail.com>> wrote:
>>>
>>> Dear all,
>>>
>>> I am using a JNI interface to the CPP code that
>>> reads from binary phrase tables.
>>>
>>> I get an error like: Mismatch between number of
>>> word penalties and number of translation systems
>>>
>>> This happens when I create 2 objects for reading
>>> from 2 different tables.
>>>
>>> My understanding is that there is some problem
>>> with Static data but I am not sure.
>>>
>>> Can anyone help me ?
>>>
>>> --
>>> Raj Dabre.
>>> Research Student,
>>> Graduate School of Informatics,
>>> Kyoto University.
>>> CSE MTech, IITB., 2011-2014
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>>
>>>
>>> --
>>> Hieu Hoang
>>> Research Associate
>>> University of Edinburgh
>>> http://www.hoang.co.uk/hieu
>>>
>>>
>>>
>>>
>>> --
>>> Raj Dabre.
>>> Research Student,
>>> Graduate School of Informatics,
>>> Kyoto University.
>>> CSE MTech, IITB., 2011-2014
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>>
>>>
>>> --
>>> Hieu Hoang
>>> Research Associate
>>> University of Edinburgh
>>> http://www.hoang.co.uk/hieu
>>>
>>>
>>>
>>>
>>> --
>>> Raj Dabre.
>>> Research Student,
>>> Graduate School of Informatics,
>>> Kyoto University.
>>> CSE MTech, IITB., 2011-2014
>>>
>>>
>>>
>>>
>>> --
>>> Hieu Hoang
>>> Research Associate
>>> University of Edinburgh
>>> http://www.hoang.co.uk/hieu
>>>
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support



------------------------------

Message: 3
Date: Wed, 10 Dec 2014 15:37:58 -0500
From: Christian Hardmeier <ch@rax.ch>
Subject: Re: [Moses-support] When does this error message occur and
how to fix it
To: Kenneth Heafield <moses@kheafield.com>
Cc: moses-support@mit.edu
Message-ID: <39C9FC17-68E1-408A-9FB2-0EC0B3DABF86@rax.ch>
Content-Type: text/plain; charset=us-ascii

I'm also a potential user of a standalone phrase table. I currently link my decoder against moses mostly because of the phrase table, and it's not always easy to do so.

/Christian

On 10.12.2014, at 15:27, Kenneth Heafield wrote:

> I for one would like a version of phrase table querying that doesn't
> depend on the rest of Moses. For cleanliness and for portability
> (there's no reason this shouldn't kill cdec's phrase table for example).
>
> Kenneth
>
> On 12/10/14 13:39, Marcin Junczys-Dowmunt wrote:
>> I am on it, sort of. I am waiting for Raj, to give me a stack trace. I
>> admit this code is basically abandoned, but let's see what we can do.
>>
>> W dniu 10.12.2014 o 19:35, Hieu Hoang pisze:
>>> I see. I'm not sure why the querying depends on StaticData. There may
>>> be some weights is wants to read. Only Marcin will know about that.
>>> You could try to debug yourself.
>>>
>>> If you intend to develop with Moses, I would urge you to update to the
>>> master branch of Moses. People forget how old code works and often
>>> can't answer your questions. The new code has also been cleaned up and
>>> rationalised. For instance, the 'translation system' functionality was
>>> problematic and has been deleted
>>>
>>> On 10 December 2014 at 15:53, Raj Dabre <prajdabre@gmail.com
>>> <mailto:prajdabre@gmail.com>> wrote:
>>>
>>> I am not using any moses.ini because I am not translating anything.
>>> My focus is on reading the phrase tables using a querying program
>>> written by Marcin.
>>>
>>> On Thu, Dec 11, 2014 at 12:50 AM, Hieu Hoang <Hieu.Hoang@ed.ac.uk
>>> <mailto:Hieu.Hoang@ed.ac.uk>> wrote:
>>>
>>> Are you using the translation system functionality in v1? That
>>> seems to be the problem. Can I have a look @ the moses.ini.
>>>
>>> On 10 December 2014 at 15:44, Raj Dabre <prajdabre@gmail.com
>>> <mailto:prajdabre@gmail.com>> wrote:
>>>
>>> I am using an older version (V1).
>>> I am not running a translation experiment but using Java
>>> Native Interface to call C functions.
>>> Can you tell me what might be the problem ?
>>> I can surely say that the root of the problem is in the
>>> StaticData.cpp file.
>>> It seems that I am creating 2 instances of a class trying
>>> to access a background moses process.
>>> Does this sound about right ?
>>>
>>>
>>> On Thu, Dec 11, 2014 at 12:37 AM, Hieu Hoang
>>> <Hieu.Hoang@ed.ac.uk <mailto:Hieu.Hoang@ed.ac.uk>> wrote:
>>>
>>> what version of Moses are you using? The current
>>> master branch on github, or an older version (version
>>> 1 etc)?
>>>
>>> Can I please see the moses.ini file you're using too
>>>
>>> On 10 December 2014 at 12:34, Raj Dabre
>>> <prajdabre@gmail.com <mailto:prajdabre@gmail.com>> wrote:
>>>
>>> Dear all,
>>>
>>> I am using a JNI interface to the CPP code that
>>> reads from binary phrase tables.
>>>
>>> I get an error like: Mismatch between number of
>>> word penalties and number of translation systems
>>>
>>> This happens when I create 2 objects for reading
>>> from 2 different tables.
>>>
>>> My understanding is that there is some problem
>>> with Static data but I am not sure.
>>>
>>> Can anyone help me ?
>>>
>>> --
>>> Raj Dabre.
>>> Research Student,
>>> Graduate School of Informatics,
>>> Kyoto University.
>>> CSE MTech, IITB., 2011-2014
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>>
>>>
>>> --
>>> Hieu Hoang
>>> Research Associate
>>> University of Edinburgh
>>> http://www.hoang.co.uk/hieu
>>>
>>>
>>>
>>>
>>> --
>>> Raj Dabre.
>>> Research Student,
>>> Graduate School of Informatics,
>>> Kyoto University.
>>> CSE MTech, IITB., 2011-2014
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>>
>>>
>>> --
>>> Hieu Hoang
>>> Research Associate
>>> University of Edinburgh
>>> http://www.hoang.co.uk/hieu
>>>
>>>
>>>
>>>
>>> --
>>> Raj Dabre.
>>> Research Student,
>>> Graduate School of Informatics,
>>> Kyoto University.
>>> CSE MTech, IITB., 2011-2014
>>>
>>>
>>>
>>>
>>> --
>>> Hieu Hoang
>>> Research Associate
>>> University of Edinburgh
>>> http://www.hoang.co.uk/hieu
>>>
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support




------------------------------

Message: 4
Date: Wed, 10 Dec 2014 21:48:33 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] When does this error message occur and
how to fix it
To: moses-support@mit.edu
Message-ID: <5488B1A1.8080702@amu.edu.pl>
Content-Type: text/plain; charset=windows-1252; format=flowed

I am waiting for some free time around Christmas. Let's see what I can
cook up then. A critical mass of missing/half-implemented features and
heisenbugs has accumulated in the compact phrase table. Before that
hoewever, I would like to find some time to finally fix LM pruning,
maybe next week. The phrase table is next on my list.

W dniu 10.12.2014 o 21:37, Christian Hardmeier pisze:
> I'm also a potential user of a standalone phrase table. I currently link my decoder against moses mostly because of the phrase table, and it's not always easy to do so.
>
> /Christian
>
> On 10.12.2014, at 15:27, Kenneth Heafield wrote:
>
>> I for one would like a version of phrase table querying that doesn't
>> depend on the rest of Moses. For cleanliness and for portability
>> (there's no reason this shouldn't kill cdec's phrase table for example).
>>
>> Kenneth
>>
>> On 12/10/14 13:39, Marcin Junczys-Dowmunt wrote:
>>> I am on it, sort of. I am waiting for Raj, to give me a stack trace. I
>>> admit this code is basically abandoned, but let's see what we can do.
>>>
>>> W dniu 10.12.2014 o 19:35, Hieu Hoang pisze:
>>>> I see. I'm not sure why the querying depends on StaticData. There may
>>>> be some weights is wants to read. Only Marcin will know about that.
>>>> You could try to debug yourself.
>>>>
>>>> If you intend to develop with Moses, I would urge you to update to the
>>>> master branch of Moses. People forget how old code works and often
>>>> can't answer your questions. The new code has also been cleaned up and
>>>> rationalised. For instance, the 'translation system' functionality was
>>>> problematic and has been deleted
>>>>
>>>> On 10 December 2014 at 15:53, Raj Dabre <prajdabre@gmail.com
>>>> <mailto:prajdabre@gmail.com>> wrote:
>>>>
>>>> I am not using any moses.ini because I am not translating anything.
>>>> My focus is on reading the phrase tables using a querying program
>>>> written by Marcin.
>>>>
>>>> On Thu, Dec 11, 2014 at 12:50 AM, Hieu Hoang <Hieu.Hoang@ed.ac.uk
>>>> <mailto:Hieu.Hoang@ed.ac.uk>> wrote:
>>>>
>>>> Are you using the translation system functionality in v1? That
>>>> seems to be the problem. Can I have a look @ the moses.ini.
>>>>
>>>> On 10 December 2014 at 15:44, Raj Dabre <prajdabre@gmail.com
>>>> <mailto:prajdabre@gmail.com>> wrote:
>>>>
>>>> I am using an older version (V1).
>>>> I am not running a translation experiment but using Java
>>>> Native Interface to call C functions.
>>>> Can you tell me what might be the problem ?
>>>> I can surely say that the root of the problem is in the
>>>> StaticData.cpp file.
>>>> It seems that I am creating 2 instances of a class trying
>>>> to access a background moses process.
>>>> Does this sound about right ?
>>>>
>>>>
>>>> On Thu, Dec 11, 2014 at 12:37 AM, Hieu Hoang
>>>> <Hieu.Hoang@ed.ac.uk <mailto:Hieu.Hoang@ed.ac.uk>> wrote:
>>>>
>>>> what version of Moses are you using? The current
>>>> master branch on github, or an older version (version
>>>> 1 etc)?
>>>>
>>>> Can I please see the moses.ini file you're using too
>>>>
>>>> On 10 December 2014 at 12:34, Raj Dabre
>>>> <prajdabre@gmail.com <mailto:prajdabre@gmail.com>> wrote:
>>>>
>>>> Dear all,
>>>>
>>>> I am using a JNI interface to the CPP code that
>>>> reads from binary phrase tables.
>>>>
>>>> I get an error like: Mismatch between number of
>>>> word penalties and number of translation systems
>>>>
>>>> This happens when I create 2 objects for reading
>>>> from 2 different tables.
>>>>
>>>> My understanding is that there is some problem
>>>> with Static data but I am not sure.
>>>>
>>>> Can anyone help me ?
>>>>
>>>> --
>>>> Raj Dabre.
>>>> Research Student,
>>>> Graduate School of Informatics,
>>>> Kyoto University.
>>>> CSE MTech, IITB., 2011-2014
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Hieu Hoang
>>>> Research Associate
>>>> University of Edinburgh
>>>> http://www.hoang.co.uk/hieu
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Raj Dabre.
>>>> Research Student,
>>>> Graduate School of Informatics,
>>>> Kyoto University.
>>>> CSE MTech, IITB., 2011-2014
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Hieu Hoang
>>>> Research Associate
>>>> University of Edinburgh
>>>> http://www.hoang.co.uk/hieu
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Raj Dabre.
>>>> Research Student,
>>>> Graduate School of Informatics,
>>>> Kyoto University.
>>>> CSE MTech, IITB., 2011-2014
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Hieu Hoang
>>>> Research Associate
>>>> University of Edinburgh
>>>> http://www.hoang.co.uk/hieu
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 98, Issue 31
*********************************************

Related Posts :

0 Response to "Moses-support Digest, Vol 98, Issue 31"

Post a Comment