Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Problem with mkcls Linux x32 (Hieu Hoang)
2. Re: Problem with mkcls Linux x32 (????????? ?????)
3. Re: Problem with mkcls Linux x32 (Hieu Hoang)
4. Re: Figuring out how to load language models (Lars Bungum)
----------------------------------------------------------------------
Message: 1
Date: Tue, 10 Jun 2014 14:06:23 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Problem with mkcls Linux x32
To: ????????? ????? <a.komin@bk.ru>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbgvi5mcHDPtu18KPNnpATKtxDcd1=6pzUuTtCOw2uTJqQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
are you sure your data is encoded in utf8, tokenized and cleaned? ie.
there;s no double spaces, tab characters, non-printing characters?
On 9 June 2014 09:38, ????????? ????? <a.komin@bk.ru> wrote:
> I'm trying to run on Linux (x32)
>
> ./mkcls -c50 -n2 -p./corpus/euro.de -V./corpus/de.vcb.classes opt
>
> I have problems:
>
> user-R560 training # ./mkcls -c50 -n2 -p./corpus/euro.de
> -V./corpus/de.vcb.classes opt
> mkcls: /home/hieu/workspace/mgizapp/mgizapp/src/mkcls/StatVar.cpp:116:
> double StatVar::quantil(double): Assertion `index>=0&&index<n' failed.
> Aborted
>
>
> Can you help me?
>
>
>
> --
> ????????? ?????
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140610/53b09f26/attachment-0001.htm
------------------------------
Message: 2
Date: Tue, 10 Jun 2014 17:28:28 +0400
From: ????????? ????? <a.komin@bk.ru>
Subject: Re: [Moses-support] Problem with mkcls Linux x32
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <1402406908.841378087@f357.i.mail.ru>
Content-Type: text/plain; charset="utf-8"
Yes.
Tue, 10 Jun 2014 14:06:23 +0100 ?? Hieu Hoang <Hieu.Hoang@ed.ac.uk>:
>are you sure your data is encoded in utf8, tokenized and cleaned? ie. there;s no double spaces, tab characters, non-printing characters?
>
>
>On 9 June 2014 09:38, ????????? ????? < a.komin@bk.ru > wrote:
>>I'm trying to run? on Linux (x32)
>>
>>./mkcls -c50 -n2 -p./corpus/ euro.de -V./corpus/de.vcb.classes opt
>>
>>I have problems:
>>
>>user-R560 training # ./mkcls -c50 -n2 -p./corpus/ euro.de -V./corpus/de.vcb.classes opt
>>mkcls: /home/hieu/workspace/mgizapp/mgizapp/src/mkcls/StatVar.cpp:116: double StatVar::quantil(double): Assertion `index>=0&&index<n' failed.
>>Aborted
>>
>>
>>Can you help me?
>>
>>
>>
>>--
>>????????? ?????
>>_______________________________________________
>>Moses-support mailing list
>>Moses-support@mit.edu
>>http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
>
>--
>Hieu Hoang
>Research Associate
>University of Edinburgh
>http://www.hoang.co.uk/hieu
>
--
????????? ?????
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140610/87f8293e/attachment-0001.htm
------------------------------
Message: 3
Date: Tue, 10 Jun 2014 15:09:40 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Problem with mkcls Linux x32
To: ????????? ????? <a.komin@bk.ru>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbjwaeWWSxMPoMO2FRPZEpSSQZA5_=atd42FVUFMivXmew@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
then I'm out of ideas. Things you could try
1.debug it a little more yourself, eg. try to isolate what data is
causing the problem by training with only a small part of the data.
2.there may be inconsistency with the mkcls binaries you've downloaded
from and your OS. COmpile mgiza yourself
3. use absolute paths, ie. not
./corpus/de.vcb.classes opt
but
/home/aaa/corpus/de.vcb.classes opt
On 10 June 2014 14:28, ????????? ????? <a.komin@bk.ru> wrote:
> Yes.
>
>
> Tue, 10 Jun 2014 14:06:23 +0100 ?? Hieu Hoang <Hieu.Hoang@ed.ac.uk>:
>
> are you sure your data is encoded in utf8, tokenized and cleaned? ie.
> there;s no double spaces, tab characters, non-printing characters?
>
>
> On 9 June 2014 09:38, ????????? ????? <a.komin@bk.ru
> <https://e.mail.ru/compose/?mailto=mailto%3aa.komin@bk.ru>> wrote:
>
> I'm trying to run on Linux (x32)
>
> ./mkcls -c50 -n2 -p./corpus/euro.de -V./corpus/de.vcb.classes opt
>
> I have problems:
>
> user-R560 training # ./mkcls -c50 -n2 -p./corpus/euro.de
> -V./corpus/de.vcb.classes opt
> mkcls: /home/hieu/workspace/mgizapp/mgizapp/src/mkcls/StatVar.cpp:116:
> double StatVar::quantil(double): Assertion `index>=0&&index<n' failed.
> Aborted
>
>
> Can you help me?
>
>
>
> --
> ????????? ?????
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> <https://e.mail.ru/compose/?mailto=mailto%3aMoses%2dsupport@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
> --
> ????????? ?????
>
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140610/c61117fa/attachment-0001.htm
------------------------------
Message: 4
Date: Tue, 10 Jun 2014 17:10:22 +0200
From: Lars Bungum <lars.bungum@idi.ntnu.no>
Subject: Re: [Moses-support] Figuring out how to load language models
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <53971FDE.7020201@idi.ntnu.no>
Content-Type: text/plain; charset=UTF-8; format=flowed
On 10. juni 2014 14:46, Hieu Hoang wrote:
> a language model ultimately inherits from FeatureFunction. It loads
> data by overriding
> virtual void Load();
I see that this is called in void StaticData::LoadFeatureFunctions(),
which in turn is populated by FeatureFunction::GetFeatureFunctions().
Is that correct?
What I want is to load all the LMs initially, but not using them all
"side by side" while decoding, but in order to produce a special
feature. Can I use the current infrastructure to do this? By giving
their paths in moses.ini and somehow accessing them in my custom feature
inside FF/ ? Loading the LMs each time inside the feature will be to
slow, so I need some way to access the "centrally" loaded LMs.
//LB
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 92, Issue 23
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 92, Issue 23"
Post a Comment