Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: optimizing lattice InputFeature weight (Jorg Tiedemann)
2. Re: Error while compile with nplm (Nikolay Bogoychev)
3. Re: optimizing lattice InputFeature weight (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Sat, 7 Feb 2015 21:35:10 +0100
From: Jorg Tiedemann <tiedeman@gmail.com>
Subject: Re: [Moses-support] optimizing lattice InputFeature weight
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <9981586F-3161-4828-A272-5A3A5AFB548B@gmail.com>
Content-Type: text/plain; charset="iso-8859-1"
inputtype is set to 2. I really don't know why this doesn't work.
Here an example:
lattice input:
((('muutoksia',0.5,1),('Muutoksia',0.9,1),),(('yritystukik?yt?nt?ihin',0.9,3),('yritys',0.5,1),),(('tuki',0.5,1),),(('k?yt?nt?ihin',0.5,1),),(('-',0.9,1),),(('Maakunta',0.9,2),('maa',0.5,1),),(('kunta',0.5,1),),(('-',0.9,1),),(('Alueet',0.9,1),('alueet',0.5,1),),(('-',0.9,1),),(('Uutiset',0.9,1),('uutiset',0.5,1),),(('-',0.9,1),),(('Karjalainen',0.9,1),('karjalainen',0.5,1),),)
nbest-list:
0 ||| changes in the business practices - - - news - karjalainen ||| Distortion0= -6 LM0= -74.8382 InputFeature0= 0 WordPenalty0= -11 PhrasePenalty0= 11 TranslationModel0= -45.7094 -47.7159 -16.804 -11.8221 ||| -50.4294
0 ||| changes in the business practices - - - news - karjalainen ||| Distortion0= -6 LM0= -74.8382 InputFeature0= 0 WordPenalty0= -11 PhrasePenalty0= 10 TranslationModel0= -45.7472 -47.7159 -16.5762 -11.8221 ||| -50.5914
...
The InputFeature0 is always 0
Decoding output includes:
0 -- (muutoksia , , -0.6931) (Muutoksia , , -0.1051)
1 -- (yritystukik?yt?nt?ihin , , -0.1053) (yritys , , -0.6931)
2 -- (tuki , , -0.6931)
3 -- (k?yt?nt?ihin , , -0.6931)
4 -- (- , , -0.1051)
5 -- (Maakunta , , -0.1052) (maa , , -0.6931)
6 -- (kunta , , -0.6931)
7 -- (- , , -0.1051)
8 -- (Alueet , , -0.1051) (alueet , , -0.6931)
9 -- (- , , -0.1051)
10 -- (Uutiset , , -0.1051) (uutiset , , -0.6931)
11 -- (- , , -0.1051)
12 -- (Karjalainen , , -0.1051) (karjalainen , , -0.6931)
What I don't understand is why there is an empty field in the output above.
And the config file sets the weight for InputFeature0 to 1:
[feature]
InputFeature num-features=1 num-input-features=1 real-word-count=0
....
# dense weights for feature functions
[weight]
InputFeature0= 1
Strange ...
J?rg
J?rg Tiedemann
tiedeman@gmail.com
On Feb 7, 2015, at 9:21 PM, Hieu Hoang wrote:
> there's no reason why it shouldn't work.
>
> the only thing i can think of is that the input type hasn't been set to lattice. In the moses.ini, there should be something like
> [inputtype]
> 2
> or on the command line
> moses -inputtype 2
>
>
> Hieu Hoang
> Research Associate (until March 2015)
> ** searching for interesting commercial MT position **
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
> On 7 February 2015 at 20:05, Jorg Tiedemann <tiedeman@gmail.com> wrote:
>
> I have a problem with lattice decoding and optimizing input-feature weights. I have edge weights in my lattice input (one per edge) and I defined one input feature that I'd like to optimize using MERT. However, my the input feature value is always 0 in the nbest lists even though none of the input edges has value 1 (or 0). What do I do wrong?
>
> My initial config file includes:
>
> [feature]
> InputFeature num-features=1 num-input-features=1 real-word-count=0
> ...
> # dense weights for feature functions
> [weight]
> InputFeature0= 1
>
> The lattice input is valid and looks like this:
>
> ((('word',0.8,1),('word',0.6,1), ....
>
> MERT tuning fails in the end especially because the input feature cannot be set.
> Any help is very much appreciated.
> Thanks,
> J?rg
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150207/88d00ff2/attachment-0001.htm
------------------------------
Message: 2
Date: Sat, 7 Feb 2015 20:55:50 +0000
From: Nikolay Bogoychev <nheart@gmail.com>
Subject: Re: [Moses-support] Error while compile with nplm
To: Jianri Li <skywalker@postech.ac.kr>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAJzPUEwT3txBk7FdPHY6gq9ST78aoPbMHyr1G4kDKdewLpnWrQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hey,
In order to use NPLM with moses you should use this fork of NPLM:
https://github.com/rsennrich/nplm
Cheers,
Nick
On Sat, Feb 7, 2015 at 6:22 PM, Jianri Li <skywalker@postech.ac.kr> wrote:
> Hi, moses users
> I was trying to compile with nplm, but I got some errors like this:
> ----------------------
> moses/LM/NeuralLMWrapper.cpp:37:22: error: ?class nplm::neuralLM? has no
> member named ?premultiply?
> ! -----------------------
> I check the source code in nplm, actually there is no premultiply ...
> I downloaded the code from http://nlg.isi.edu/software/nplm/ which is
> listed in the moses homepage (NPLM) .
> And my compile option is : ./bjam --with-boost=/path-to/boost_1_55_0
> --with-cmph=/path-to/cmph-2.0 --with-nplm=/path-to/nplm -j24
> If you have any idea, please help me.
> Thank you.
>
> Helson
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150207/c839187b/attachment-0001.htm
------------------------------
Message: 3
Date: Sat, 07 Feb 2015 22:50:25 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] optimizing lattice InputFeature weight
To: Jorg Tiedemann <tiedeman@gmail.com>, Hieu Hoang
<Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <54D696B1.8010500@gmail.com>
Content-Type: text/plain; charset="windows-1252"
i think there's a problem with it and it's my fault. Let me check it and
get back to you
On 07/02/15 20:35, Jorg Tiedemann wrote:
>
> inputtype is set to 2. I really don't know why this doesn't work.
>
> Here an example:
>
> lattice input:
>
> ((('muutoksia',0.5,1),('Muutoksia',0.9,1),),(('yritystukik?yt?nt?ihin',0.9,3),('yritys',0.5,1),),(('tuki',0.5,1),),(('k?yt?nt?ihin',0.5,1),),(('-',0.9,1),),(('Maakunta',0.9,2),('maa',0.5,1),),(('kunta',0.5,1),),(('-',0.9,1),),(('Alueet',0.9,1),('alueet',0.5,1),),(('-',0.9,1),),(('Uutiset',0.9,1),('uutiset',0.5,1),),(('-',0.9,1),),(('Karjalainen',0.9,1),('karjalainen',0.5,1),),)
>
> nbest-list:
> 0 ||| changes in the business practices - - - news - karjalainen |||
> Distortion0= -6 LM0= -74.8382 InputFeature0= 0 WordPenalty0= -11
> PhrasePenalty0= 11 TranslationModel0= -45.7094 -47.7159 -16.804
> -11.8221 ||| -50.4294
> 0 ||| changes in the business practices - - - news - karjalainen |||
> Distortion0= -6 LM0= -74.8382 InputFeature0= 0 WordPenalty0= -11
> PhrasePenalty0= 10 TranslationModel0= -45.7472 -47.7159 -16.5762
> -11.8221 ||| -50.5914
> ...
>
> The InputFeature0 is always 0
>
> Decoding output includes:
> 0 -- (muutoksia , , -0.6931) (Muutoksia , , -0.1051)
> 1 -- (yritystukik?yt?nt?ihin , , -0.1053) (yritys , , -0.6931)
> 2 -- (tuki , , -0.6931)
> 3 -- (k?yt?nt?ihin , , -0.6931)
> 4 -- (- , , -0.1051)
> 5 -- (Maakunta , , -0.1052) (maa , , -0.6931)
> 6 -- (kunta , , -0.6931)
> 7 -- (- , , -0.1051)
> 8 -- (Alueet , , -0.1051) (alueet , , -0.6931)
> 9 -- (- , , -0.1051)
> 10 -- (Uutiset , , -0.1051) (uutiset , , -0.6931)
> 11 -- (- , , -0.1051)
> 12 -- (Karjalainen , , -0.1051) (karjalainen , , -0.6931)
>
> What I don't understand is why there is an empty field in the output
> above.
>
> And the config file sets the weight for InputFeature0 to 1:
>
> [feature]
> InputFeature num-features=1 num-input-features=1 real-word-count=0
> ....
> # dense weights for feature functions
> [weight]
> InputFeature0= 1
>
> Strange ...
>
> J?rg
>
>
> J?rg Tiedemann
> tiedeman@gmail.com <mailto:tiedeman@gmail.com>
>
>
>
>
> On Feb 7, 2015, at 9:21 PM, Hieu Hoang wrote:
>
>> there's no reason why it shouldn't work.
>>
>> the only thing i can think of is that the input type hasn't been set
>> to lattice. In the moses.ini, there should be something like
>> [inputtype]
>> 2
>> or on the command line
>> moses -inputtype 2
>>
>>
>> Hieu Hoang
>> Research Associate (until March 2015)
>> ** searching for interesting commercial MT position **
>> University of Edinburgh
>> http://www.hoang.co.uk/hieu
>>
>>
>> On 7 February 2015 at 20:05, Jorg Tiedemann <tiedeman@gmail.com
>> <mailto:tiedeman@gmail.com>> wrote:
>>
>>
>> I have a problem with lattice decoding and optimizing
>> input-feature weights. I have edge weights in my lattice input
>> (one per edge) and I defined one input feature that I'd like to
>> optimize using MERT. However, my the input feature value is
>> always 0 in the nbest lists even though none of the input edges
>> has value 1 (or 0). What do I do wrong?
>>
>> My initial config file includes:
>>
>> [feature]
>> InputFeature num-features=1 num-input-features=1 real-word-count=0
>> ...
>> # dense weights for feature functions
>> [weight]
>> InputFeature0= 1
>>
>> The lattice input is valid and looks like this:
>>
>> ((('word',0.8,1),('word',0.6,1), ....
>>
>> MERT tuning fails in the end especially because the input feature
>> cannot be set.
>> Any help is very much appreciated.
>> Thanks,
>> J?rg
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
--
Hieu Hoang
Research Associate (until March 2015)
** searching for interesting commercial MT position **
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150207/9b7e6ad9/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 100, Issue 28
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 100, Issue 28"
Post a Comment