Moses-support Digest, Vol 109, Issue 31

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Can't read LexicalReordering0 in moses.ini from mert-work
folder (Apurva Joshi)
2. not getting proper translation even after tuning (Apurva Joshi)
3. Re: not getting proper translation even after tuning (Hieu Hoang)
4. Fwd: not getting proper translation even after tuning
(Apurva Joshi)


----------------------------------------------------------------------

Message: 1
Date: Sun, 15 Nov 2015 12:54:46 +0530
From: Apurva Joshi <apurvajoshi1992@gmail.com>
Subject: [Moses-support] Can't read LexicalReordering0 in moses.ini
from mert-work folder
To: moses-support@mit.edu
Message-ID:
<CAMfCXbWh-uYw7+R7FGk=t6Xa0DnSQ970Cn0HwfrEVyg-1wGkOQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

i used following command to do tuning

nohup nice ~/mosesdecoder-RELEASE-3.0/scripts/training/mert-moses.pl
~/corpus/corpora.true.en ~/corpus/corpora.true.hi
~/mosesdecoder-RELEASE-3.0/bin/moses ~/working/train/model/moses.ini
--mertdir ~/mosesdecoder-RELEASE-3.0/bin/ &> mert.out &


~/working/train/model/moses.ini == contain

*PhraseDictionaryMemory *name=TranslationModel0 num-features=4*
path=/home/techmahindra/working/train/model/phrase-table.gz* input-factor=0
output-factor=0

*LexicalReordering* name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0

*path=/home/techmahindra/working/train/model/reordering-table.wbe-msd-bidirectional-fe.gz*
Now after tuning , ~/working/mert-work/filtered/moses.ini == contain

*PhraseDictionaryMemory* name=TranslationModel0 num-features=4
*path=/home/techmahindra/working/mert-work/filtered/phrase-table.0-0.1.1.gz*
input-factor=0 output-factor=0

"*phrase-table.0-0.1.1.gz* " is generated in mert-work/filtered folder

*LexicalReordering* name=LexicalReordering0 num-features=6
type=wbe-msd-bidirectional-fe-allff input-factor=0 output-factor=0*
path=/home/techmahindra/working/mert-work/filtered/reordering-table.wbe-msd-bidirectional-fe*

*"reordering-table.wbe-msd-bidirectional-fe" *is not generated in
mert-work/filtered folder....

so when i run moses.ini from mert-work/filtered

its showing error that




*Can't read
/home/techmahindra/working/mert-work/filtered/reordering-table.wbe-msd-bidirectional-fe*
plz help asap
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151115/6be700a9/attachment-0001.html

------------------------------

Message: 2
Date: Sun, 15 Nov 2015 14:32:39 +0530
From: Apurva Joshi <apurvajoshi1992@gmail.com>
Subject: [Moses-support] not getting proper translation even after
tuning
To: moses-support@mit.edu, Nisheeth Joshi <njoshi.in@gmail.com>,
Prashant Mathur <prashant@fbk.eu>, Philipp Koehn <phi@jhu.edu>, David
Madl <david@madlnet.net>
Message-ID:
<CAMfCXbV7TUZY8r4wXeu9=t=mK8FgjofmKwtcMCN53=hFtYjwuw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

hello,

i done with tuning, after tuning i observed that , there is only 0.5%
improvement in translated op as compared to translation without tuning..

i used mert method

i used following command to do tuning

cd ~/working
nohup nice ~/mosesdecoder-RELEASE-3.0/ \

scripts/training/mert-moses.pl \

~/corpus/corpora.true.en \

~/corpus/corpora.true.hi \

~/mosesdecoder-RELEASE-3.0/bin/moses \

train/model/moses.ini --mertdir ~/mosesdecoder/bin/ \
&> mert.out &

in manual 2 methods are defined for tuning 1.batch 2.online

which one should i use?

i done tuning with mert...there is no weight difference in moses.ini
in mert-work folder

and that of in train/model folder...

so what is solution?

ie after tuning should the weight in moses.ini in mert-work folder and

train/model same or different???

plz helpppp
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151115/3b2dbc89/attachment-0001.html

------------------------------

Message: 3
Date: Sun, 15 Nov 2015 09:16:12 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] not getting proper translation even after
tuning
To: Apurva Joshi <apurvajoshi1992@gmail.com>
Cc: moses-support <moses-support@mit.edu>, Philipp Koehn <phi@jhu.edu>
Message-ID:
<CAEKMkbipZZhkJXCDhpHXxuAEZU+7xMra-pC48eEm90tzijfHXw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

when you run tuning, there should also be another argument
mert-moses.pl .... --working-dir whatever
The tuned moses.ini will be created as
whatever/moses.ini
This is the moses.ini file you should use

Hieu Hoang
http://www.hoang.co.uk/hieu

On 15 November 2015 at 09:02, Apurva Joshi <apurvajoshi1992@gmail.com>
wrote:

> hello,
>
> i done with tuning, after tuning i observed that , there is only 0.5%
> improvement in translated op as compared to translation without tuning..
>
> i used mert method
>
> i used following command to do tuning
>
> cd ~/working
> nohup nice ~/mosesdecoder-RELEASE-3.0/ \
>
> scripts/training/mert-moses.pl \
>
> ~/corpus/corpora.true.en \
>
> ~/corpus/corpora.true.hi \
>
> ~/mosesdecoder-RELEASE-3.0/bin/moses \
>
> train/model/moses.ini --mertdir ~/mosesdecoder/bin/ \
> &> mert.out &
>
> in manual 2 methods are defined for tuning 1.batch 2.online
>
> which one should i use?
>
> i done tuning with mert...there is no weight difference in moses.ini in mert-work folder
>
> and that of in train/model folder...
>
> so what is solution?
>
> ie after tuning should the weight in moses.ini in mert-work folder and
>
> train/model same or different???
>
> plz helpppp
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151115/71757a77/attachment-0001.html

------------------------------

Message: 4
Date: Sun, 15 Nov 2015 14:56:18 +0530
From: Apurva Joshi <apurvajoshi1992@gmail.com>
Subject: [Moses-support] Fwd: not getting proper translation even
after tuning
To: moses-support@mit.edu
Message-ID:
<CAMfCXbWnzs1pwciz3j5uPRvTeySdC=6Qh9VN+dgn+_EO4=KaOw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

---------- Forwarded message ----------
From: Apurva Joshi <apurvajoshi1992@gmail.com>
Date: Sun, Nov 15, 2015 at 2:56 PM
Subject: Re: [Moses-support] not getting proper translation even after
tuning
To: Hieu Hoang <hieuhoang@gmail.com>


hi hieu

m not getting about what u said about " mert-moses.pl .... --working-dir
whatever"

general command for tuning is

cd working

mert-moses.pl input corpus.true output corpus.true moses
train/model/moses.ini *--mertdir* ~/mosesdecoder/bin/ \ &> mert.out &

now after this mert-work folder is generated

now in above command exactly what changes should i do? plz tell me..

On Sun, Nov 15, 2015 at 2:46 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:

> when you run tuning, there should also be another argument
> mert-moses.pl .... --working-dir whatever
> The tuned moses.ini will be created as
> whatever/moses.ini
> This is the moses.ini file you should use
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 15 November 2015 at 09:02, Apurva Joshi <apurvajoshi1992@gmail.com>
> wrote:
>
>> hello,
>>
>> i done with tuning, after tuning i observed that , there is only 0.5%
>> improvement in translated op as compared to translation without tuning..
>>
>> i used mert method
>>
>> i used following command to do tuning
>>
>> cd ~/working
>> nohup nice ~/mosesdecoder-RELEASE-3.0/ \
>>
>> scripts/training/mert-moses.pl \
>>
>> ~/corpus/corpora.true.en \
>>
>> ~/corpus/corpora.true.hi \
>>
>> ~/mosesdecoder-RELEASE-3.0/bin/moses \
>>
>> train/model/moses.ini --mertdir ~/mosesdecoder/bin/ \
>> &> mert.out &
>>
>> in manual 2 methods are defined for tuning 1.batch 2.online
>>
>> which one should i use?
>>
>> i done tuning with mert...there is no weight difference in moses.ini in mert-work folder
>>
>> and that of in train/model folder...
>>
>> so what is solution?
>>
>> ie after tuning should the weight in moses.ini in mert-work folder and
>>
>> train/model same or different???
>>
>> plz helpppp
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151115/d6e95ac0/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 109, Issue 31
**********************************************

0 Response to "Moses-support Digest, Vol 109, Issue 31"

Post a Comment