Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Documentation describing Moses n-best list extraction
(Matthias Huck)
2. Re: Documentation describing Moses n-best list extraction
(Philip Williams)
3. Re: coredump (fatma elzahraa Eltaher)
4. Re: coredump (fatma elzahraa Eltaher)
----------------------------------------------------------------------
Message: 1
Date: Sat, 28 Feb 2015 17:24:35 +0000
From: Matthias Huck <mhuck@inf.ed.ac.uk>
Subject: Re: [Moses-support] Documentation describing Moses n-best
list extraction
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>, Philip James
Williams <p.j.williams-2@sms.ed.ac.uk>
Message-ID: <1425144275.1876.8.camel@inf.ed.ac.uk>
Content-Type: text/plain; charset="UTF-8"
On Sat, 2015-02-28 at 17:11 +0000, Matthias Huck wrote:
> On Sat, 2015-02-28 at 16:45 +0000, Hieu Hoang wrote:
> > i've never seen the phrase-based n-best extraction explicitly
> > described. There was a paper on directed graph enumeration (I forget
> > which) that was helpful t me when I was implementing it.
>
>
> Maybe this?
>
> Hart, P., Nilsson, N., and Raphael, B., "A Formal Basis for the
> Heuristic Determination of Minimum Cost Paths," IEEE Trans. Syst.
> Science and Cybernetics, SSC-4(2):100-107, 1968.
>
> http://ai.stanford.edu/~nilsson/OnlinePubs-Nils/PublishedPapers/astar.pdf
And here's a paper from 2002 that describes the application of A* for
n-best list extraction from word graphs in statistical machine
translation (Section 4.3 & Table 1):
N. Ueffing, F. J. Och, and H. Ney. Generation of Word Graphs in
Statistical Machine Translation. In Proc. of the Conference on Empirical
Methods for Natural Language Processing, pages 156-163, Philadelphia,
PA, USA, July 2002.
https://www-i6.informatik.rwth-aachen.de/publications/download/443/UeffingN.OchF.J.NeyH.--GenerationofWordGraphsinStatisticalMachineTranslation--2002.ps
>
>
>
> > However, it's a fairly simple dynamic programming algorithm
> >
> >
> > The scfg-based extraction is different. I think it's based on 1 of
> > Liang Huang's paper, however, Phil can tell you more.
> >
> >
> > It was formerly based on the same algorithm as pb, but it was found
> > out to be incorrect and missing some paths
> >
> > Hieu Hoang
> > Research Associate (until March 2015)
> >
> > ** searching for interesting commercial MT position **
> >
> > University of Edinburgh
> > http://www.hoang.co.uk/hieu
> >
> >
> >
> > On 25 February 2015 at 13:08, Lane Schwartz <dowobeha@gmail.com>
> > wrote:
> > Is there a particular paper that describes the current
> > technique(s)
> > used for n-best list extraction within Moses?
> >
> > Thanks,
> > Lane
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> > The University of Edinburgh is a charitable body, registered in
> > Scotland, with registration number SC005336.
>
>
>
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
------------------------------
Message: 2
Date: Sat, 28 Feb 2015 17:35:12 +0000
From: Philip Williams <philip.williams@mac.com>
Subject: Re: [Moses-support] Documentation describing Moses n-best
list extraction
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>, Philip James
Williams <p.j.williams-2@sms.ed.ac.uk>
Message-ID: <DCD7D55D-65F5-4E07-861A-3D8A308EA3EE@mac.com>
Content-Type: text/plain; charset="us-ascii"
For the syntax-based decoding algorithms, n-best list extraction is done with algorithm 3 from this paper:
Liang Huang and David Chiang
"Better k-best parsing"
In Proceedings of IWPT 2005
For phrase-based SMT, Philipp's textbook has a very readable description of the algorithm (section 9.1.3).
Phil
On 28 Feb 2015, at 16:45, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:
> i've never seen the phrase-based n-best extraction explicitly described. There was a paper on directed graph enumeration (I forget which) that was helpful t me when I was implementing it. However, it's a fairly simple dynamic programming algorithm
>
> The scfg-based extraction is different. I think it's based on 1 of Liang Huang's paper, however, Phil can tell you more.
>
> It was formerly based on the same algorithm as pb, but it was found out to be incorrect and missing some paths
>
> Hieu Hoang
> Research Associate (until March 2015)
> ** searching for interesting commercial MT position **
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
> On 25 February 2015 at 13:08, Lane Schwartz <dowobeha@gmail.com> wrote:
> Is there a particular paper that describes the current technique(s)
> used for n-best list extraction within Moses?
>
> Thanks,
> Lane
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150228/a100d321/attachment-0001.htm
------------------------------
Message: 3
Date: Sat, 28 Feb 2015 20:59:33 +0200
From: fatma elzahraa Eltaher <fatmaeltaher@gmail.com>
Subject: Re: [Moses-support] coredump
To: moses-support@mit.edu
Message-ID:
<CAOW1BbS4DYThLwn07qyurRrh13-=S7eCFEQthr3-ObqYGgW-Qg@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"
is there any answer for that???
thank you,
Fatma El-Zahraa El -Taher
Teaching Assistant at Computer & System department
Faculty of Engineering, Azhar University
Email : fatmaeltaher@gmail.com
mobile: +201141600434
On Sat, Feb 28, 2015 at 12:22 AM, fatma elzahraa Eltaher <
fatmaeltaher@gmail.com> wrote:
> I try to run example in manual : and in this step 2.3.5 Training the
> Translation System
> I run the following command
> ohup nice
> /home/fatma/Desktop/Folder_Moses/mosesdecoder/scripts/training/train-model.perl
> -root-dir train \
> -corpus /home/fatma/Desktop/corpus/news-commentary-v8.fr-en.clean \
> -f fr -e en -alignment grow-diag-final-and -reordering
> msd-bidirectional-fe \
> -lm 0:3:/home/fatma/Desktop/corpus/lm/news-commentary-v8.fr-en.blm.en:8 \
> -external-bin-dir /home/fatma/Desktop/external-bin >& training.out &
> but I get error .
> I attached
> training.out
>
> <https://mail.google.com/mail/u/0/?ui=2&ik=087e92bbdb&view=att&th=14bcd21c3b99930e&attid=0.1&disp=safe&realattid=f_i6o56fld0&zw>
>
>
> thank you,
>
>
>
> Fatma El-Zahraa El -Taher
>
> Teaching Assistant at Computer & System department
>
> Faculty of Engineering, Azhar University
>
> Email : fatmaeltaher@gmail.com
> mobile: +201141600434
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150228/a4a434e0/attachment-0001.htm
------------------------------
Message: 4
Date: Sat, 28 Feb 2015 22:03:39 +0200
From: fatma elzahraa Eltaher <fatmaeltaher@gmail.com>
Subject: Re: [Moses-support] coredump
To: moses-support@mit.edu
Message-ID:
<CAOW1BbRC3QnYqmyJetoQsCepjdkK5GYgYsSkWW5=6a2yuUSYXA@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"
thanks I fixed it.
thank you,
Fatma El-Zahraa El -Taher
Teaching Assistant at Computer & System department
Faculty of Engineering, Azhar University
Email : fatmaeltaher@gmail.com
mobile: +201141600434
On Sat, Feb 28, 2015 at 8:59 PM, fatma elzahraa Eltaher <
fatmaeltaher@gmail.com> wrote:
> is there any answer for that???
>
>
> thank you,
>
>
>
> Fatma El-Zahraa El -Taher
>
> Teaching Assistant at Computer & System department
>
> Faculty of Engineering, Azhar University
>
> Email : fatmaeltaher@gmail.com
> mobile: +201141600434
>
>
> On Sat, Feb 28, 2015 at 12:22 AM, fatma elzahraa Eltaher <
> fatmaeltaher@gmail.com> wrote:
>
>> I try to run example in manual : and in this step 2.3.5 Training the
>> Translation System
>> I run the following command
>> ohup nice
>> /home/fatma/Desktop/Folder_Moses/mosesdecoder/scripts/training/train-model.perl
>> -root-dir train \
>> -corpus /home/fatma/Desktop/corpus/news-commentary-v8.fr-en.clean \
>> -f fr -e en -alignment grow-diag-final-and -reordering
>> msd-bidirectional-fe \
>> -lm 0:3:/home/fatma/Desktop/corpus/lm/news-commentary-v8.fr-en.blm.en:8 \
>> -external-bin-dir /home/fatma/Desktop/external-bin >& training.out &
>> but I get error .
>> I attached
>> training.out
>>
>> <https://mail.google.com/mail/u/0/?ui=2&ik=087e92bbdb&view=att&th=14bcd21c3b99930e&attid=0.1&disp=safe&realattid=f_i6o56fld0&zw>
>>
>>
>> thank you,
>>
>>
>>
>> Fatma El-Zahraa El -Taher
>>
>> Teaching Assistant at Computer & System department
>>
>> Faculty of Engineering, Azhar University
>>
>> Email : fatmaeltaher@gmail.com
>> mobile: +201141600434
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150228/f04cbe1a/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 100, Issue 102
***********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 100, Issue 102"
Post a Comment