Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. NAACL-HLT 2015: Student Volunteer Program (Saif Mohammad)
2. Re: Bilm train "IndexError: list index out of range"
(Marwa Refaie)
3. Re: [decoding-graph-backoff] (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Thu, 16 Apr 2015 22:02:21 -0400
From: Saif Mohammad <uvgotsaif@gmail.com>
Subject: [Moses-support] NAACL-HLT 2015: Student Volunteer Program
To: "Mohammad, Saif" <saif.mohammad@nrc-cnrc.gc.ca>
Message-ID:
<CALu_-OQv9ET25ZpuFxx40YcsLP7vTmiee0W6fj+CG=RskEB-Cw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
STUDENT VOLUNTEER PROGRAM
NAACL-HLT 2015
We seek a limited number of student volunteers for the 2015 Conference of
the North American Chapter of the Association for Computational Linguistics
- Human Language Technology.
Volunteers are assigned one full day's work. The work will be divided,
probably into two half-day shifts, and the shifts will be scheduled to
maximize volunteer access to the conference events. Tasks include assisting
at the registration desk, stuffing delegate packs, and providing technical
assistance for conference events including tutorials, the main conference,
and workshops.
Preference will be given to students who have papers accepted at the main
conference or workshops.
In return for volunteering work, the students receive free registration to
the main conference. Workshops and tutorials are not included, and must be
paid for by the student.
Application deadline: April 29, 2015
Notification of acceptance: May 4, 2015
= Submission procedure =
To apply for the Student Volunteer Program, please fill out this grant
application form:
http://goo.gl/forms/6x5kKlSRdu
All Student Volunteer Award recipients must register for the conference,
selecting "I am a Student Volunteer" in the main conference section.
Students will be reimbursed by the office manager, Priscilla Rasmussen,
after the conference and upon providing original receipts and an accounting
of the requested funding (i.e., a business expense report).
= Contact =
Student volunteers chair
Annie Louis, University of Edinburgh
alouis@inf.ed.ac.uk
--
Saif Mohammad
Research Officer
Information and Communications Technologies Portfolio
National Research Council Canada
http://www.saifmohammad.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150416/580d0cc4/attachment-0001.htm
------------------------------
Message: 2
Date: Sat, 18 Apr 2015 21:00:55 +0000
From: Marwa Refaie <basmallah@hotmail.com>
Subject: Re: [Moses-support] Bilm train "IndexError: list index out of
range"
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <DUB118-W15DB7CEC75D4F15ACF0186BAE20@phx.gbl>
Content-Type: text/plain; charset="windows-1256"
Just for anyone with same obstacles : it solved by binarize the phrase table as follows
If phrase
table is large
~/mosesdecoder/bin/CreateOnDiskPt 1 1 4 100 2
~/Phd/April/nplm/-dir/model/phrase-table.gz phrase-table.folder
Change
moses.ini ::
[feature]
PhraseDictionaryMemory path=phrase-table.1.gz ....
to
[feature]
PhraseDictionaryOnDisk path=phrase-table.1.folder ....
Marwa N. Refaie
From: basmallah@hotmail.com
To: moses-support@mit.edu
Subject: Bilm train "IndexError: list index out of range"
Date: Fri, 17 Apr 2015 22:48:29 +0000
Hi all,
I trained BiLM with English-Arabic corpus , & it give better Blue score. But when work with different bigger corpus I have this error !! target_aligns[tpos].append(spos)IndexError: list index out of range
I have file .ngrams which stopped after small no of lines by this error ??? any help plz ??
2015-04-18 00:42:19 INFO: Vocabulary size: 111432015-04-18 00:42:19 INFO: Reading vocabulary from ai2.true.ar....................2015-04-18 00:42:19 INFO: Vocabulary size: 162402015-04-18 00:42:19 INFO: Extracting ngramsTraceback (most recent call last): File "/home/marwa/mosesdecoder/scripts/training/bilingual-lm/extract_training.py", line 167, in <module> main() File "/home/marwa/mosesdecoder/scripts/training/bilingual-lm/extract_training.py", line 107, in main ofh) File "/home/marwa/mosesdecoder/scripts/training/bilingual-lm/extract.py", line 74, in get_ngrams target_aligns[tpos].append(spos)IndexError: list index out of range
Marwa N. Refaie
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150418/805c6020/attachment-0001.htm
------------------------------
Message: 3
Date: Sun, 19 Apr 2015 12:52:02 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] [decoding-graph-backoff]
To: Matthias Huck <mhuck@inf.ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbg8fxt_XbrfPwe-AWGZ8KWuSe+EHQjtC1S4RqKYga-ypw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
i used the following simple moses.ini file. the decoder seems to be doing
what is expected. Models, input and & output attached.
[input-factors]
0
[mapping]
0 T 0
1 T 1
[feature]
UnknownWordPenalty
PhraseDictionaryCompact name=pt input-factor=0 output-factor=0
path=pt.compact num-features=1
PhraseDictionaryCompact name=pt2 input-factor=0 output-factor=0
path=pt2.compact num-features=1
[weight]
pt= 1
pt2= 1
[decoding-graph-backoff]
0
1
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu
On 17 April 2015 at 01:26, Matthias Huck <mhuck@inf.ed.ac.uk> wrote:
> I think your remark in the mail from January was correct, it has to be
> ePos-sPos+1 > backoff
> but currently still is
> ePos-sPos+1 <= backoff
>
> Are you able to somehow test this?
>
>
> On Thu, 2015-04-16 at 23:57 +0400, Hieu Hoang wrote:
> > ah yes, I thought the backoff was doing the opposite to what it's
> > supposed to do so I changed the comparison around. I checked that it
> > backed off, but i didn't run it through tuning.
> >
> > it may still be wrong, or there may be strange interaction with the
> tuning.
> >
> >
> > On 16/04/2015 22:16, Matthias Huck wrote:
> > > Well, what's that business mentioned in your mail from January (quoted
> > > below), with the backoff being broken, then being broken more, then
> > > possibly been fixed - or not?
> > >
> > >
> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
> > >
> > >
> > > I set up a system that was supposed to do backoff with factored
> > > generation steps, more or less in the manner of what's described in
> this
> > > paper: Interpolated Backoff for Factored Translation Models, Philipp
> > > Koehn and Barry Haddow, AMTA 2012.
> > >
> > > MIRA tunes all the weights of the backoff models to 0. With exactly the
> > > same configuration, this did not happen last year (February 2014).
> Maybe
> > > the [decoding-graph-backoff] setting didn't have any effect prior to
> > > some of your code modifications, and the models were actually competing
> > > in older setups? Or it's buggy now. I can't really tell.
> > >
> > > I can show you the two setups if you want.
> > >
> > >
> > >
> > > On Thu, 2015-04-16 at 21:34 +0400, Hieu Hoang wrote:
> > >> Didn't know it has changed. How should it behave and how does it
> > >> actually behave?
> > >>
> > >> On 16 Apr 2015 21:04, "Matthias Huck" <mhuck@inf.ed.ac.uk> wrote:
> > >> Hi Hieu,
> > >>
> > >> It seems that [decoding-graph-backoff] doesn't quite behave
> > >> like last
> > >> year any more. Can you briefly explain how its behaviour has
> > >> changed,
> > >> i.e. what it did before and what it does now? Can you please
> > >> also let me
> > >> know whether there's a way to reproduce the old behaviour via
> > >> configuration options?
> > >>
> > >> Cheers,
> > >> Matthias
> > >>
> > >>
> > >>
> > >> On Fri, 2015-01-09 at 15:20 +0000, Hieu Hoang wrote:
> > >> > >From the git history, I think it was slightly broken, then
> > >> I broke it even
> > >> > more in May 2014.
> > >> >
> > >> >
> > >>
> https://github.com/moses-smt/mosesdecoder/commit/44fec57c535db2df73ccbb1628d8143a9c728c19
> > >> >
> > >> > It was
> > >> > endPos-startPos+1 >= backoff
> > >> > then
> > >> > endPos-startPos+1 <= backoff
> > >> > I think it should be
> > >> > endPos-startPos+1 > backoff
> > >> >
> > >> > I'll change it if it's ok with everyone
> > >> >
> > >> >
> > >> > On 9 January 2015 at 15:11, Marcin Junczys-Dowmunt
> > >> <junczys@amu.edu.pl>
> > >> > wrote:
> > >> >
> > >> > > Hm, we have been using it at WIPO, but I have to admit I
> > >> never checked
> > >> > > it _actually_ does anything useful. We sorta believe it
> > >> does.
> > >> > >
> > >> > > W dniu 09.01.2015 o 16:08, Hieu Hoang pisze:
> > >> > >
> > >> > > Hi All
> > >> > >
> > >> > > Does anyone use this functionality in Moses when you
> have
> > >> multiple
> > >> > > phrase-tables?
> > >> > >
> > >> > > From the code, it doesn't look like it works as
> described
> > >> in
> > >> > > http://www.statmt.org/moses/?n=Moses.AdvancedFeatures
> > >> > >
> > >> > > Maybe I'm missing something
> > >> > >
> > >> > > --
> > >> > > Hieu Hoang
> > >> > > Research Associate
> > >> > > University of Edinburgh
> > >> > > http://www.hoang.co.uk/hieu
> > >> > >
> > >> > >
> > >> > >
> > >> > > _______________________________________________
> > >> > > Moses-support mailing
> > >> listMoses-support@mit.eduhttp://
> mailman.mit.edu/mailman/listinfo/moses-support
> > >> > >
> > >> > >
> > >> > >
> > >> > > _______________________________________________
> > >> > > Moses-support mailing list
> > >> > > Moses-support@mit.edu
> > >> > > http://mailman.mit.edu/mailman/listinfo/moses-support
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >> > _______________________________________________
> > >> > Moses-support mailing list
> > >> > Moses-support@mit.edu
> > >> > http://mailman.mit.edu/mailman/listinfo/moses-support
> > >> > The University of Edinburgh is a charitable body,
> registered
> > >> in
> > >> > Scotland, with registration number SC005336.
> > >>
> > >>
> > >>
> > >> --
> > >> The University of Edinburgh is a charitable body, registered
> > >> in
> > >> Scotland, with registration number SC005336.
> > >>
> > >>
> > >
> > >
> >
>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150419/da970cc9/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: backoff.zip
Type: application/zip
Size: 5583 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150419/da970cc9/attachment.zip
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 102, Issue 39
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 102, Issue 39"
Post a Comment