Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: word alignment viewer (Philipp Koehn)
2. Re: using Moses in Monolingual dialogue setting (Read, James C)
3. Re: word alignment viewer (J?rg Tiedemann)
4. Re: word alignment viewer (Marcin Junczys-Dowmunt)
----------------------------------------------------------------------
Message: 1
Date: Mon, 9 Dec 2013 17:24:06 +0000
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] word alignment viewer
To: Amin Farajian <ma.farajian@gmail.com>, Jason Riesa
<jason.riesa@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDAVp9uENJhQa_TJnQqELJpvVA48a_KP+eJkHUmA3hpE3g@mail.gmail.com>
Content-Type: text/plain; charset="windows-1252"
Hi,
Jason Riesa has a nice command line word alignment visualization tool
http://nlg.isi.edu/demos/picaro/
but the download site is not available anymore.
-phi
On Mon, Dec 9, 2013 at 5:10 PM, Amin Farajian <ma.farajian@gmail.com> wrote:
> Dear Hieu,
>
> For this task we recently modified the tool implemented by chris
> callison-burch, which you can find the original code here:
> http://cs.jhu.edu/~ccb/interface-word-alignment.html
>
> The modified version of the code reads the source, target and word
> alignment information from the input files and enables the user to modify
> the alignment points.
>
> I've tried different tools, but found this one easy to use and very
> helpful.
> If you are interested, let me know to share the code with you.
>
> Bests,
> Amin
>
> PS. Here is the screen-shot of the tool:
>
>
>
>
> On 12/09/2013 05:37 PM, Matthias Huck wrote:
>
> It's called "Cairo":
>
> Cairo: An Alignment Visualization Tool. Noah A. Smith and Michael E.
> Jahr. In Proceedings of the Language Resources and Evaluation Conference
> (LREC 2000), pages 549?552, Athens, Greece, May/June 2000.http://www.cs.cmu.edu/~nasmith/papers/smith+jahr.lrec00.pdf
> http://old-site.clsp.jhu.edu/ws99/projects/mt/toolkit/cairo.tar.gz
>
> Never tried that one, though. The code seems to be kind of prehistoric.
>
>
> On Mon, 2013-12-09 at 11:15 -0500, Lane Schwartz wrote:
>
> I don't have a copy, but I believe that there was a tool called Chiro
> or Cairo that does this, that I'm told helped provide the Egypt theme
> to the Egypt-themed JHU summer workshop on machine translation.
>
> On Mon, Dec 9, 2013 at 10:25 AM, Hieu Hoang <Hieu.Hoang@ed.ac.uk> <Hieu.Hoang@ed.ac.uk> wrote:
>
> does anyone have a nice GUI word alignment viewer they can share? ie. given
> the source, target, alignment files, display each parallel sentence with a
> link between the aligned words.
>
> No webapp or complicated install procedure would be best
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburghhttp://www.hoang.co.uk/hieu
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131209/18d26119/attachment-0001.htm
------------------------------
Message: 2
Date: Mon, 9 Dec 2013 17:33:00 +0000
From: "Read, James C" <jcread@essex.ac.uk>
Subject: Re: [Moses-support] using Moses in Monolingual dialogue
setting
To: Kevin Gimpel <kgimpel@cs.cmu.edu>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<F00840E41983C645928E21E3C35F4EB1012CF80540@mbx1-node2.essex.ac.uk>
Content-Type: text/plain; charset="us-ascii"
I guess if you were to change the subject and ask a question from a list of well formed common questions if the probability of the response is below some sensible threshold then you could make a system which fools a user some of the time.
James
________________________________________
From: moses-support-bounces@mit.edu [moses-support-bounces@mit.edu] on behalf of Read, James C [jcread@essex.ac.uk]
Sent: 09 December 2013 17:14
To: Kevin Gimpel
Cc: moses-support@mit.edu
Subject: Re: [Moses-support] using Moses in Monolingual dialogue setting
I'm guessing he wants to make a conversational agent that produces a most likely response based on the stimulus.
In any case, the distinction between 1 and 2 is probably redundant if GIZA++ is being used to train in both directions. The two phrase tables could be merged I guess. I guess the advantage of 2 over 1 is that you don't need to worry about the merging logic at the cost of more training time.
I'm not sure I understand the question of A1~B3. Unless I'm reading his question wrong I don't see how this could happen.
I suppose my main concern would be the inordinate amounts of training data you would need to get something useful up and running.
James
________________________________
From: kgimpel@gmail.com [kgimpel@gmail.com] on behalf of Kevin Gimpel [kgimpel@cs.cmu.edu]
Sent: 09 December 2013 15:17
To: Read, James C
Cc: Andrew; moses-support@mit.edu
Subject: Re: [Moses-support] using Moses in Monolingual dialogue setting
Hi Andrew, it's an interesting idea.. I would guess that it would depend on what the data look like. If the A's and B's are of fundamentally different type (e.g., they are utterances in an automatic dialogue system, where A's are always questions and B's are always responses), then approach 2 seems a bit odd as it will conflate A's and B's utterances. However, if the A's and B's are just part of a conversation, e.g., in IM chats, then they are of the same "type" and approach 2 would make sense. In fact, I think approach 2 would make more sense than approach 1 in that case. It also of course depends on how you want to use the resulting translation system.
Kevin
On Mon, Dec 9, 2013 at 5:18 AM, Read, James C <jcread@essex.ac.uk<mailto:jcread@essex.ac.uk>> wrote:
Are you trying to figure out the probability of a response given a stimulus?
Given that GIZA++ aligns words and makes heavy use of co-occurrence statistics I doubt this is likely to produce very fruitful results. How big is your data set?
Give it a whirl and see what happens. I would be interested to hear what comes of it?
James
________________________________
From: moses-support-bounces@mit.edu<mailto:moses-support-bounces@mit.edu> [moses-support-bounces@mit.edu<mailto:moses-support-bounces@mit.edu>] on behalf of Andrew [ravenyj@hotmail.com<mailto:ravenyj@hotmail.com>]
Sent: 08 December 2013 20:10
To: moses-support@mit.edu<mailto:moses-support@mit.edu>
Subject: [Moses-support] using Moses in Monolingual dialogue setting
Hi,
I'm using Moses in monolingual dialogue setting as in http://aritter.github.io/mt_chat.pdf,
where source and target are both in English and target is a response to source.
I'd like to propose a little thought experiment in this setting, and hear what you think would happen.
Suppose we have a conversation with six utterances, A1,B1,A2,B2,A3,B3 where A and B indicate speakers,
and the number indicates n-th statement by the speaker. They are all in one conversation of continuous topic.
Now suppose we train it using Moses in two different ways as following:
1) Source file contains A1, A2, A3 and target contains B1, B2, B3 so that A1-B1 is a pair and so on.
2) Source contains A1,B1,A2,B2,A3 and target contains B1,A2,B2,A3,B3, taking advantage of the fact that response is a stimulus to the next response.
Then, How will the results be different and why?
Since GIZA++ gets alignment in both directions, will 2) result in any of A1~B3 being the translation of any other?
This may be a strange question, but I would really like to get your insight.
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu<mailto:Moses-support@mit.edu>
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
------------------------------
Message: 3
Date: Mon, 9 Dec 2013 17:47:00 +0000
From: J?rg Tiedemann <Jorg.Tiedemann@lingfil.uu.se>
Subject: Re: [Moses-support] word alignment viewer
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: moses-support <moses-support@mit.edu>
Message-ID: <B2D05882-B739-4E69-8111-4378550C5773@lingfil.uu.se>
Content-Type: text/plain; charset="iso-8859-1"
Some more links (maybe not exactly what you need):
Alpaco
http://www.d.umn.edu/~tpederse/parallel.html
UMIACS alignment visualization
http://www.umiacs.umd.edu/~nmadnani/alignment/forclip.htm
i*Link
http://www.ida.liu.se/labs/nlplab/ILink/
HandAlign
http://www.umiacs.umd.edu/~hal/HandAlign/index.html
AlignmentSet
http://gps-tsc.upc.es/veu/personal/lambert/software/AlignmentSet.html
What's wrong with my NLP
http://code.google.com/p/whatswrong/
AltAligner
http://www.kyloo.net/software/doku.php/misc:alt-aligner
J?rg
**********************************************************************************
J?rg Tiedemann jorg.tiedemann@lingfil.uu.se<mailto:jorg.tiedemann@lingfil.uu.se>
Dep. of Linguistics and Philology http://stp.lingfil.uu.se/~joerg/
Uppsala University tel: +46 (0)18 - 471 1412
Box 635, SE-751 26 Uppsala/Sweden fax: +46 (0)18 - 471 1094
On Dec 9, 2013, at 4:25 PM, Hieu Hoang wrote:
does anyone have a nice GUI word alignment viewer they can share? ie. given the source, target, alignment files, display each parallel sentence with a link between the aligned words.
No webapp or complicated install procedure would be best
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu<mailto:Moses-support@mit.edu>
http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131209/34d79cfa/attachment-0001.htm
------------------------------
Message: 4
Date: Mon, 09 Dec 2013 18:54:10 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] word alignment viewer
To: moses-support@mit.edu
Message-ID: <52A603C2.3020101@amu.edu.pl>
Content-Type: text/plain; charset="iso-8859-1"
Hi,
A few years ago I've written my own. Written in perl, uses Gtk and
GooCanvas. Alignments are stored in a sqlite3 database, can also be
modified to work with postgres. Just checked it, still works after some
hassle with perl packages. You can annotate in both windows (matrix and
graph) and you can provide sure (red) and probable (orange) alignments.
The only thing missing is a small script to populate the data base with
sentences to align, I can provide this quickly. Several users can work
on the same database and anotate sentences multiple times. If you use
postgres on a remote server you can work in parallel. Just realized I
should have made this available :)
Drop a line if you want to test it. Screenshot attached.
W dniu 09.12.2013 16:25, Hieu Hoang pisze:
> does anyone have a nice GUI word alignment viewer they can share? ie.
> given the source, target, alignment files, display each parallel
> sentence with a link between the aligned words.
>
> No webapp or complicated install procedure would be best
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131209/5f3a83b8/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: editor.png
Type: image/png
Size: 169735 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20131209/5f3a83b8/attachment.png
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 86, Issue 30
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 86, Issue 30"
Post a Comment