Moses-support Digest, Vol 108, Issue 53

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Issue with alignment (Philipp Koehn)
2. Re: Moses-support Digest, Vol 108, Issue 52 (Apurva Joshi)


----------------------------------------------------------------------

Message: 1
Date: Thu, 15 Oct 2015 14:13:53 -0400
From: Philipp Koehn <phi@jhu.edu>
Subject: Re: [Moses-support] Issue with alignment
To: gang tang <gangtang2014@126.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDAec6qbYeR3KKRon+eQoMz34=+nGQ=Sy++MyXKyZv2_2A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

I ran this corpus through GIZA++ and did get the correct result:

% head training/corpus.11.*
==> training/corpus.11.en <==
sandalo camufluge
sandalo daino
sandalo madras
sandalo vernice

==> training/corpus.11.fr <==
camufluge sandalo
daino sandalo
madras sandalo
vernice sandalo

% zcat training/giz*11/fr-en.A3.final.gz
# Sentence pair (1) source length 2 target length 2 alignment score :
0.536702
camufluge sandalo
NULL ({ }) sandalo ({ 2 }) camufluge ({ 1 })
# Sentence pair (2) source length 2 target length 2 alignment score :
0.536702
daino sandalo
NULL ({ }) sandalo ({ 2 }) daino ({ 1 })
# Sentence pair (3) source length 2 target length 2 alignment score :
0.536702
madras sandalo
NULL ({ }) sandalo ({ 2 }) madras ({ 1 })
# Sentence pair (4) source length 2 target length 2 alignment score :
0.536702
vernice sandalo
NULL ({ }) sandalo ({ 2 }) vernice ({ 1 })


So, something must have gone wrong on your end. Are you sure that you
preparing the data in the correct format?


-phi

On Fri, Oct 9, 2015 at 7:02 AM, gang tang <gangtang2014@126.com> wrote:

> Dear All,
>
> Since there are no answers to my questions, I assume that there are no
> easy fixes to the alignment problem. However, just out of curiosity,
> shouldn't there be alignment tools that take lexical considerations into
> account while aligning parallel corpus? I mean, alignment tools that look
> up translations for specific words in a domain-specifc dictionary during
> alignment? Could there be any reason that it is not an interesting area to
> explore?
>
> Best Regards,
>
> Gang
>
>
> ? 2015-09-25 19:34:13?"gang tang" <gangtang2014@126.com> ???
>
> Dear all,
>
> I have a problem with alignment. I'd greatly appreciate if anyone can help
> solve my issue.
>
> I have the following corpus:
>
> ?sandalo camufluge" -> "camufluge sandal"
> "sandalo daino" -> "daino sandal"
> "sandalo madras" -> "madras sandal"
> "sandalo vernice" -> "vernice sandal"
>
> The alignment software I used was GIZA++, and the alignment result was
> always 0-0 1-1, which meant that "sandalo" wasn't aligned with "sandal".
> And after training phrase.translation.table always had entries such as
> "sandalo" -> "camufluge", "sandalo" -> "daino", "sandalo"->"madras", and
> "sandalo"->"vernice", and no "sandalo"->"sandal". Is there any way this
> problem could be solved? Could I add more data to align "sandalo" with
> "sandal" and translate "sandalo" to "sandal"? How should I tune the system?
>
> Thanks for your attention,
>
> Gang
>
>
>
> ????iPhone6s???5288???????
> <http://rd.da.netease.com/redirect?t=ORBmhG&p=y7fo42&proId=1024&target=http%3A%2F%2Fwww.kaola.com%2Factivity%2Fdetail%2F4650.html%3Ftag%3Dea467f1dcce6ada85b1ae151610748b5>
>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151015/cfa6b2bf/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 16 Oct 2015 16:10:56 +0530
From: Apurva Joshi <apurvajoshi1992@gmail.com>
Subject: Re: [Moses-support] Moses-support Digest, Vol 108, Issue 52
To: moses-support@mit.edu, 561FA714.50304@kheafield.com
Message-ID:
<CAMfCXbWymaOw_c_-CL6hn+J-bhNSMka0YK3-eKqgNn1d3n4QOA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

hi kenneth, m not getting what u said about to use socat.....

is there any moses api libraries available so that we can run moses and its
command through C program or through shell script...

my problem is i am not getting how to redirect translated output to text
file...i have been working on this problem from last 4 days still not
getting any way to generate output txt file to further integrate this
output text file as ip to my next design....

i know tthis command

moses -f moses.ini <ip_file> op_file...
plz tell me other than this...

plzz helpp...and reply on same id...

apurvajoshi1992@gmail.com

On Thu, Oct 15, 2015 at 9:31 PM, <moses-support-request@mit.edu> wrote:

> Send Moses-support mailing list submissions to
> moses-support@mit.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.mit.edu/mailman/listinfo/moses-support
> or, via email, send a message with subject or body 'help' to
> moses-support-request@mit.edu
>
> You can reach the person managing the list at
> moses-support-owner@mit.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Moses-support digest..."
>
>
> Today's Topics:
>
> 1. how to copy output of moses.ini into text output file...
> (Apurva Joshi)
> 2. Re: how to copy output of moses.ini into text output file...
> (Kenneth Heafield)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Thu, 15 Oct 2015 18:24:39 +0530
> From: Apurva Joshi <apurvajoshi1992@gmail.com>
> Subject: [Moses-support] how to copy output of moses.ini into text
> output file...
> To: moses-support@mit.edu
> Message-ID:
> <CAMfCXbUKQ+NDc-oLZoTphOo5_h7yaZ3LSpm64Gb4bmFvsy0y=
> g@mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> my logic is
>
> load moses.ini
> give input word (eg "hello") through stdin
> redirect translated op from stdout to txt file...
> again user ask wanna continue?? if yes...gv ip...and above process repeats
> ...otherwise...stop
>
>
>
> how can i write this through shell script....
>
> pllzzzzz help
> and
> reply on same id
>
> apurvajoshi1992@gmail.com
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL:
> http://mailman.mit.edu/mailman/private/moses-support/attachments/20151015/ed5a72ca/attachment-0001.html
>
> ------------------------------
>
> Message: 2
> Date: Thu, 15 Oct 2015 14:16:04 +0100
> From: Kenneth Heafield <moses@kheafield.com>
> Subject: Re: [Moses-support] how to copy output of moses.ini into text
> output file...
> To: moses-support@mit.edu
> Message-ID: <561FA714.50304@kheafield.com>
> Content-Type: text/plain; charset=windows-1252
>
> Hi,
>
> You can implement this (and much much more) by reading:
>
> - http://www.dest-unreach.org/socat/
>
> - man bash
>
> In the UNIX philosophy, it's Moses's responsibility to be awesome at
> going from stdin to stdout, some other tool's responsibility to do
> things with stdin and stdout, and your responsibility to mix them.
>
> Read up on socat and you can make Moses be a TCP server or UNIX socket
> server. Read man bash and you can do everything you're asking for.
>
> Kenneth
>
> On 10/15/2015 01:54 PM, Apurva Joshi wrote:
> > my logic is
> >
> > load moses.ini
> > give input word (eg "hello") through stdin
> > redirect translated op from stdout to txt file...
> > again user ask wanna continue?? if yes...gv ip...and above process
> > repeats ...otherwise...stop
> >
> >
> >
> > how can i write this through shell script....
> >
> > pllzzzzz help
> > and
> > reply on same id
> >
> > apurvajoshi1992@gmail.com <mailto:apurvajoshi1992@gmail.com>
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
>
>
> ------------------------------
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> End of Moses-support Digest, Vol 108, Issue 52
> **********************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20151016/f2248baa/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 108, Issue 53
**********************************************

Tweet