Moses-support Digest, Vol 89, Issue 30

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: EMS Binarize phrase table (Mihee Ji)
2. Re: EMS Binarize phrase table (Barry Haddow)


----------------------------------------------------------------------

Message: 1
Date: Thu, 13 Mar 2014 23:03:09 +0900
From: "Mihee Ji" <mhji@e4net.net>
Subject: Re: [Moses-support] EMS Binarize phrase table
To: "'Hieu Hoang'" <Hieu.Hoang@ed.ac.uk>
Cc: 'moses-support' <moses-support@mit.edu>
Message-ID: <000601cf3ec4$f8be0ab0$ea3a2010$@e4net.net>
Content-Type: text/plain; charset="us-ascii"

Hello,



Thank you for response.

Yes, it creates files for only for tuning, but there are not for the whole
training table.

Are there any options to binarize the whole ttable in EMS?



Best regards,



Mihee Ji



From: hieuhoang@gmail.com [mailto:hieuhoang@gmail.com] On Behalf Of Hieu
Hoang
Sent: Thursday, March 13, 2014 10:58 PM
To: Mihee Ji
Cc: moses-support
Subject: Re: [Moses-support] EMS Binarize phrase table



yes, it should create some files in the directories

tuning/filtered.?/phrase-table.*.bin/

evaluation/*filtered*/phrase-table.*.bin/

The files it creates are

Misc.dat

Source.dat

TargetColl.dat

TargetInd.dat

Vocab.dat



On 13 March 2014 10:45, Mihee Ji <mhji@e4net.net> wrote:

Hello



I am trying to binarize phase table using EMS.



This is a specification for ttable-binalizeri in config.tree.







What else should I do to binarize phase table?



Thank you.



Mihee Ji




_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support







--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140313/dad7fe10/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 10026 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140313/dad7fe10/attachment-0001.png

------------------------------

Message: 2
Date: Thu, 13 Mar 2014 14:17:28 +0000
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] EMS Binarize phrase table
To: Mihee Ji <mhji@e4net.net>, "'Hieu Hoang'" <Hieu.Hoang@ed.ac.uk>
Cc: 'moses-support' <moses-support@mit.edu>
Message-ID: <5321BDF8.8010207@staffmail.ed.ac.uk>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

Hi Mihee

For experiments with lattice input, where filtering does not work, I use
the following option in EMS to force it to binarise the whole table

binarize-all = $moses-script-dir/training/binarize-model.perl

This goes in the [GENERAL] section. I have used this with
processPhraseTable, but I don't know if it works with CreateOnDiskPt

cheers - Barry

On 13/03/14 14:03, Mihee Ji wrote:
>
> Hello,
>
> Thank you for response.
>
> Yes, it creates files for only for tuning, but there are not for the
> whole training table.
>
> Are there any options to binarize the whole ttable in EMS?
>
> Best regards,
>
> Mihee Ji
>
> *From:*hieuhoang@gmail.com [mailto:hieuhoang@gmail.com] *On Behalf Of
> *Hieu Hoang
> *Sent:* Thursday, March 13, 2014 10:58 PM
> *To:* Mihee Ji
> *Cc:* moses-support
> *Subject:* Re: [Moses-support] EMS Binarize phrase table
>
> yes, it should create some files in the directories
>
> tuning/filtered.?/phrase-table.*.bin/
>
> evaluation/*filtered*/phrase-table.*.bin/
>
> The files it creates are
>
> Misc.dat
>
> Source.dat
>
> TargetColl.dat
>
> TargetInd.dat
>
> Vocab.dat
>
> On 13 March 2014 10:45, Mihee Ji <mhji@e4net.net
> <mailto:mhji@e4net.net>> wrote:
>
> Hello
>
> I am trying to binarize phase table using EMS.
>
> This is a specification for ttable-binalizeri in config.tree.
>
> What else should I do to binarize phase table?
>
> Thank you.
>
> Mihee Ji
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support


--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 89, Issue 30
*********************************************

Tweet