Moses-support Digest, Vol 100, Issue 74

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Moses with SRILM Compile Error (TinTin Kalaw)
2. Re: CountBinFeature when using moses decoder (Barry Haddow)
3. Re: Moses-support Digest, Vol 100, Issue 73 (koormoosh)


----------------------------------------------------------------------

Message: 1
Date: Sun, 22 Feb 2015 22:48:03 +0800
From: TinTin Kalaw <tintin.kalaw@gmail.com>
Subject: Re: [Moses-support] Moses with SRILM Compile Error
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAPSQ0oc5mtxYGVCzf+Gj2fV=hM9YP6CUL+=xP52iedoSvfNq4Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

It is because this other tool that I need (a thesis project of an
upperclassmen) was made with SRILM. To run their project, SRILM must work.

I used an older version of SRILM (v1.6.0). The build still failed.

Thank you for your fast reply.

Regards,



*Kristine Ma. Dominique F. KalawContact No.: 0927.854.4201Email:
tintin.kalaw@gmail.com <tintin.kalaw@gmail.com>*

On Sun, Feb 22, 2015 at 5:30 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:

> use a older version of SRILM.
>
> Can I ask why you use SRILM in more detail? Do you use it to create
> language models, or within the decoder to look up LM scores? In both cases,
> there are now better tools to use than SRILM
>
>
> On 22/02/15 07:22, TinTin Kalaw wrote:
>
> Good day!
>
> Whenever I try to compile Moses with the *--with-srilm=/my/path/to/srilm*,
> I get a compilation error. If I compile it with the
> *--with-boost=/my/path/to/boost* or with just *./bjam*, it is a success.
> Unfortunately I cannot use an alternative to SRILM because this other tool
> that I am using makes use of SRILM and Moses.
>
> I have already successfully installed/compiled the other
> tools/packages/dependencies that Moses needs. My machine is running on a
> dual-boot OS of *Windows 8.1* and *Ubuntu 14.04 LTS 64-bit*. I am
> currently using Ubuntu. I used *Giza v1.0.7*, *SRILM v1.7.1*, *Boost
> 1_57_0*, and the version of *Moses* as of Feb 7 2015.
>
> Attached here is the *build.log.gz* of the command *./bjam
> --with-srilm=$SRILM*.
>
> I am hoping for your swift response regarding this issue. Thank you.
>
> --
> Regards,
>
>
>
> *Kristine Ma. Dominique F. Kalaw Contact No.: 0927.854.4201 Email:
> tintin.kalaw@gmail.com <tintin.kalaw@gmail.com>*
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> --
> Hieu Hoang
> Research Associate (until March 2015)
> ** searching for interesting commercial MT position **
> University of Edinburghhttp://www.hoang.co.uk/hieu
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150222/b2a3c4d1/attachment-0001.htm

------------------------------

Message: 2
Date: Sun, 22 Feb 2015 17:00:21 +0000
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] CountBinFeature when using moses decoder
To: ?? <chengyong3001@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <20150222170021.49552xo2gdvn5xc0@www.staffmail.ed.ac.uk>
Content-Type: text/plain; charset=ISO-8859-1; DelSp="Yes";
format="flowed"

Hi

What did you add to the EMS config? If you add this

score-settings = "--[Sparse]CountBinFeature 1 2 3 10"

it won't work. You should add:

score-settings = "--CountBinFeature 1 2 3 10"
OR
score-settings = "--SparseCountBinFeature 1 2 3 10"

cheers - Barry

Quoting ?? <chengyong3001@gmail.com> on Fri, 20 Feb 2015 21:20:04 +0800:

> Hello,
>
>
> I want to use the sparse features for Moses decoder. I set lexical sparse
> feature successfully as the website guides.
>
>
> But when I add the count bin feature, the website said I should add
> TRAINING:score-settings
> = "--[Sparse]CountBinFeature 1 2 3 10? in experiment.perl, but it seems
> not to work because I can?t see anything related to it in phrase table or
> moses.ini.
>
>
>
> Thanks!
>
> cheng yong
>



--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.




------------------------------

Message: 3
Date: Mon, 23 Feb 2015 07:39:22 +1100
From: koormoosh <koormoosh@gmail.com>
Subject: Re: [Moses-support] Moses-support Digest, Vol 100, Issue 73
To: moses-support@mit.edu
Message-ID:
<CAN3_CDgK+LjbXZQ1ZkpJOfF1Qd0qrt1y9P1-2Lj0NJhR8-vF4g@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thanks Kenneth. I expected that passing

-gt1min 0 -gt2min 0 -gt3min 0 -gt4min 0 ....

to srilm prevents that pruning you mentioned. But it doesn't. Is this what
you meant by "pruning", or there exists a separate unavoidable pruning that
srilm does?
On 23/02/2015 4:28 AM, <moses-support-request@mit.edu> wrote:

> Send Moses-support mailing list submissions to
> moses-support@mit.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://mailman.mit.edu/mailman/listinfo/moses-support
> or, via email, send a message with subject or body 'help' to
> moses-support-request@mit.edu
>
> You can reach the person managing the list at
> moses-support-owner@mit.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Moses-support digest..."
>
>
> Today's Topics:
>
> 1. Re: SRI/KenLM kneser ney implementation (Kenneth Heafield)
> 2. Re: Fwd: Fwd: SGM files (Barry Haddow)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Sun, 22 Feb 2015 07:00:05 -0500
> From: Kenneth Heafield <moses@kheafield.com>
> Subject: Re: [Moses-support] SRI/KenLM kneser ney implementation
> To: moses-support@mit.edu
> Message-ID: <54E9C4C5.7020702@kheafield.com>
> Content-Type: text/plain; charset=windows-1252
>
> SRILM prunes singletons for trigrams and above by default. You're
> likely to get better answers to SRILM-specific questions on srilm-user.
>
> On 02/22/2015 06:28 AM, koormoosh wrote:
> > Hi,
> >
> > I wonder if SRI does any sort of implicit pruning or refinement? To be
> more
> > precise, is there any way to force SRI not to prune anything (removing
> > singletons, etc). I thought that my way of calling it does what I want
> (not
> > pruning), but then I don't know how to explain getting different results.
> > This is how I call SRI:
> >
> >
> -----------------------------------------------------------------------------------------------------
> > ./ngram-count -order 3 -text training.txt -write training.ngrams
> >
> > ./ngram-count -order 3 -read training.ngrams -lm training.binary
> > -interpolate -ukndiscount -gt1min 0 -gt2min 0 -gt3min 0 -write-binary-lm
> >
> > ./ngram -order 3 -lm training.binary -ppl test.txt -debug 2
> >
> > am I missing/misusing something?
> >
> >
> --------------------------------------------------------------------------------------------------------
> > An example to show this problem:
> > (Example-1):
> > Test: "13 13 13"
> > Training: "13 13 13 13 17"
> > perplexity *matches* SRI: "2.79327"
> >
> > (Example-2):
> > Test: "13 13 13"
> > Training "13 13 13 13 13 13 17 17 17 17 17 14 14 15 15 15 16 16 16 16"
> > perplexity *doesn't match* SRI: "4.51546" and what SRI returns us
> "4.242".
> >
> -------------------------------------------------------------------------------------------------------
> >
> > Thanks in advance,
> > Koorm
> >
> >
> >
> > _______________________________________________
> > Moses-support mailing list
> > Moses-support@mit.edu
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
>
>
> ------------------------------
>
> Message: 2
> Date: Sun, 22 Feb 2015 13:03:33 +0000
> From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
> Subject: Re: [Moses-support] Fwd: Fwd: SGM files
> To: Ricardo Cabello S?nchez <ricardo.cabello.sanchez@googlemail.com>
> Cc: moses-support@mit.edu
> Message-ID: <20150222130333.52775wu0xcldgp44@www.staffmail.ed.ac.uk>
> Content-Type: text/plain; charset=ISO-8859-1; DelSp="Yes";
> format="flowed"
>
> Hi Ricardo
>
> The only documentation for EMS is on the Moses website, see
> http://www.statmt.org/moses/?n=FactoredTraining.EMS plus the examples
> in the Moses distribution and the one for the baseline system
> (http://www.statmt.org/moses/uploads/Moses/config). The file
> experiment.meta shows the templates that EMS uses to execute an
> experiment, but is quite hard to read if you are new to Moses.
>
> For evaluating with text files rather than sgm, look at the EVALUATION
> section of the baseline system config file. This should take care of
> the errors you reported below,
>
> cheers - Barry
>
> Quoting Ricardo Cabello S?nchez
> <ricardo.cabello.sanchez@googlemail.com> on Sun, 22 Feb 2015 12:52:34
> +0100:
>
> > Hi,
> >
> > I get problems also at
> > stepEVALUATION:test:reference-from-sgm crashed
> > step EVALUATION:test:analysis-coverage crashed
> >
> > Coudl you please advice? Please find attached log files.
> >
> > Thanks
> >
> > Ricardo
> >
> > 2015-02-22 12:25 GMT+01:00 Ricardo Cabello S?nchez <
> > ricardo.cabello.sanchez@googlemail.com>:
> >
> >> Hi Barry,
> >>
> >> Thank you very much for your quick response. It helped a lot. Now I can
> >> train my system much better. I do not have much expertise in scripts and
> >> config files but I am doing my best. Do you know where I can find a
> quick
> >> guidance to know how to configure config file?
> >>
> >> Experiment crashed at test filter step. Could you please advice? Please
> >> find attached log file.
> >>
> >> Thank you and best regards,
> >>
> >> Ricardo
> >>
> >> 2015-02-22 11:55 GMT+01:00 Barry Haddow <bhaddow@staffmail.ed.ac.uk>:
> >>
> >>> Hi Ricardo
> >>>
> >>> You only need sgm files if you want to evaluate with the nist bleu
> >>> script. If you want to use bleu to evaluate with txt files, just use
> >>> multi-bleu.perl (in scripts/generic)
> >>>
> >>> cheers - Barry
> >>>
> >>>
> >>> Quoting Ricardo Cabello S?nchez <
> ricardo.cabello.sanchez@googlemail.com>
> >>> on Sun, 22 Feb 2015 11:44:51 +0100:
> >>>
> >>> Hi all,
> >>>>
> >>>> I do not know if my message reached you.
> >>>>
> >>>> Thank you
> >>>>
> >>>> Ricardo
> >>>>
> >>>> ---------- Forwarded message ----------
> >>>> From: Ricardo Cabello S?nchez <ricardo.cabello.sanchez@googlemail.com
> >
> >>>> Date: 2015-02-21 19:51 GMT+01:00
> >>>> Subject: SGM files
> >>>> To: moses-support@mit.edu
> >>>>
> >>>>
> >>>> Hi,
> >>>>
> >>>> I would like to ask you how I can get sgm files for reference. I
> already
> >>>> have txt files in ENG and in PTG correctly aligned. Is there any way
> to
> >>>> run
> >>>> moses without these sgm files?
> >>>>
> >>>> Thank you and best regards,
> >>>>
> >>>> Ricardo
> >>>>
> >>>>
> >>>
> >>>
> >>> --
> >>> The University of Edinburgh is a charitable body, registered in
> >>> Scotland, with registration number SC005336.
> >>>
> >>>
> >>>
> >>
> >
>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
>
>
>
> ------------------------------
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> End of Moses-support Digest, Vol 100, Issue 73
> **********************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150223/93f127da/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 100, Issue 74
**********************************************

Tweet