Moses-support Digest, Vol 85, Issue 2

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: language models (Hieu Hoang)
2. Re: -include-alignment-in-n-best replaced by
-include-segmentation-in-n-best ? (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Fri, 1 Nov 2013 15:22:05 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] language models
To: Tom Hoar <tahoar@precisiontranslationtools.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbg+VwjVfvJ=dGuL2Na0HTDTP4zXpTNXxQTmHCS2A+Rvrg@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

You can get a list of available feature functions that was compiled into a
particular moses executable by running the decoder without any arguments.

Just been added:

https://github.com/moses-smt/mosesdecoder/commit/d51702f38726e540723250d656cccec6234a2d3f

$./bin/moses
.....
Available feature functions:
KENLM
SRILM
IRSTLM
SkeletonStatelessFF
ConstrainedDecoding
UnknownWordPenalty
....



On 1 November 2013 00:09, Tom Hoar <tahoar@precisiontranslationtools.com>wrote:

> Here's a shell script that finds all language models. The output is a
> simple list of all the language models that were compiled into the Moses
> binary. Example, on DoMY it reports:
>
> tahoar@moses0:~$ report-moses-lms.sh
> IRSTLM RANDLM KENLM
>
> It supports these command line options:
>
> tahoar@moses0:~$ report-moses-lms.sh -h
> usage: report-moses-lms.sh OPTIONS
>
> Reports all language models compiled into a moses binary.
>
> OPTIONS:
> -p|-P path Absolute path of Moses binary (/home/tahoar/bin/moses)
> -l|-L Output one language model per line
> -c|-C Include language model code in output
> -q|-Q Quiet mode (no output if binary not found)
> -h|-H Show this message
>
>
> It's based on some code shared from this support list a couple years ago.
> It's been tested through release 1.0. Please feel free to add it to the
> Moses contrib folder if it still works on the active trunk.
>
> Tom
>
>
>
> On 11/01/2013 12:02 AM, Read, James C wrote:
>
>> Thanks,
>>
>> my installation of both IRSTLM and SRILM completed without errors. I used
>> the --with-irstlm and --with-srilm flags to compile Moses with both
>> libraries. The compilation finished without errors. Is there a quick way to
>> verify that everything worked for both libraries?
>>
>> thanks,
>> James
>> ______________________________**__________
>> From: Nicola Bertoldi [bertoldi@fbk.eu]
>> Sent: 31 October 2013 16:22
>> To: Read, James C
>> Cc: moses-support support; Nicola Bertoldi
>> Subject: Re: [Moses-support] language models
>>
>> Hi James,
>>
>> yes, I already succeeded in installing randLM and SRILM on both MacOSx
>> and Linux Redhat. it was very simple following their documentations.
>>
>> and
>>
>> yes, it is possible to compile Moses with any LM library you like
>> adding zero, one or more of the following parameters
>>
>> --with-irstlm=/path/to/irstlm
>>
>> --with-randlm=/path/to/randlm
>>
>> --with-srilm=/path/to/srilm
>>
>> you can find more details here
>> http://www.statmt.org/moses/?**n=Development.GetStarted<http://www.statmt.org/moses/?n=Development.GetStarted>
>> in section "Optional packages"
>>
>>
>> at run time, you can select the desired LM type in the configuration file.
>>
>>
>>
>> Nicola
>>
>>
>>
>> On Oct 31, 2013, at 5:01 PM, Read, James C wrote:
>>
>> Does anybody have experience with installing RandLM and SRILM? Is it
>>> possible to compile Moses to support a variety of language model libraries
>>> and then configure to select which one to use for each experiment?
>>>
>>> thanks,
>>> James
>>>
>>> ______________________________**_________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/**mailman/listinfo/moses-support<http://mailman.mit.edu/mailman/listinfo/moses-support>
>>>
>>
>> ______________________________**_________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/**mailman/listinfo/moses-support<http://mailman.mit.edu/mailman/listinfo/moses-support>
>>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131101/976441ae/attachment-0001.htm

------------------------------

Message: 2
Date: Fri, 1 Nov 2013 15:38:24 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] -include-alignment-in-n-best replaced by
-include-segmentation-in-n-best ?
To: Jean-Marc Coursimault <jean-marc.coursimault@xrce.xerox.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAEKMkbib3fOs4Hks_1OQLYkwGH=nZiruqT7PFjUaF8HmYmSfXw@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

the argument -include-alignment-in-n-best was probably just renamed for
some consistency. Hope 1 of these meets your needs:
-print-alignment-info
-include-segmentation-in-n-best
-print-alignment-info-in-n-best
-alignment-output-file

-use-alignment-info is no longer valid. The assumption is there are always
word alignments, even if the set of alignments is empty


On 31 October 2013 16:58, Jean-Marc Coursimault <
jean-marc.coursimault@xrce.xerox.com> wrote:

> Hello,
>
> I'm switching to the last version of Moses from a much older one and I run
> into some compatibility problems.
>
> Specifically, the option |-include-alignment-in-n-best does not exist
> anymore.|
> |It seems replaced by |-include-segmentation-in-n-**best (can someone
> confirm this ? Is there a differemce in output from
> |-include-alignment-in-n-best ?|)
>
> and the option -use-alignment-info is no longer valid (probably because
> "Word Alignment Information is turned on by default by Hieu Hoang and Barry
> Haddow" in http://www.statmt.org/moses/?**n=Moses.Releases<http://www.statmt.org/moses/?n=Moses.Releases>?)
>
> They still exist in the doc ( http://www.statmt.org/moses/?**
> n=Moses.AdvancedFeatures#ntoc9<http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc9>)
>
> Thanks for any clarification !
>
> -- Jean-Marc
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131101/e4911cf3/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 85, Issue 2
********************************************

Tweet