Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. -include-alignment-in-n-best replaced by
-include-segmentation-in-n-best ? (Jean-Marc Coursimault)
2. Re: language models (Read, James C)
3. Re: language models (Tom Hoar)
4. Postgraduate Student Internship Oracle (Sorin Slavescu)
5. [Question?]How to ensure that all N-best list will be
included in Moses search graph? (LUONG Ngoc Quang)
----------------------------------------------------------------------
Message: 1
Date: Thu, 31 Oct 2013 17:58:48 +0100
From: Jean-Marc Coursimault <jean-marc.coursimault@xrce.xerox.com>
Subject: [Moses-support] -include-alignment-in-n-best replaced by
-include-segmentation-in-n-best ?
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <52728C48.8070104@xrce.xerox.com>
Content-Type: text/plain; charset="iso-8859-1"
Hello,
I'm switching to the last version of Moses from a much older one and I
run into some compatibility problems.
Specifically, the option |-include-alignment-in-n-best does not exist
anymore.|
|It seems replaced by |-include-segmentation-in-n-best (can someone
confirm this ? Is there a differemce in output from
|-include-alignment-in-n-best ?|)
and the option -use-alignment-info is no longer valid (probably because
"Word Alignment Information is turned on by default by Hieu Hoang and
Barry Haddow" in http://www.statmt.org/moses/?n=Moses.Releases ?)
They still exist in the doc (
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc9 )
Thanks for any clarification !
-- Jean-Marc
-------------- next part --------------
A non-text attachment was scrubbed...
Name: jean-marc_coursimault.vcf
Type: text/x-vcard
Size: 261 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20131031/4b6c09ca/attachment-0001.vcf
------------------------------
Message: 2
Date: Thu, 31 Oct 2013 17:02:25 +0000
From: "Read, James C" <jcread@essex.ac.uk>
Subject: Re: [Moses-support] language models
To: Nicola Bertoldi <bertoldi@fbk.eu>
Cc: moses-support support <moses-support@mit.edu>
Message-ID:
<F00840E41983C645928E21E3C35F4EB1012CF34E51@mbx1-node2.essex.ac.uk>
Content-Type: text/plain; charset="us-ascii"
Thanks,
my installation of both IRSTLM and SRILM completed without errors. I used the --with-irstlm and --with-srilm flags to compile Moses with both libraries. The compilation finished without errors. Is there a quick way to verify that everything worked for both libraries?
thanks,
James
________________________________________
From: Nicola Bertoldi [bertoldi@fbk.eu]
Sent: 31 October 2013 16:22
To: Read, James C
Cc: moses-support support; Nicola Bertoldi
Subject: Re: [Moses-support] language models
Hi James,
yes, I already succeeded in installing randLM and SRILM on both MacOSx and Linux Redhat. it was very simple following their documentations.
and
yes, it is possible to compile Moses with any LM library you like
adding zero, one or more of the following parameters
--with-irstlm=/path/to/irstlm
--with-randlm=/path/to/randlm
--with-srilm=/path/to/srilm
you can find more details here
http://www.statmt.org/moses/?n=Development.GetStarted
in section "Optional packages"
at run time, you can select the desired LM type in the configuration file.
Nicola
On Oct 31, 2013, at 5:01 PM, Read, James C wrote:
> Does anybody have experience with installing RandLM and SRILM? Is it possible to compile Moses to support a variety of language model libraries and then configure to select which one to use for each experiment?
>
> thanks,
> James
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
------------------------------
Message: 3
Date: Fri, 01 Nov 2013 07:09:27 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] language models
To: moses-support@MIT.EDU
Message-ID: <5272F137.1040403@precisiontranslationtools.com>
Content-Type: text/plain; charset="iso-8859-1"
Here's a shell script that finds all language models. The output is a
simple list of all the language models that were compiled into the Moses
binary. Example, on DoMY it reports:
tahoar@moses0:~$ report-moses-lms.sh
IRSTLM RANDLM KENLM
It supports these command line options:
tahoar@moses0:~$ report-moses-lms.sh -h
usage: report-moses-lms.sh OPTIONS
Reports all language models compiled into a moses binary.
OPTIONS:
-p|-P path Absolute path of Moses binary (/home/tahoar/bin/moses)
-l|-L Output one language model per line
-c|-C Include language model code in output
-q|-Q Quiet mode (no output if binary not found)
-h|-H Show this message
It's based on some code shared from this support list a couple years
ago. It's been tested through release 1.0. Please feel free to add it to
the Moses contrib folder if it still works on the active trunk.
Tom
On 11/01/2013 12:02 AM, Read, James C wrote:
> Thanks,
>
> my installation of both IRSTLM and SRILM completed without errors. I used the --with-irstlm and --with-srilm flags to compile Moses with both libraries. The compilation finished without errors. Is there a quick way to verify that everything worked for both libraries?
>
> thanks,
> James
> ________________________________________
> From: Nicola Bertoldi [bertoldi@fbk.eu]
> Sent: 31 October 2013 16:22
> To: Read, James C
> Cc: moses-support support; Nicola Bertoldi
> Subject: Re: [Moses-support] language models
>
> Hi James,
>
> yes, I already succeeded in installing randLM and SRILM on both MacOSx and Linux Redhat. it was very simple following their documentations.
>
> and
>
> yes, it is possible to compile Moses with any LM library you like
> adding zero, one or more of the following parameters
>
> --with-irstlm=/path/to/irstlm
>
> --with-randlm=/path/to/randlm
>
> --with-srilm=/path/to/srilm
>
> you can find more details here
> http://www.statmt.org/moses/?n=Development.GetStarted
> in section "Optional packages"
>
>
> at run time, you can select the desired LM type in the configuration file.
>
>
>
> Nicola
>
>
>
> On Oct 31, 2013, at 5:01 PM, Read, James C wrote:
>
>> Does anybody have experience with installing RandLM and SRILM? Is it possible to compile Moses to support a variety of language model libraries and then configure to select which one to use for each experiment?
>>
>> thanks,
>> James
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
A non-text attachment was scrubbed...
Name: report-moses-lms.sh
Type: application/x-shellscript
Size: 1907 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20131101/5dda9231/attachment-0001.bin
------------------------------
Message: 4
Date: Fri, 01 Nov 2013 11:01:10 +0000
From: Sorin Slavescu <sorin.slavescu@oracle.com>
Subject: [Moses-support] Postgraduate Student Internship Oracle
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <527389F6.2010108@oracle.com>
Content-Type: text/plain; charset="utf-8"
Worldwide Product Translation Group in Oracle has an opening for an
internship position in Machine Translation for a Masters or PhD student.
The internship is available for applied research in translation quality
improvement for a Moses based SMT system. Projects in the areas of
incremental training, preprocessing for English to Japanese or German,
confidence estimation, domain specific MT engines, Moses function
features for terminology integration, or other similar research areas
are considered.
Knowledge in SMT and previous experience using Moses toolkit are required.
Programming skills required: C++ necessary, Java and Perl an advantage.
The internship position is for 13 months with a competitive salary plus
benefits. The successful candidate will be required to work from our
Dublin office locatedin EastPointBusinessPark,Dublin3.
Please submit your CV and a description of the MT research project(s)
you are involved in to sorin.slavescu@oracle.com
Closing date: Monday 11th of November 2013.
--
ORACLE <http://www.oracle.com>
Sorin Slavescu | Principal Software Engineer
Phone: +35318031937 | E-mail: sorin.slavescu@oracle.com
Oracle Worldwide Product Translation (WPTG) - Tools
Block P5, East Point Business Park | Dublin 3, Ireland
Oracle is committed to developing practices and products that help
protect the environment <http://www.oracle.com/commitment>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131101/b6b1611d/attachment-0001.htm
------------------------------
Message: 5
Date: Fri, 1 Nov 2013 15:17:07 +0100
From: LUONG Ngoc Quang <quangngocluong@gmail.com>
Subject: [Moses-support] [Question?]How to ensure that all N-best list
will be included in Moses search graph?
To: moses-support@mit.edu
Message-ID: <49EF6AAC-CDD2-414E-9C92-123EBEB7ED70@gmail.com>
Content-Type: text/plain; charset=windows-1252
Hi all,
Currently i would like to exploit the Moses search graph as an alternative for N-best list to improve MT, thanks to a huge number of hypotheses it contains. Nevertheless when i try to output all the hypotheses in the search graph, i observe that they don't cover all N-best list. In other words, there are still several hypotheses in N-best (N=1000) not included in the search graph.
Even when i increase the number of hypotheses popped for each stack (up to 10000 for example), this coverage can not be obtained.
So, i would like to ask all of you whether we have any Moses option (command, script?) to ensure that the search graph will contain all N best list of each source sentence?
For information, the command we invoked to generate the search graph and the N-best list is as follows:
./home/toolkits/Moses/moses-04-2009/moses-cmd/src/moses
-f output10881/moses.ini
-mbr -cube-pruning-pop-limit 10000
-s 10000
-output-search-graph search_graph_881
-use-alignment-info
-print-alignment-info
-include-alignment-in-n-best
-print-alignment-info-in-n-best -n-best-list ./Nbest-881test 1000
< ./pre-processed-corpus/881.lowercased.fr
> ./pre-processed-corpus/881.hyp.SG
Furthermore, the way we conduct to extract all hypotheses (sentences) from the search graph is : We start from each final node, move backward until reach the initial one. First, the hypothesis is set : s= "". In each step, we get the field "out" of the current node (the translated word(s)) and add to the hypothesis : s = out + s.
Is this the right way to obtain all hypotheses?
Thanks a lot and all suggestions would be very welcomed !
bests,
Quang
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 85, Issue 1
********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 85, Issue 1"
Post a Comment