Moses-support Digest, Vol 99, Issue 52

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Missing processPhraseTable binary from bin directory
(Mario Diana)
2. Re: XML Maker Bug (Hieu Hoang)
3. Re: Deprecating the Binary phrase-table (Tom Hoar)
4. Re: about the scores in run*.best100.out (Matthias Huck)
5. Re: Configuration parameter documentaion (Matthias Huck)


----------------------------------------------------------------------

Message: 1
Date: Thu, 22 Jan 2015 22:07:04 +0000
From: Mario Diana <mdiana@technicallycreative.com>
Subject: Re: [Moses-support] Missing processPhraseTable binary from
bin directory
To: "moses-support@mit.edu" <moses-support@mit.edu>
Cc: Hieu Hoang <hieu.hoang@ed.ac.uk>
Message-ID:
<SN2PR07MB061A629744DB29AB83463C4C6490@SN2PR07MB061.namprd07.prod.outlook.com>

Content-Type: text/plain; charset="utf-8"

Thank you, Hieu. I read that, but couldn?t quite tell if that was my problem (as the old utility is still mentioned in the tutorial). If it isn?t too much trouble could you explain how I might get my hands on one of the 4 alternatives? I?m quite new to all of this. Thank you.

From: hieuhoang@gmail.com [mailto:hieuhoang@gmail.com] On Behalf Of Hieu Hoang
Sent: Thursday, January 22, 2015 4:58 PM
To: Mario Diana
Cc: moses-support@mit.edu
Subject: Re: [Moses-support] Missing processPhraseTable binary from bin directory

fyi
?? https://www.mail-archive.com/moses-support@mit.edu/msg11367.html


On 22 January 2015 at 21:55, Mario Diana <mdiana@technicallycreative.com> wrote:
Hello,

[...]




------------------------------

Message: 2
Date: Thu, 22 Jan 2015 22:25:45 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] XML Maker Bug
To: Li Xiang <lixiang.ict@gmail.com>, moses-support
<moses-support@mit.edu>
Message-ID: <54C178E9.3050202@gmail.com>
Content-Type: text/plain; charset="windows-1252"

the <ne> tag is for placeholders. Use another tag, eg <trans>

On 21/01/15 08:58, Li Xiang wrote:
> Hi all,
>
> I am trying to use the xml marker function. But I can not get the xml
> translation options. According to
> http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc33, I use
> ?ne? as xml label. And I use the following command:
>
> echo 'das ist <ne translation="a cute place">ein kleines haus</ne>' | moses -xml-input exclusive -f moses.ini
>
> The error is
>
> ERROR: Placeholder must only span 1 word: das ist <ne translation="a
> cute place">ein kleines haus</ne>
> Unable to parse XML in line: das ist <ne translation="a cute
> place">ein kleines haus</ne>
> Exception: Unable to parse XML in line: das ist <ne translation="a
> cute place">ein kleines haus</ne>
>
> I notice that ?The words have to be surrounded by tags, such as
> |<np...>| and |</np>|. The name of the tags can be chosen freely.? in
> the tutorial.
>
> But I replace ?ne? with ?np?. I can get the translation.
>
> I think it is a bug. But I can not find the source file. Does anyone
> tell me where source file is or explain the reason ?
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150122/df63ba3c/attachment-0001.htm

------------------------------

Message: 3
Date: Fri, 23 Jan 2015 07:09:10 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] Deprecating the Binary phrase-table
To: moses-support@mit.edu
Message-ID: <54C19126.7070108@precisiontranslationtools.com>
Content-Type: text/plain; charset=utf-8; format=flowed

Is this a proposed change for Release 3 or post-release 3?



On Tue, Jan 13, 2015 at 08:05:56, Raj Dabre wrote:

Hey,

Nikolay's Probing PT is standalone.

I have used it.

It is pretty fast and awesome.

Regards.


On Wed, Jan 14, 2015 at 12:42 AM, Christian Hardmeier <c...@rax.ch> wrote:

> Hi,
>
> > If people want binary phrase-tables, there's now a glutony of choice.
> > 1. Marcin's compact phrase-table is pretty awesome - it's fast and
> > small.
> > 2. Nikolay's Probing Pt built on KenLM's datastructures.
> > 3. Uli's dynamic suffix array
> > 4. My OnDisk pt. Supports both phrase-based and syntax.
>
> Is any of these available as a stand-alone library?
> If moses gives up the old binary phrase table, I'll have to look around
> for a new phrase table implementation for my document-level decoder,
> Docent. It would be easier to link against a phrase table library instead
> of a whole decoder.
>
> Thanks for any hints!
>
> Christian
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>

--
Raj Dabre.
Research Student,
Graduate School of Informatics,
Kyoto University.
CSE MTech, IITB., 2011-2014


------------------------------

Message: 4
Date: Fri, 23 Jan 2015 00:11:29 +0000
From: Matthias Huck <mhuck@inf.ed.ac.uk>
Subject: Re: [Moses-support] about the scores in run*.best100.out
To: Arefeh Kazemi <arefeh_kazemi@yahoo.com>
Cc: Moses-support <moses-support@mit.edu>
Message-ID: <1421971889.1792.1.camel@inf.ed.ac.uk>
Content-Type: text/plain; charset="UTF-8"

Hi Arefeh,

Can you try to run the setup from the cluster on your local desktop
system? With the same input, a Moses binary compiled from the same
sources, and the same command to produce the n-best lists? Normally it
should give you the same output.

Why would the feature never produce an overall score larger than 60?

Also note that you should not use Assign() in your feature functions any
more (since two weeks ago).
http://comments.gmane.org/gmane.comp.nlp.moses.user/12146
If you use Assign rather than PlusEquals and you merged with the recent
master from GitHub on the cluster but not on your desktop machine, then
something like what you described can have happened.

Cheers,
Matthias



On Thu, 2015-01-22 at 21:00 +0000, Arefeh Kazemi wrote:
> Hi
>
>
> I've implemented a feature with 4 scores in moses-chart. when I debug
> the code on my system, every thing is OK and the scores are calculated
> right, but when I run mert to tune the weights (on a cluster), I get
> wrong scores for my feature in run*.best.100 files. for example my
> feature could have the maximum value of 60 but for some instances I
> get values more than 300.
>
> does anyone know why this happens?
>
>
> Regards
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support



--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

Message: 5
Date: Fri, 23 Jan 2015 00:30:32 +0000
From: Matthias Huck <mhuck@inf.ed.ac.uk>
Subject: Re: [Moses-support] Configuration parameter documentaion
To: Roee Aharoni <roee.aharoni@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <1421973032.1792.3.camel@inf.ed.ac.uk>
Content-Type: text/plain; charset="UTF-8"

Hi Roee,

I would be very surprised if each and every Moses feature is described
somewhere. But Moses is generally very well documented, and you find all
the information you need for building a state-of-the-art baseline system
on the website [http://www.statmt.org/moses/] and in the manual
[http://www.statmt.org/moses/manual/manual.pdf].

And if you want to know about the details you can even read the source
code!

Maybe our recent Moses tutorial slides from ICON come close to what
you're looking for (in particular slides 58 ff.).
http://www.statmt.org/moses/icon.2014.pdf

Let us know in case you need help with anything specific.

Cheers,
Matthias


On Thu, 2015-01-22 at 06:23 -0800, Roee Aharoni wrote:
> Hi all,
>
> Is there any documentation that explains the meaning of every
> parameter in moses.ini?
>
>
> Thanks in advance,
> Roee
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support



--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 99, Issue 52
*********************************************

0 Response to "Moses-support Digest, Vol 99, Issue 52"

Post a Comment