Moses-support Digest, Vol 91, Issue 15

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Preparing training data (Hieu Hoang)
2. suffix array, how to specify grammar file per sentence
(Mohammad Salameh)


----------------------------------------------------------------------

Message: 1
Date: Sat, 10 May 2014 22:11:20 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Preparing training data
To: Ricardo Cabello S?nchez <ricardo.cabello.sanchez@googlemail.com>,
moses-support@mit.edu
Message-ID: <536E95F8.7020808@gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

the Moses4Localization project might have tools you need to deal with TMX.
https://code.google.com/p/m4loc/
Moses itself only accept raw text file

On 05/05/2014 11:58, Ricardo Cabello S?nchez wrote:
>
> Dear all,
>
> I would like to ask you how to proceed to prepare data to train the
> system.
>
> The thing is that I have a lot of translation data in xml files: one
> with original text and one with translation text and I would like to
> know how to prepare them. I would need to convert files into text
> files without tags? Is there some way to use a tmx file to train system?
>
> Thank you and best regards,
>
> Ricardo
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140510/7b990483/attachment-0001.htm

------------------------------

Message: 2
Date: Sat, 10 May 2014 20:13:49 -0600
From: Mohammad Salameh <msalameh83@gmail.com>
Subject: [Moses-support] suffix array, how to specify grammar file per
sentence
To: moses-support@mit.edu
Message-ID:
<CAJjti4bd622ViV2-qdXvnPMrkPXeV5fzKJ5m2AkFhy8pXB372w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi All,
I am using suffix array for hierarichal models. And I have generated the
grammar per sentence files using
./scripts/training/wrappers/adam-suffix-array/suffix-array-create.sh

During decoding with moses_chart I am providing the directory path in the
config file for all the grammar sentences, which works fine. But is there a
way that I can specify which grammar file I want to use for each sentence
in the test file ?

The script above also generates a sentence file of the format:
<seg grammar="/local/scratch/work/a4/evaluation/ORD/grammar.0.gz"
id="0">erdogan states turkey to reject any pressures to urge it to
recognize cyprus </seg>

but the decoder seems not to be aware of the path in the sentence.

Regards,
Salameh
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140510/65f16cf1/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 91, Issue 15
*********************************************

Tweet