Moses-support Digest, Vol 86, Issue 72

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Using Transliteration in Translation system (Pranjal Das)
2. Re: How to change the phrase and reordering tables to point
to the binarised versions (renubalyan)
3. Re: How to change the phrase and reordering tables to point
to the binarised versions (Asad)


----------------------------------------------------------------------

Message: 1
Date: Wed, 25 Dec 2013 06:51:28 +0200
From: Pranjal Das <pranjal4456@gmail.com>
Subject: [Moses-support] Using Transliteration in Translation system
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAAGh44z8Zhkqsdk+yfLb5aPsMtRkki-qbsA8TJK7bgXn5ndn0w@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi all...i am using Assamese and English parallel corpus for my translation
and trained them. But some proper nouns are not translated.This is because
i have a very small corpus. So i want to use the transliteration process in
my translation system.
i am using this command for my translation: echo '?????? ??? ????? ??? ?'|
~/mymoses/bin/moses -f ~/work/mert-work/moses.ini
This gave me the output "?????? is a vast country".
This is because the word "??????" is not in my parallel corpus.
So i took some parallel list of words in Assamese and English, and break
each word character-wise. Thus, each line of the two files would have
single words with a space between each character. i have used these 2 files
to train the system as normal translation task.
Then i used the following command echo '?????? ??? ????? ??? ?'|
~/mymoses/bin/moses -f ~/work/mert-work/moses.ini | ./space.pl
Here "space.pl" is perl file that break the Assamese word character-wise"
This gave me the output "? ? ? ? ? ? is a vast country"
I had to break the word because i have trained the system character-wise..

Then i used the Translation along with the transliteration system that i
have trained, using the command:
echo '?????? ??? ????? ??? ?'| ~/mymoses/bin/moses -f
~/work/mert-work/moses.ini | ./space.pl | ~/mymoses/bin/moses -f
~/work1/train/model/moses.ini

This gave me the output "c a n a d a is a vast country"

The characters are transliterated..but the only problem is the spaces
between the word.So i want to use a perl file that will join the word. My
final command will be
echo '?????? ??? ????? ??? ?'| ~/mymoses/bin/moses -f
~/work/mert-work/moses.ini | ./space.pl | ~/mymoses/bin/moses -f
~/work1/train/model/moses.ini | ./join.pl

Help me with this "join.pl" file to join the word to get the final output
like this: "canada is a vast country"


*Pranjal Das*
Department of Information Technology,
Institute of Science and Technology,
Gauhati University,Guwahati,Assam
Phone- +91-8399879454
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131225/5112f3de/attachment-0001.htm

------------------------------

Message: 2
Date: Wed, 25 Dec 2013 16:16:15 +0530 (IST)
From: renubalyan <renubalyan@cdac.in>
Subject: Re: [Moses-support] How to change the phrase and reordering
tables to point to the binarised versions
To: "Asad A.Malik" <asad_12204@yahoo.com>, "moses-support@mit.edu"
<moses-support@mit.edu>
Message-ID:
<1437654118.2840.1387968375082.JavaMail.open-xchange@webmail.cdac.in>
Content-Type: text/plain; charset="utf-8"

Hi Asad,

You need to make these changes to the moses.ini file that you have copied to
binarized directory.

You will find PhraseDictionaryMemory in the moses.ini file, simply change it to
PhraseDictionaryBinary.

Also the path mentioned here for PhraseDictionary and LexicalReordering will be
pointing to older locations of these files so change this path to point it to
the new locations as mentioned.


Renu


On December 24, 2013 at 10:12 PM "Asad A.Malik" <asad_12204@yahoo.com> wrote:

>
> Hi All,
>
> I've in the Testing phases, and I've binarised phrase and lexical table by
> given commands in Moses manual. And also copied moses.ini in binarised
> directory.
>
> But I don't know how to do following.
> 1. Change PhraseDictionaryMemory to PhraseDictionaryBinary
> 2. Set the path of the PhraseDictionary feature to point to
> $HOME/working/binarised- model/phrase-table
> 3. Set the path of the LexicalReordering feature to point to
> $HOME/working/binarised- model/reordering-table
>
>
>
> Regards
>
>
> Asad A.Malik
>
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
-------------------------------------------------------------------------------------------------------------------------------

This e-mail is for the sole use of the intended recipient(s) and may
contain confidential and privileged information. If you are not the
intended recipient, please contact the sender by reply e-mail and destroy
all copies and the original message. Any unauthorized review, use,
disclosure, dissemination, forwarding, printing or copying of this email
is strictly prohibited and appropriate legal action will be taken.
-------------------------------------------------------------------------------------------------------------------------------

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131225/43fef4e3/attachment-0001.htm

------------------------------

Message: 3
Date: Wed, 25 Dec 2013 16:25:16 +0500
From: Asad <asad_12204@yahoo.com>
Subject: Re: [Moses-support] How to change the phrase and reordering
tables to point to the binarised versions
To: renubalyan <renubalyan@cdac.in>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <980388F3-FD92-4E5B-AB2F-7EBCC66BB942@yahoo.com>
Content-Type: text/plain; charset="us-ascii"

How can I make changes to moses.ini file???
And I've used cp command to copy moses.ini to binarised directory, is it roght??

Regards
Asad A.Malik

Sent from my iPod

On Dec 25, 2013, at 3:46 PM, renubalyan <renubalyan@cdac.in> wrote:

> Hi Asad,
>
> You need to make these changes to the moses.ini file that you have copied to binarized directory.
>
> You will find PhraseDictionaryMemory in the moses.ini file, simply change it to PhraseDictionaryBinary.
>
> Also the path mentioned here for PhraseDictionary and LexicalReordering will be pointing to older locations of these files so change this path to point it to the new locations as mentioned.
>
>
> Renu
>
>
> On December 24, 2013 at 10:12 PM "Asad A.Malik" <asad_12204@yahoo.com> wrote:
>>
>> Hi All,
>>
>> I've in the Testing phases, and I've binarised phrase and lexical table by given commands in Moses manual. And also copied moses.ini in binarised directory.
>>
>> But I don't know how to do following.
>> 1. Change PhraseDictionaryMemory to PhraseDictionaryBinary
>> 2. Set the path of the PhraseDictionary feature to point to $HOME/working/binarised- model/phrase-table
>> 3. Set the path of the LexicalReordering feature to point to $HOME/working/binarised- model/reordering-table
>>
>>
>>
>> Regards
>>
>>
>> Asad A.Malik
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
> -------------------------------------------------------------------------------------------------------------------------------
> This e-mail is for the sole use of the intended recipient(s) and may
> contain confidential and privileged information. If you are not the
> intended recipient, please contact the sender by reply e-mail and destroy
> all copies and the original message. Any unauthorized review, use,
> disclosure, dissemination, forwarding, printing or copying of this email
> is strictly prohibited and appropriate legal action will be taken.
> -------------------------------------------------------------------------------------------------------------------------------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20131225/8012f428/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 86, Issue 72
*********************************************

Tweet