Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: nplm (Hieu Hoang)
2. Re: Legacy tokenizer.perl functionality. (Hieu Hoang)
3. Re: Legacy tokenizer.perl functionality. (Tom Hoar)
4. Question about mosesserver binary (Tom Hoar)
5. Re: Question about mosesserver binary (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Fri, 16 Jan 2015 09:14:57 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] nplm
To: Marwa Refaie <basmallah@hotmail.com>
Cc: moses-support <moses-support@mit.edu>, avaswani@isi.edu, Xiaoqiang
Feng <feng.x.q.2006@gmail.com>
Message-ID:
<CAEKMkbjG8QQqHYqbEok+EvNG6=eruQojb+BevcUGnfrQt7fibA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
On 16 January 2015 at 08:08, Marwa Refaie <basmallah@hotmail.com> wrote:
> Hi
> Thanks for all your replies. It's working now.
> I can send a step by step how it installed and linked to moses & how it
> worked on Arabic .
>
yes, a step-by-step guide to install and use NPLM with moses would be great.
If you can write it and send it to me, i'll put it onto the moses website
> For the 00000 train model, it solved using dos2unix.exe on the file
> before working with nplm.
> I designing my experiments now.
> Thanks all
>
> --- Original Message ---
>
> From: "Xiaoqiang Feng" <feng.x.q.2006@gmail.com>
> Sent: 14 January 2015 04:21
> To: "Marwa Refaie" <basmallah@hotmail.com>
> Subject: Re: nplm
>
> Hi,
>
> You got train.ngrams with all 000 000 000 ...... etc, which means the
> preprocessing of training data is wrong.
> I think you should first to handle the preprocessing: convering the
> training data to numberized n-grams.
>
> xiaoqiang
>
> 2015-01-14 5:37 GMT+08:00 Marwa Refaie <basmallah@hotmail.com>:
>
> Hi,
>
>
> I follow all instruction as listed to compile & build the nplm , it's ok
> when I get language model for ENGLISH LANGUAGE, but when I proceed to build
> ARABIC LANGUAGE MODEL I got train.ngrams with all 000 000 000 .......etc .
>
> Even the prepare & train step finished very fast !!
>
> As logic when I used with moses decoder I have no translation !!!!!!!
> just the same English words instead of translated Arabic word.
>
> Any help please ....
>
>
>
>
> *Marwa N. Refaie*
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150116/ec0031e0/attachment-0001.htm
------------------------------
Message: 2
Date: Fri, 16 Jan 2015 09:36:23 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Legacy tokenizer.perl functionality.
To: Tom Hoar <tahoar@precisiontranslationtools.com>,
moses-support@mit.edu
Message-ID: <54B8DB97.2040902@gmail.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
it's probably a good idea to make this change. If you've done it
already, please send me the updated scripts and I'll check it in. If
not, I'll do it myself
there's hopefully a fast, C++ tokenizer replacement coming soon.
Highlighting these issues now is useful to understanding exactly how the
tokenizer works/should work
On 15/01/15 01:52, Tom Hoar wrote:
> This is a separate issue from the parallel "Tokenization problem" thread...
>
> The tokenizer.perl has had one line that transforms the grave accent (`)
> to apostrophe and another that transforms double apostrophe ('') to to
> single quote. I suspect these have been in the script since the
> beginning. However, they recently "bit" me on a recent project. Easy
> enough to work around.
>
> Still, I'm wondering. Do they still belong in the tokenizer.perl script?
> Or, should they moved into one of the other scripts? The
> normalize-punctuation.perl script seems to be a good candidate.
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
------------------------------
Message: 3
Date: Fri, 16 Jan 2015 16:43:40 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] Legacy tokenizer.perl functionality.
To: moses-support@mit.edu
Message-ID: <54B8DD4C.4070203@precisiontranslationtools.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
I did not make the change, merely worked around the issue (Perl's not my
thing). I think the code is on lines 282-286 and 388-397. Just search
for the `, which appears in a couple other places for loser scrutiny.
On 01/16/2015 04:36 PM, Hieu Hoang wrote:
> it's probably a good idea to make this change. If you've done it
> already, please send me the updated scripts and I'll check it in. If
> not, I'll do it myself
>
> there's hopefully a fast, C++ tokenizer replacement coming soon.
> Highlighting these issues now is useful to understanding exactly how
> the tokenizer works/should work
>
> On 15/01/15 01:52, Tom Hoar wrote:
>> This is a separate issue from the parallel "Tokenization problem"
>> thread...
>>
>> The tokenizer.perl has had one line that transforms the grave accent (`)
>> to apostrophe and another that transforms double apostrophe ('') to to
>> single quote. I suspect these have been in the script since the
>> beginning. However, they recently "bit" me on a recent project. Easy
>> enough to work around.
>>
>> Still, I'm wondering. Do they still belong in the tokenizer.perl script?
>> Or, should they moved into one of the other scripts? The
>> normalize-punctuation.perl script seems to be a good candidate.
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
------------------------------
Message: 4
Date: Fri, 16 Jan 2015 16:54:47 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: [Moses-support] Question about mosesserver binary
To: moses-support@mit.edu
Message-ID: <54B8DFE7.3030900@precisiontranslationtools.com>
Content-Type: text/plain; charset=utf-8; format=flowed
I compiled the yesterday's github commit. It seems to have gone well...
but I forgot to redirect output to a log file. Oops.
Before restarting, I noticed the mosesserver binary is missing. On
closer inspection, default Ubuntu 14.04 does not include libxmlrpc. Does
anyone now the Debian package that adds this support? I think it should
be `libxmlrpc-core-c3-dev`.
------------------------------
Message: 5
Date: Fri, 16 Jan 2015 10:04:10 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Question about mosesserver binary
To: Tom Hoar <tahoar@precisiontranslationtools.com>,
moses-support@mit.edu
Message-ID: <54B8E21A.4010404@gmail.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
i personally compile xmlrpc-c myself and get moses to link to it
./bjam --with-xmlrpc-c=/path/to/xmlrpc-c
That way, you have more control. Moses doesn't like xmlrpc-c v. 1.25.29
(off the top of my head). Also, you can delete the .so file and force
moses to link to the static libraries. This will allow you to move your
executable around different servers easier
On 16/01/15 09:54, Tom Hoar wrote:
> I compiled the yesterday's github commit. It seems to have gone well...
> but I forgot to redirect output to a log file. Oops.
>
> Before restarting, I noticed the mosesserver binary is missing. On
> closer inspection, default Ubuntu 14.04 does not include libxmlrpc. Does
> anyone now the Debian package that adds this support? I think it should
> be `libxmlrpc-core-c3-dev`.
>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 99, Issue 32
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 99, Issue 32"
Post a Comment