Moses-support Digest, Vol 95, Issue 30

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Boost library naming (Christian Hardmeier)
2. Re: dictionary in moses (Philipp Koehn)
3. How to convert XML to TXT (Asad A.Malik)


----------------------------------------------------------------------

Message: 1
Date: Thu, 18 Sep 2014 11:26:46 +0200
From: Christian Hardmeier <ch@rax.ch>
Subject: Re: [Moses-support] Boost library naming
To: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <ECDFB3D5-C779-46DC-9563-56994371D4F6@rax.ch>
Content-Type: text/plain; charset=us-ascii

Hi Hieu,

thanks for looking at this!

I believe where it goes wrong is when there's an old version of Boost somewhere in the system paths, as there is on many systems. If that version has the -mt libs (which it would have especially if it's very old since this was the default in the 1.30 series of Boost), moses will prefer it to the newer version you installed. Does that sound right?

I even think I've seen it pick up new headers from a custom installation together with old libs from /usr/lib sometimes, but I don't remember exactly under what circumstances that would happen.

/Christian

On Sep 17, 2014, at 8:10 PM, Hieu Hoang wrote:

> it looks like Moses has been configured to use
> libboost_*
> if the tagged version isn't available. Therefore, you don't need to create
> libboost_*-mt.a
> Isn't that good enough?
>
>
>
> On 15 September 2014 07:30, Hieu Hoang <hieuhoang@gmail.com> wrote:
> Sounds good. Since there's been no objection, feel free to check in yhe change yourself. Otherwise I'll do it in the next couple of weeks
>
> Sent from my flying horse
>
>> On 15 Sep 2014, at 05:44 am, Tom Hoar <tahoar@precisiontranslationtools.com> wrote:
>>
>> I support the effort. Updating to standard expectations almost always
>> reduces support requests.
>>
>> Regards,
>> Tom
>>
>>
>>> On 09/12/2014 02:05 PM, Pierre Lison wrote:
>>> Hi,
>>>
>>> I second Christian's request. We got into some trouble installing Moses on our cluster because of this naming scheme. It would be great to switch to a standard library layout for Boost.
>>>
>>> Cheers,
>>>
>>> Pierre
>>>
>>>
>>>> 10. sep. 2014 kl. 18:14 skrev Christian Hardmeier <christian.hardmeier@lingfil.uu.se>:
>>>>
>>>> Hi everyone,
>>>>
>>>> Moses currently requires installing the Boost libraries with the --layout=tagged option. This library naming scheme has been non-standard on Unix-like systems since Boost 1.40.0. It forces you to use special options when installing Boost, and it can lead to trouble if you then try to link Moses against other software that prefers a standard installation - effectively you have to install Boost twice to make everybody happy.
>>>>
>>>> In my opinion, it would be preferable if Moses used the --layout=system scheme that you get by default in recent versions of Boost. Would anybody object to this?
>>>>
>>>> Best,
>>>> Christian
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>> --
>>> Pierre Lison (Postdoctoral Research Fellow)
>>> Department of Informatics, University of Oslo
>>> Mobile: +47.967.998.12
>>> Web: http://folk.uio.no/plison
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support




------------------------------

Message: 2
Date: Thu, 18 Sep 2014 09:35:10 -0400
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] dictionary in moses
To: i.ramadan@saudisoft.com
Cc: Hieu Hoang <hieu.hoang@ed.ac.uk>, moses-support
<moses-support@mit.edu>
Message-ID:
<CAAFADDA+K7+bFauzuTN3o3-M+WNPeNy1V9kKg6OTvqoaLPPPQQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

to create a separate phrase table just from the dictionary, just run the
dictionary (just like a parallel corpus) through the training pipeline. The
resulting additional phrase table can be added, as described here:
http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc23

-phi

On Thu, Sep 18, 2014 at 3:13 AM, Ihab Ramadan <i.ramadan@saudisoft.com>
wrote:

> Thank you Hieu
>
> But if you please I need more explanation how to create a primary primary
> phrase-table
>
> Thanks
>
>
>
> *From:* hieuhoang@gmail.com [mailto:hieuhoang@gmail.com] *On Behalf Of *Hieu
> Hoang
> *Sent:* Wednesday, September 17, 2014 6:06 PM
> *To:* i.ramadan@saudisoft.com
> *Cc:* moses-support
> *Subject:* Re: [Moses-support] dictionary in moses
>
>
>
> You can use the dictionary to
>
> 1. Create a primary primary phrase-table.
>
> 2. Add it to the parallel data
>
>
>
> Your last question on the mailing list - 50 parallel sentences for the
> tuning set is too small in most circumstances. I usually use around
> 1000-2000 sentences
>
>
>
> On 17 September 2014 11:02, Ihab Ramadan <i.ramadan@saudisoft.com> wrote:
>
> Dear All,
>
> I tried the parameter ??dictionary dic.txt ? in the training process with
> no effect at all, how can I use my dictionary to get exact translation for
> the words
>
> thanks
>
>
>
> Best Regards
>
> *Ihab Ramadan*| Senior Developer| Saudisoft <http://www.saudisoft.com/> -
> Egypt | *Tel * +2 02 330 320 37 Ext- 0 | Mob+201007570826 | Fax
> +20233032036 | *Follow us on *[image: linked]
> <http://www.linkedin.com/company/77017?trk=vsrp_companies_res_name&trkInfo=VSRPsearchId%3A1489659901402995947155%2CVSRPtargetId%3A77017%2CVSRPcmpt%3Aprimary>* |
> **[image: ZA102637861]*
> <https://www.facebook.com/pages/Saudisoft-Co-Ltd/289968997768973?ref_type=bookmark>* |
> **[image: ZA102637858]* <https://twitter.com/Saudisoft>
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140918/e93adf40/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 1351 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140918/e93adf40/attachment-0003.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.gif
Type: image/gif
Size: 1314 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140918/e93adf40/attachment-0004.gif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 1317 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140918/e93adf40/attachment-0005.gif

------------------------------

Message: 3
Date: Thu, 18 Sep 2014 07:39:44 -0700
From: "Asad A.Malik" <asad_12204@yahoo.com>
Subject: [Moses-support] How to convert XML to TXT
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<1411051184.96243.YahooMailNeo@web140205.mail.bf1.yahoo.com>
Content-Type: text/plain; charset="us-ascii"

Hi All,

I am currently trying to develop SMT system, and for that I have parallel corpus, but the problem is that I have parallel corpus in XML format and upto my knowledge MOSES support TXT. So is there any way that I can convert XML to TXT so that I don't change the format also.

PS. I've tried multiple online XML converter but each of them change the order or the corpus. Also the corpus is then converted as paragraph.

Kind Regards,

Mr. Asad Abdul Malik
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140918/b573cf25/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 95, Issue 30
*********************************************

Tweet