Moses-support Digest, Vol 88, Issue 54

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: ERROR: Lexical reordering scoring failed at
moses/scripts/training/train-model.perl line 1738.
(=?GB2312?B?wO673bvd?=)
2. Re: ERROR: Lexical reordering scoring failed at
moses/scripts/training/train-model.perl line 1738. (Barry Haddow)
3. Re: Moses Compilation error (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Tue, 25 Feb 2014 16:54:25 +0100
From: =?GB2312?B?wO673bvd?= <hui.li@informatik.uni-heidelberg.de>
Subject: Re: [Moses-support] ERROR: Lexical reordering scoring failed
at moses/scripts/training/train-model.perl line 1738.
To: Barry Haddow <bhaddow@staffmail.ed.ac.uk>, moses-support@MIT.EDU
Message-ID:
<CAOG3Tm-f6=E00QcAPcObZDBX8MAkDx0SS-iTx2y5O-2yMR5nLg@mail.gmail.com>
Content-Type: text/plain; charset="gb2312"

Hi Barry,
Thanks for the instructions.
I check the tmp directory and it seems that the align.0000 file is broken.
And I rerun the extract-parallel perl separately but it doesn't work either.
Here is the link to my small corpus.
https://www.dropbox.com/sh/beffab8g215awz6/2dCp0G_pdj

Thank you,
Hui

2014-02-24 18:46 GMT+01:00 Barry Haddow <bhaddow@staffmail.ed.ac.uk>:

> Hi Hui
>
> I have a vague memory that very short corpora cause problems ...
>
> If you edit scripts/generic/extract-parallel.perl to comment out the
> following line (line 223 in my version):
>
> $cmd = "rm -rf $TMPDIR \n";
>
> then rerun, it should retain the tmp directory created during
> extraction. You could then rerun extract manually and look for the
> problem. If you don't see anything odd, then upload to pastebin of
> dropbox and send out the link - or just email if it's small.
>
> cheers - Barry
>
>
> On 24/02/14 16:00, ?????? wrote:
> > Hi Barry,
> > I tried to use absolute paths like this:
> >
> > hli@themisto:~$ /home/hli/MT/moses/scripts/training/train-model.perl
> > /home/hli/MT -corpus /home/hli/MT/lm/1545.test.lowercased
> > -external-bin-dir /home/hli/MT/bin -e de -f ade -alignment
> > grow-diag-final-and -reordering msd-bidirectional-fe -lm
> > 0:3:/home/hli/MT/lm/1545.test.lm >& training.out &
> >
> > but the same error still exists.
> >
> > Is that anything wrong with my corpus?
> >
> > Best,
> > Hui
> >
> >
> > 2014-02-24 16:48 GMT+01:00 Barry Haddow <bhaddow@staffmail.ed.ac.uk
> > <mailto:bhaddow@staffmail.ed.ac.uk>>:
> >
> > Hi Hui
> >
> > It looks like your extract failed, but there is no error message.
> > Do you think it ran out of disk? Could you try again, but use
> > absolute paths everywhere?
> >
> > cheers - Barry
> >
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140225/46fcec8e/attachment-0001.htm

------------------------------

Message: 2
Date: Tue, 25 Feb 2014 16:12:34 +0000
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] ERROR: Lexical reordering scoring failed
at moses/scripts/training/train-model.perl line 1738.
To: =?GB2312?B?wO673bvd?= <hui.li@informatik.uni-heidelberg.de>,
moses-support@mit.edu
Message-ID: <530CC0F2.5000200@staffmail.ed.ac.uk>
Content-Type: text/plain; charset="gb2312"

Hi Hui

What do you mean by "broken"? I meant for you to upload the contents of
the tmp directory to dropbox,

cheers - Barry

On 25/02/14 15:54, ?????? wrote:
> Hi Barry,
> Thanks for the instructions.
> I check the tmp directory and it seems that the align.0000 file is broken.
> And I rerun the extract-parallel perl separately but it doesn't work
> either.
> Here is the link to my small corpus.
> https://www.dropbox.com/sh/beffab8g215awz6/2dCp0G_pdj
>
> Thank you,
> Hui
>
> 2014-02-24 18:46 GMT+01:00 Barry Haddow <bhaddow@staffmail.ed.ac.uk
> <mailto:bhaddow@staffmail.ed.ac.uk>>:
>
> Hi Hui
>
> I have a vague memory that very short corpora cause problems ...
>
> If you edit scripts/generic/extract-parallel.perl to comment out the
> following line (line 223 in my version):
>
> $cmd = "rm -rf $TMPDIR \n";
>
> then rerun, it should retain the tmp directory created during
> extraction. You could then rerun extract manually and look for the
> problem. If you don't see anything odd, then upload to pastebin of
> dropbox and send out the link - or just email if it's small.
>
> cheers - Barry
>
>
> On 24/02/14 16:00, ?????? wrote:
> > Hi Barry,
> > I tried to use absolute paths like this:
> >
> > hli@themisto:~$ /home/hli/MT/moses/scripts/training/train-model.perl
> > /home/hli/MT -corpus /home/hli/MT/lm/1545.test.lowercased
> > -external-bin-dir /home/hli/MT/bin -e de -f ade -alignment
> > grow-diag-final-and -reordering msd-bidirectional-fe -lm
> > 0:3:/home/hli/MT/lm/1545.test.lm >& training.out &
> >
> > but the same error still exists.
> >
> > Is that anything wrong with my corpus?
> >
> > Best,
> > Hui
> >
> >
> > 2014-02-24 16:48 GMT+01:00 Barry Haddow
> <bhaddow@staffmail.ed.ac.uk <mailto:bhaddow@staffmail.ed.ac.uk>
> > <mailto:bhaddow@staffmail.ed.ac.uk
> <mailto:bhaddow@staffmail.ed.ac.uk>>>:
> >
> > Hi Hui
> >
> > It looks like your extract failed, but there is no error message.
> > Do you think it ran out of disk? Could you try again, but use
> > absolute paths everywhere?
> >
> > cheers - Barry
> >
> >
>

-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: not available
Url: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140225/14280f03/attachment-0001.bat

------------------------------

Message: 3
Date: Tue, 25 Feb 2014 16:58:01 +0000
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Moses Compilation error
To: priyanka <priyanka@cse.iitb.ac.in>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbje-L6bzV18x6iMLcFVPgfbvXOMJg2daaX7ekjnaqRAtw@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

There's a problem with your SRILM library.

My advise - don't bother linking to SRILM. KenLM is much better than SRILM
for most purposes these days

Your compilation command should be as simple as
bjam -a -j2



On 25 February 2014 07:36, priyanka <priyanka@cse.iitb.ac.in> wrote:

> Hello everyone,
>
> I am getting gcc.link error while compiling the moses. I tried compiling
> with boost_1_51_0, as suggested in the thread http://comments.gmane.org/
> gmane.comp.nlp.moses.user/8140
> Still I am getting the same error. I have attached the error log with the
> mail.
> My system is Ubuntu 12.04 64 bit
> Command used for moses compilation:
> /usr/bin/bjam -a --with-srilm=/home/piyu/MTech/MTech1-Sem2/tools/srilm
> --with-giza=/home/piyu/MTech/MTech1-Sem2/tools/bin
> --with-boost=/usr/include/boost link=shared -j2
>
> Will really appreciate your help.
>
> Thanks,
> Priyanka
> MTech1, IIT Bombay
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140225/05d9a2b9/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 88, Issue 54
*********************************************

Tweet