Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. mgizza installation ERROR (Benyamin Bosari)
2. My phrase-table.tgz is 20-bytes long (????????? ???????)
3. Re: My phrase-table.tgz is 20-bytes long (Tom Hoar)
4. Re: My phrase-table.tgz is 20-bytes long (Kenneth Heafield)
----------------------------------------------------------------------
Message: 1
Date: Sat, 14 Feb 2015 12:43:58 +0000 (UTC)
From: Benyamin Bosari <b.bosari2010@yahoo.com>
Subject: [Moses-support] mgizza installation ERROR
To: Moses-support Support <moses-support@mit.edu>
Message-ID:
<1714914320.1184862.1423917838425.JavaMail.yahoo@mail.yahoo.com>
Content-Type: text/plain; charset="utf-8"
Hi guys,
In order to install mgizza aligner after doing the "cmake" ?step, I run the "make" and this error message appeared:
~/boost_1_55_0/lib64/libboost_thread.a(thread.o): In function `boost::this_thread::hiden::sleep_for(timespec const&)':thread.cpp:(.text+0xed8): undefined reference to `clock_gettime'
Could you please help me in order to solve this problem?
Thank you and regards,
Benyamin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150214/69eb5810/attachment-0001.htm
------------------------------
Message: 2
Date: Sat, 14 Feb 2015 22:19:49 +0800
From: ????????? ??????? <deadyaga@gmail.com>
Subject: [Moses-support] My phrase-table.tgz is 20-bytes long
To: moses-support@mit.edu
Message-ID:
<CAOAX5pkFyfs2cJetu=p_9Z0hL2_AMhyBBnPr99dnjDmRFDHdTQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hello, everybody!
I have a problem with moses. I created big parallel corpus by concatenating
a bunch of existing corpuses on http://opus.lingfil.uu.se. After that I
cleaned up results (while creating tokens script reported some errors. I
deleted error-prone rows from both of parts).
Then I started to train translation model using mgiza with such an
executable:
nohup nice /opt/moses/scripts/training/train-model.perl --parallel -mgiza
-mgiza-cpus 20 -cores 20 -root-dir train -corpus ~/corpus/ru-en.clean -f ru
-e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm
0:3:$HOME/lm/ru-en.arpa.en:8 -external-bin-dir /opt/moses/mgiza >&
training.out &
After a week of work I have this in the end of training.out:
(7) learn reordering model @ Sun Feb 8 15:30:35 MSK 2015
(7.1) [no factors] learn reordering model @ Sun Feb 8 15:30:35 MSK 2015
(7.2) building tables @ Sun Feb 8 15:30:35 MSK 2015
Executing: /opt/moses/scripts/../bin/lexical-reordering-score
/home/adminadmin/working/train/model/extract.o.sorted.gz 0.5
/home/adminadmin/working/train/model/reordering-table. --model "wbe msd
wbe-msd-bidirectional-fe"
Lexical Reordering Scorer
scores lexical reordering models of several types (hierarchical,
phrase-based and word-based-extraction
(8) learn generation model @ Sun Feb 8 15:30:35 MSK 2015
no generation model requested, skipping step
(9) create moses.ini @ Sun Feb 8 15:30:35 MSK 2015
There is a bunch of files in ~/working/train folder. Looks like everything
is ok, except the tiny problem: phrase-table.tgz has size of 20 bytes. And,
of course, it's not usable at all!
Can somebody help and give me a direction where to dig?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150214/61d07771/attachment-0001.htm
------------------------------
Message: 3
Date: Sat, 14 Feb 2015 21:33:25 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] My phrase-table.tgz is 20-bytes long
To: moses-support@mit.edu
Message-ID: <54DF5CB5.70609@precisiontranslationtools.com>
Content-Type: text/plain; charset="utf-8"
An empty phrase-table.gz file is usually the result of an ill-prepared
training corpus. Make sure you run the final corpus through
clean-corpus-n.perl.
On 02/14/2015 09:19 PM, ????????? ??????? wrote:
> Hello, everybody!
>
> I have a problem with moses. I created big parallel corpus by
> concatenating a bunch of existing corpuses on
> http://opus.lingfil.uu.se. After that I cleaned up results (while
> creating tokens script reported some errors. I deleted error-prone
> rows from both of parts).
>
> Then I started to train translation model using mgiza with such an
> executable:
>
> nohup nice /opt/moses/scripts/training/train-model.perl --parallel
> -mgiza -mgiza-cpus 20 -cores 20 -root-dir train -corpus
> ~/corpus/ru-en.clean -f ru -e en -alignment grow-diag-final-and
> -reordering msd-bidirectional-fe -lm 0:3:$HOME/lm/ru-en.arpa.en:8
> -external-bin-dir /opt/moses/mgiza >& training.out &
>
> After a week of work I have this in the end of training.out:
> (7) learn reordering model @ Sun Feb 8 15:30:35 MSK 2015
> (7.1) [no factors] learn reordering model @ Sun Feb 8 15:30:35 MSK 2015
> (7.2) building tables @ Sun Feb 8 15:30:35 MSK 2015
> Executing: /opt/moses/scripts/../bin/lexical-reordering-score
> /home/adminadmin/working/train/model/extract.o.sorted.gz 0.5
> /home/adminadmin/working/train/model/reordering-table. --model "wbe
> msd wbe-msd-bidirectional-fe"
> Lexical Reordering Scorer
> scores lexical reordering models of several types (hierarchical,
> phrase-based and word-based-extraction
> (8) learn generation model @ Sun Feb 8 15:30:35 MSK 2015
> no generation model requested, skipping step
> (9) create moses.ini @ Sun Feb 8 15:30:35 MSK 2015
>
> There is a bunch of files in ~/working/train folder. Looks like
> everything is ok, except the tiny problem: phrase-table.tgz has size
> of 20 bytes. And, of course, it's not usable at all!
>
> Can somebody help and give me a direction where to dig?
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150214/2d160f71/attachment-0001.htm
------------------------------
Message: 4
Date: Sat, 14 Feb 2015 09:54:29 -0500
From: Kenneth Heafield <moses@kheafield.com>
Subject: Re: [Moses-support] My phrase-table.tgz is 20-bytes long
To: moses-support@mit.edu
Message-ID: <54DF61A5.90105@kheafield.com>
Content-Type: text/plain; charset=UTF-8
Sign my petition to add return code checking to train-model.perl.
On 02/14/2015 09:33 AM, Tom Hoar wrote:
> An empty phrase-table.gz file is usually the result of an ill-prepared
> training corpus. Make sure you run the final corpus through
> clean-corpus-n.perl.
>
>
>
> On 02/14/2015 09:19 PM, ????????? ??????? wrote:
>> Hello, everybody!
>>
>> I have a problem with moses. I created big parallel corpus by
>> concatenating a bunch of existing corpuses on
>> http://opus.lingfil.uu.se. After that I cleaned up results (while
>> creating tokens script reported some errors. I deleted error-prone
>> rows from both of parts).
>>
>> Then I started to train translation model using mgiza with such an
>> executable:
>>
>> nohup nice /opt/moses/scripts/training/train-model.perl --parallel
>> -mgiza -mgiza-cpus 20 -cores 20 -root-dir train -corpus
>> ~/corpus/ru-en.clean -f ru -e en -alignment grow-diag-final-and
>> -reordering msd-bidirectional-fe -lm 0:3:$HOME/lm/ru-en.arpa.en:8
>> -external-bin-dir /opt/moses/mgiza >& training.out &
>>
>> After a week of work I have this in the end of training.out:
>> (7) learn reordering model @ Sun Feb 8 15:30:35 MSK 2015
>> (7.1) [no factors] learn reordering model @ Sun Feb 8 15:30:35 MSK 2015
>> (7.2) building tables @ Sun Feb 8 15:30:35 MSK 2015
>> Executing: /opt/moses/scripts/../bin/lexical-reordering-score
>> /home/adminadmin/working/train/model/extract.o.sorted.gz 0.5
>> /home/adminadmin/working/train/model/reordering-table. --model "wbe
>> msd wbe-msd-bidirectional-fe"
>> Lexical Reordering Scorer
>> scores lexical reordering models of several types (hierarchical,
>> phrase-based and word-based-extraction
>> (8) learn generation model @ Sun Feb 8 15:30:35 MSK 2015
>> no generation model requested, skipping step
>> (9) create moses.ini @ Sun Feb 8 15:30:35 MSK 2015
>>
>> There is a bunch of files in ~/working/train folder. Looks like
>> everything is ok, except the tiny problem: phrase-table.tgz has size
>> of 20 bytes. And, of course, it's not usable at all!
>>
>> Can somebody help and give me a direction where to dig?
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 100, Issue 46
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 100, Issue 46"
Post a Comment