Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: kbmira does not work (Toshiaki Nakazawa)
2. Re: extract sentences from search graph file (MOSES)
(Barry Haddow)
3. Re: segmentation fault and register dump (Barry Haddow)
4. Re: mgiza++ force alignment: segmentation fault when
reloading a big N table (Hieu Hoang)
5. error when execute bjam (L?szl? Laki)
----------------------------------------------------------------------
Message: 1
Date: Mon, 11 Aug 2014 12:03:54 +0900
From: Toshiaki Nakazawa <nakazawa@pa.jst.jp>
Subject: Re: [Moses-support] kbmira does not work
To: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Cc: moses-support@mit.edu
Message-ID:
<CAMMh7mrJs1OQ+oZjZd+o5c7vbucaqzXmV+gSxeL61jgrUA_vEg@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Hi Barry,
Thank you very much for the info. It works now!
best,
Nakazawa
2014-08-08 19:11 GMT+09:00 Barry Haddow <bhaddow@staffmail.ed.ac.uk>:
> Hi Toshiaki
>
> Thanks for the clear bug report.
>
> If you supply kbmira with an initial weights file, like the one attached,
> using the --dense-init argument, then it does not seg fault. This is
> supplied automatically if you use kbmira from within mert-moses.pl
>
> I will try to fix kbmira so that it at least gives an error message, or
> supplies a sensible default, when no weights file is given,
>
> cheers - Barry
>
>
> On 08/08/14 09:04, Toshiaki Nakazawa wrote:
>>
>> Hi all,
>>
>> I'm now trying the latest version of Moses (git pull and bjam -a
>> today). When I use kbmira with some data, it dies after the first
>> update.
>>
>> $ mosesdecoder/bin/kbmira --scfile run0.scores.dat --ffile
>> run0.features.dat
>> kbmira with c=0.01 decay=0.999 no_shuffle=0
>> Initialising random seed from system clock
>> .................Initial BLEU = 0.135127
>> 1013/1790 updates, avg loss = 1.67374, BLEU = 0.166537
>> zsh: segmentation fault nice -19
>> /Users/nakazawa/work/MT/tool/mosesdecoder/bin/kbmira --scfile -o
>>
>> The data are
>> http://lotus.kuee.kyoto-u.ac.jp/~nakazawa/run0.scores.dat
>> http://lotus.kuee.kyoto-u.ac.jp/~nakazawa/run0.features.dat
>>
>> $ g++ --version
>> Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr
>> --with-gxx-include-dir=/usr/include/c++/4.2.1
>> Apple LLVM version 5.1 (clang-503.0.40) (based on LLVM 3.4svn)
>> Target: x86_64-apple-darwin13.3.0
>> Thread model: posix
>>
>> Does someone have any ideas?
>>
>> Thanks,
>>
>> Toshiaki Nakazawa
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
> --
> The University of Edinburgh is a charitable body, registered in
> Scotland, with registration number SC005336.
>
------------------------------
Message: 2
Date: Mon, 11 Aug 2014 09:23:54 +0100
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] extract sentences from search graph file
(MOSES)
To: Saeed Farzi <saeedfarzi@gmail.com>, moses-support
<moses-support@mit.edu>
Message-ID: <53E87D9A.3050809@staffmail.ed.ac.uk>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
On 09/08/14 12:58, Saeed Farzi wrote:
> Dear all,
>
> I am trying to extract all translated sentences form output search
> graph file generated by option -output-search-graph-extended. i wonder
> if anybody give me a code or tool that do this for me?
> tnx in advance,
Hi Saeed
The translated sentences are written to stdout as usual. In the search
graph file, the first field is a number indicating the sentence id of
the test set,
cheers - Barry
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
------------------------------
Message: 3
Date: Mon, 11 Aug 2014 09:41:24 +0100
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] segmentation fault and register dump
To: Saeed Farzi <saeedfarzi@gmail.com>, moses-support
<moses-support@mit.edu>
Message-ID: <53E881B4.30102@staffmail.ed.ac.uk>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
On 09/08/14 13:01, Saeed Farzi wrote:
> Hi
>
> when I am trying to use -lattice-sample option, Moses outputs a
> segmentation fault and register dump error. any body can help me to
> solve this problem?
> tnx
>
I fixes the seg fault. Try now with the latest version from github.
--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
------------------------------
Message: 4
Date: Mon, 11 Aug 2014 11:03:08 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] mgiza++ force alignment: segmentation
fault when reloading a big N table
To: Eleftherios Avramidis <Eleftherios.Avramidis@dfki.de>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbiMrD8moF9v4=t0iPvLsqTZztaVvuHraPP42-jQzV6uxw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
did you manage to solve this issue? I tried contacting Qin Gao but there's
been no reply so far.
>From my experience with mgiza a while ago, force alignment works ok
On 3 August 2014 23:34, Eleftherios Avramidis <Eleftherios.Avramidis@dfki.de
> wrote:
> Hi,
>
> I am trying to produce word alignment for individual sentences. For this
> purpose I am using the "force align" functionality of mgiza++ Unfortunately
> when I am loading a big N table (fertility), mgiza crashes with a
> segmentation fault.
>
> In particular, I have initially run mgiza on the full training parallel
> corpus using the default settings of the Moses script:
>
> /project/qtleap/software/moses-2.1.1/bin/training-tools/mgiza -CoocurrenceFile /local/tmp/elav01/selection-mechanism/systems/de-en/training/giza.1/en-de.cooc -c /local/tmp/elav01/selection-mechanism/systems/de-en/training/prepared.1/en-de-int-train.snt -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -ncpus 24 -nodumps 0 -nsmooth 4 -o /local/tmp/elav01/selection-mechanism/systems/de-en/training/giza.1/en-de -onlyaldumps 0 -p0 0.999 -s /local/tmp/elav01/selection-mechanism/systems/de-en/training/prepared.1/de.vcb -t /local/tmp/elav01/selection-mechanism/systems/de-en/training/prepared.1/en.vcb
>
> Afterwards, by executing the mgiza force-align script, I run the
> following command
>
> /project/qtleap/software/moses-2.1.1/mgizapp-code/mgizapp//bin/mgiza giza.en-de/en-de.gizacfg -c /local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/prepared./en-de.snt -o /local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/giza./en-de -s /local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/prepared./de.vcb -t /local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/prepared./en.vcb -m1 0 -m2 0 -mh 0 -coocurrence /local/tmp/elav01/selection-mechanism/systems/de-en/falign/qtmp_SOVBrE/giza./en-de.cooc -restart 11 -previoust giza.en-de/en-de.t3.final -previousa giza.en-de/en-de.a3.final -previousd giza.en-de/en-de.d3.final -previousn giza.en-de/en-de.n3.final -previousd4 giza.en-de/en-de.d4.final -previousd42 giza.en-de/en-de.D4.final -m3 0 -m4 1
>
> This runs fine, until I get the following error:
>
> We are going to load previous N model from giza.en-de/en-de.n3.final
>
> Reading fertility table from giza.en-de/en-de.n3.final
>
> Segmentation fault (core dumped)
>
>
> The n-table that is failing has about 300k entries. For this reason, I
> thought I should try to see if the size is a problem. So I concatenated the
> table to 60k entries. And it works! But the alignments are not good.
>
> I am struggling to fix this, so any help would be appreciated. I am
> running a freshly installed mgiza, on Ubuntu 12.04
>
> cheers,
> Lefteris
>
> --
> MSc. Inf. Eleftherios Avramidis
> DFKI GmbH, Alt-Moabit 91c, 10559 Berlin
> Tel. +49-30 238 95-1806
>
> Fax. +49-30 238 95-1810
>
> -------------------------------------------------------------------------------------------
> Deutsches Forschungszentrum fuer Kuenstliche Intelligenz GmbH
> Firmensitz: Trippstadter Strasse 122, D-67663 Kaiserslautern
>
> Geschaeftsfuehrung:
> Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster (Vorsitzender)
> Dr. Walter Olthoff
>
> Vorsitzender des Aufsichtsrats:
> Prof. Dr. h.c. Hans A. Aukes
>
> Amtsgericht Kaiserslautern, HRB 2313
> -------------------------------------------------------------------------------------------
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140811/fe6d420d/attachment-0001.htm
------------------------------
Message: 5
Date: Mon, 11 Aug 2014 17:41:36 +0200
From: L?szl? Laki <laki.laszlo@gmail.com>
Subject: [Moses-support] error when execute bjam
To: moses-support@mit.edu
Message-ID:
<CAA_FTD+J8eNpo86SkztBy1Ru_zxn+N4xnd_xt7Zh-dq5iz8GUA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi,
I downloaded the latest version of moses from github and I tried to install
it. I usually install it successfully, but that time it failed and I can't
find the error from the log.
the executed command was:
./bjam -a -q -d+2 --with-srilm=<path>/srilm
--with-irstlm=<path>/irstlm-5.80.03
--install-scripts=<path>/mosesdecoder/scripts --max-kenlm-order=10 -j8
--max-factors=6 --prefix=<path>/mosesdecoder --static | gzip >& build.log.gz
(there is a line in the log: *collect2: ld returned 1 exit status*, but I
don't know is it relevant?)
Thanks,
L?szl?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140811/f4ff2185/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: build.log.gz
Type: application/x-gzip
Size: 14887 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20140811/f4ff2185/attachment.bin
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 94, Issue 13
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 94, Issue 13"
Post a Comment