Moses-support Digest, Vol 92, Issue 12

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Problem with GIZA on Windows (x64) (Hieu Hoang)
2. Re: Problem with GIZA on Windows (x64) (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 5 Jun 2014 14:34:31 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Problem with GIZA on Windows (x64)
To: ????????? ????? <a.komin@bk.ru>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbjrMJHLqf-9doyvDtXfR=TGsCFz6YsJEji1GypdVATtgg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

always use absolute paths, ie. not
../
but
/cygdrive/d/whatever/


On 5 June 2014 14:24, ????????? ????? <a.komin@bk.ru> wrote:

>
> Hi.
>
> I'm trying to run script train-model.perl on Windows 7 (x64) via Cygwin
> (x64). I have problems.
>
> I downloaded binaries from here:
> http://www.statmt.org/moses/RELEASE-2.1/binaries/cygwin-64bit/. I do
> everything as described in manual.
>
> At first I tried to execute the command:
>
> >>?????????@Komin /cygdrive/d/moses-cygwin-64bit/scripts/training
> >>$ ./train-model.perl -root-dir . --corpus corpus/euro --f de --e en
> Using SCRIPTS_ROOTDIR: D:/moses-cygwin-64bit/scripts
> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
> string at ./train-model.perl line 239.
> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
> string at ./train-model.perl line 240.
> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
> string at ./train-model.perl line 248.
> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
> string at ./train-model.perl line 249.
> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
> string at ./train-model.perl line 251.
> >>Using single-thread GIZA
> >>????? ?? ????? ???? ?????? ????.
> >>????? ?? ????? ???? ?????? ????.
> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
> string at ./train-model.perl line 340.
> >>ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in .
> >>You MUST specify the parameter -external-bin-dir at ./train-model.perl
> line 340.
>
>
> After adding parameters: -external-bin-dir .. / training-snt2cooc
> snt2cooc.exe
> these problems were solved , but new problems appeared:
>
>
>
> >>?????????@Komin /cygdrive/d/moses-cygwin-64bit/scripts/training
> >>$ ./train-model.perl -root-dir . -external-bin-dir ../training -snt2cooc
> snt2cooc.exe --corpus corpus/euro --f de --e en
> >>Using SCRIPTS_ROOTDIR: D:/moses-cygwin-64bit/scripts
> Using single-thread GIZA
>
> >>?????????@Komin /cygdrive/d/moses-cygwin-64bit/scripts/training
> >>$ ./train-model.perl -root-dir . -external-bin-dir ../training -snt2cooc
> snt2cooc.exe --corpus corpus/euro --f de --e en
> >>Using SCRIPTS_ROOTDIR: D:/moses-cygwin-64bit/scripts
> >>Using single-thread GIZA
> >>????? ?? ????? ???? ?????? ????.
> >>????? ?? ????? ???? ?????? ????.
> >>(1) preparing corpus @ Thu Jun 5 16:58:36 MSK 2014
> >>Executing: mkdir -p D:\moses-cygwin-64bit\scripts\training/corpus
> >>(1.0) selecting factors @ Thu Jun 5 16:58:36 MSK 2014
> >>(1.1) running mkcls @ Thu Jun 5 16:58:36 MSK 2014
> >>D:\moses-cygwin-64bit\scripts\training/mkcls -c50 -n2
> -pD:\moses-cygwin-64bit\scripts\training\corpus\euro.de
> -VD:\moses-cygwin-64bit\scripts\training/corpus/de.vcb.classes opt
> >> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb.classes already in
> place, reusing
> >>(1.1) running mkcls @ Thu Jun 5 16:58:36 MSK 2014
> >>D:\moses-cygwin-64bit\scripts\training/mkcls -c50 -n2
> -pD:\moses-cygwin-64bit\scripts\training\corpus\euro.en
> -VD:\moses-cygwin-64bit\scripts\training/corpus/en.vcb.classes opt
> >> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb.classes already in
> place, reusing
> >>(1.2) creating vcb file
> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb @ Thu Jun 5 16:58:36
> MSK 2014
> >>(1.2) creating vcb file
> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb @ Thu Jun 5 16:58:36
> MSK 2014
> >>(1.3) numberizing corpus
> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt @ Thu Jun
> 5 16:58:36 MSK 2014
> >> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt
> already in place, reusing
> >>(1.3) numberizing corpus
> D:\moses-cygwin-64bit\scripts\training/corpus/en-de-int-train.snt @ Thu Jun
> 5 16:58:36 MSK 2014
> >> D:\moses-cygwin-64bit\scripts\training/corpus/en-de-int-train.snt
> already in place, reusing
> >>(2) running giza @ Thu Jun 5 16:58:36 MSK 2014
> >>(2.1a) running snt2cooc de-en @ Thu Jun 5 16:58:36 MSK 2014
>
> >>Executing: mkdir -p D:\moses-cygwin-64bit\scripts\training/giza.de-en
> >>Executing: D:\moses-cygwin-64bit\scripts\training/snt2cooc.exe
> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc
> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb
> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt
> >>D:\moses-cygwin-64bit\scripts\training/snt2cooc.exe
> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc
> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb
> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt
> >>END.
> >>(2.1b) running giza de-en @ Thu Jun 5 16:58:36 MSK 2014
> >>D:\moses-cygwin-64bit\scripts\training/GIZA++ -CoocurrenceFile
> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc -c
> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt -m1 5 -m2
> 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1
> -nsmooth 4 -o D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en
> -onlyaldumps 1 -p0 0.999 -s
> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb -t
> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
> >>Executing: D:\moses-cygwin-64bit\scripts\training/GIZA++
> -CoocurrenceFile
> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc -c
> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt -m1 5 -m2
> 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1
> -nsmooth 4 -o D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en
> -onlyaldumps 1 -p0 0.999 -s
> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb -t
> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
> >>D:\moses-cygwin-64bit\scripts\training/GIZA++ -CoocurrenceFile
> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc -c
> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt -m1 5 -m2
> 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1
> -nsmooth 4 -o D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en
> -onlyaldumps 1 -p0 0.999 -s
> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb -t
> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
> >>"D:\moses-cygwin-64bit\scripts\training/GIZA++" ?? ????? ???????? ???
> ?????
> >>????????, ??????? ?????? ??? ?????? ????.
> >>Exit code: 1
> >>ERROR: Giza did not produce the output file
> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.A3.final. Is your
> corpus clean (reasonably-sized sentences)? at ./train-model.perl line 1182.
>
>
>
> I tried to clean the my corpus with a clean-corpus-n.perl. It did not help.
>
> Can you help me?
>
>
> Best regards,
> Alexandr Komin.
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140605/b57e4806/attachment-0001.htm

------------------------------

Message: 2
Date: Thu, 5 Jun 2014 14:44:45 +0100
From: Hieu Hoang <Hieu.Hoang@ed.ac.uk>
Subject: Re: [Moses-support] Problem with GIZA on Windows (x64)
To: ????????? ????? <a.komin@bk.ru>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbhEpyPtsb7w4OvRCO=dDZmsxpbukWqbYdTgQEAYAFMEtg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

also, do not use Windows path names, ie not
D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
but
/cygdrive/d/moses-cygwin-64bit/scripts/training/corpus/de.vcb


On 5 June 2014 14:34, Hieu Hoang <Hieu.Hoang@ed.ac.uk> wrote:

> always use absolute paths, ie. not
> ../
> but
> /cygdrive/d/whatever/
>
>
> On 5 June 2014 14:24, ????????? ????? <a.komin@bk.ru> wrote:
>
>>
>> Hi.
>>
>> I'm trying to run script train-model.perl on Windows 7 (x64) via Cygwin
>> (x64). I have problems.
>>
>> I downloaded binaries from here:
>> http://www.statmt.org/moses/RELEASE-2.1/binaries/cygwin-64bit/. I do
>> everything as described in manual.
>>
>> At first I tried to execute the command:
>>
>> >>?????????@Komin /cygdrive/d/moses-cygwin-64bit/scripts/training
>> >>$ ./train-model.perl -root-dir . --corpus corpus/euro --f de --e en
>> Using SCRIPTS_ROOTDIR: D:/moses-cygwin-64bit/scripts
>> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
>> string at ./train-model.perl line 239.
>> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
>> string at ./train-model.perl line 240.
>> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
>> string at ./train-model.perl line 248.
>> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
>> string at ./train-model.perl line 249.
>> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
>> string at ./train-model.perl line 251.
>> >>Using single-thread GIZA
>> >>????? ?? ????? ???? ?????? ????.
>> >>????? ?? ????? ???? ?????? ????.
>> >>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or
>> string at ./train-model.perl line 340.
>> >>ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in .
>> >>You MUST specify the parameter -external-bin-dir at ./train-model.perl
>> line 340.
>>
>>
>> After adding parameters: -external-bin-dir .. / training-snt2cooc
>> snt2cooc.exe
>> these problems were solved , but new problems appeared:
>>
>>
>>
>> >>?????????@Komin /cygdrive/d/moses-cygwin-64bit/scripts/training
>> >>$ ./train-model.perl -root-dir . -external-bin-dir ../training
>> -snt2cooc snt2cooc.exe --corpus corpus/euro --f de --e en
>> >>Using SCRIPTS_ROOTDIR: D:/moses-cygwin-64bit/scripts
>> Using single-thread GIZA
>>
>> >>?????????@Komin /cygdrive/d/moses-cygwin-64bit/scripts/training
>> >>$ ./train-model.perl -root-dir . -external-bin-dir ../training
>> -snt2cooc snt2cooc.exe --corpus corpus/euro --f de --e en
>> >>Using SCRIPTS_ROOTDIR: D:/moses-cygwin-64bit/scripts
>> >>Using single-thread GIZA
>> >>????? ?? ????? ???? ?????? ????.
>> >>????? ?? ????? ???? ?????? ????.
>> >>(1) preparing corpus @ Thu Jun 5 16:58:36 MSK 2014
>> >>Executing: mkdir -p D:\moses-cygwin-64bit\scripts\training/corpus
>> >>(1.0) selecting factors @ Thu Jun 5 16:58:36 MSK 2014
>> >>(1.1) running mkcls @ Thu Jun 5 16:58:36 MSK 2014
>> >>D:\moses-cygwin-64bit\scripts\training/mkcls -c50 -n2
>> -pD:\moses-cygwin-64bit\scripts\training\corpus\euro.de
>> -VD:\moses-cygwin-64bit\scripts\training/corpus/de.vcb.classes opt
>> >> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb.classes already
>> in place, reusing
>> >>(1.1) running mkcls @ Thu Jun 5 16:58:36 MSK 2014
>> >>D:\moses-cygwin-64bit\scripts\training/mkcls -c50 -n2
>> -pD:\moses-cygwin-64bit\scripts\training\corpus\euro.en
>> -VD:\moses-cygwin-64bit\scripts\training/corpus/en.vcb.classes opt
>> >> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb.classes already
>> in place, reusing
>> >>(1.2) creating vcb file
>> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb @ Thu Jun 5 16:58:36
>> MSK 2014
>> >>(1.2) creating vcb file
>> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb @ Thu Jun 5 16:58:36
>> MSK 2014
>> >>(1.3) numberizing corpus
>> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt @ Thu Jun
>> 5 16:58:36 MSK 2014
>> >> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt
>> already in place, reusing
>> >>(1.3) numberizing corpus
>> D:\moses-cygwin-64bit\scripts\training/corpus/en-de-int-train.snt @ Thu Jun
>> 5 16:58:36 MSK 2014
>> >> D:\moses-cygwin-64bit\scripts\training/corpus/en-de-int-train.snt
>> already in place, reusing
>> >>(2) running giza @ Thu Jun 5 16:58:36 MSK 2014
>> >>(2.1a) running snt2cooc de-en @ Thu Jun 5 16:58:36 MSK 2014
>>
>> >>Executing: mkdir -p D:\moses-cygwin-64bit\scripts\training/giza.de-en
>> >>Executing: D:\moses-cygwin-64bit\scripts\training/snt2cooc.exe
>> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc
>> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb
>> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
>> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt
>> >>D:\moses-cygwin-64bit\scripts\training/snt2cooc.exe
>> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc
>> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb
>> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
>> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt
>> >>END.
>> >>(2.1b) running giza de-en @ Thu Jun 5 16:58:36 MSK 2014
>> >>D:\moses-cygwin-64bit\scripts\training/GIZA++ -CoocurrenceFile
>> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc -c
>> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt -m1 5 -m2
>> 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1
>> -nsmooth 4 -o D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en
>> -onlyaldumps 1 -p0 0.999 -s
>> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb -t
>> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
>> >>Executing: D:\moses-cygwin-64bit\scripts\training/GIZA++
>> -CoocurrenceFile
>> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc -c
>> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt -m1 5 -m2
>> 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1
>> -nsmooth 4 -o D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en
>> -onlyaldumps 1 -p0 0.999 -s
>> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb -t
>> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
>> >>D:\moses-cygwin-64bit\scripts\training/GIZA++ -CoocurrenceFile
>> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc -c
>> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt -m1 5 -m2
>> 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1
>> -nsmooth 4 -o D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en
>> -onlyaldumps 1 -p0 0.999 -s
>> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb -t
>> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
>> >>"D:\moses-cygwin-64bit\scripts\training/GIZA++" ?? ????? ???????? ???
>> ?????
>> >>????????, ??????? ?????? ??? ?????? ????.
>> >>Exit code: 1
>> >>ERROR: Giza did not produce the output file
>> D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.A3.final. Is your
>> corpus clean (reasonably-sized sentences)? at ./train-model.perl line 1182.
>>
>>
>>
>> I tried to clean the my corpus with a clean-corpus-n.perl. It did not
>> help.
>>
>> Can you help me?
>>
>>
>> Best regards,
>> Alexandr Komin.
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>


--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140605/224bc6f0/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 92, Issue 12
*********************************************

Tweet