Moses-support Digest, Vol 92, Issue 11

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Segmentation fault (charmaine ponay)
2. Re: Importing Eclipse projects (Jun-ya NORIMATSU)
3. Regarding Moses Server (Pranjal Das)
4. Problem with GIZA on Windows (x64) (????????? ?????)


----------------------------------------------------------------------

Message: 1
Date: Wed, 4 Jun 2014 21:55:43 -0700
From: charmaine ponay <csponay@gmail.com>
Subject: [Moses-support] Segmentation fault
To: moses-support@mit.edu
Message-ID:
<CAB0nykf9t61VD0ekmU4dF7m-VzSk-joGVq7wPtL47LrpM-R+6A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

hi, what does it mean when i get this error after escaping special
characters and training my corpus?

$ ../mosesdecoder-master/bin/moses -f Charmaine/training/model/moses.ini <
Charmaine/testing.fl > Charmaine/Testing/CharmaineOut
Defined parameters (per moses.ini or switch):
config: Charmaine/training/model/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryMemory name=TranslationModel0 table-limit=20 num-features=4
path=/masters/Charmaine/training/model/phrase-table.gz input-factor=0
output-factor=0 Distortion SRILM name=LM0 factor=0
path=/masters/Charmaine/preprocessed/training.clean.en.lm order=3
input-factors: 0
mapping: 0 T 0
weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2 Distortion0= 0.3 LM0= 0.5
../mosesdecoder-master/bin
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20
num-features=4 path=/masters/Charmaine/training/model/phrase-table.gz
input-factor=0 output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=Distortion
FeatureFunction: Distortion0 start: 7 end: 7
line=SRILM name=LM0 factor=0
path=/masters/Charmaine/preprocessed/training.clean.en.lm order=3
FeatureFunction: LM0 start: 8 end: 8
Start loading text SCFG phrase table. Moses format : [0.000] seconds
Reading /masters/Charmaine/training/model/phrase-table.gz
----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
Segmentation fault (core dumped)

Regards,

*Charmaine Salvador - Ponay*
Instructor
Information and Computer Studies Dept.
University of Santo Tomas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140604/1ab26ead/attachment-0001.htm

------------------------------

Message: 2
Date: Thu, 05 Jun 2014 14:10:05 +0900
From: Jun-ya NORIMATSU <norimatsu@mibel.cs.tsukuba.ac.jp>
Subject: Re: [Moses-support] Importing Eclipse projects
To: moses-support@mit.edu
Message-ID: <538FFBAD.1080105@mibel.cs.tsukuba.ac.jp>
Content-Type: text/plain; charset=windows-1252; format=flowed

Hi, Lars,

I'm developper of DALM.
You may use DALM v1.0.0-stable, but it does not work with current master
branch of mosesdecoder.
# v1.0.0-stable is for moses 2.1.1.
# we are now trying to tune DALMWrapper.
# We add more features on master branch of DALM.

Please use latest master branch of DALM.
https://github.com/jnory/DALM/tree/master

Please ask me if you have trouble with it.

Thanks,
--
Jun-ya NORIMATSU

(2014/06/03 23:34), Lars Bungum wrote:
> On 03. juni 2014 14:29, Hieu Hoang wrote:
>> hi lars
>>
>> glad you're trying to use the eclipse file. I use it everyday, but
>> no-one else seems to use it. I can help you. Please follow the
>> instructions below, don't diverge from it
> Thanks for helping me out. Obviously I try to follow the instructions
> as closely as possible, but there must be something I have touched that
> somehow affects.
>>
>> don't copy or add mosesdecoder/lib to Eclipse. The libraries in there
>> are compiled by bjam. You need the libraries compiled by Eclipse to be
>> able to debug it
>>
> OK. It's that moses directory under other-builds I can't get to compile
> with DALM.
>
>> I just downloaded the latest DALM version and compiled it. Is
>> this the correct one?
>>
>> I use the DALM directly from github
>> https://github.com/hieuhoang/DALM
>> I've just updated my own version, clean and compile both DALM, bjam
>> moses, and Eclipse moses. They all work
>>
> I can't argue with that if it works for you. I just updated both the
> moses and dalm source tree, and I still get errors on this file:
> mosesdecoder/moses/LM/DALMWrapper.cpp
>
> mosesdecoder/moses/LM/DALMWrapper.cpp: In constructor
> ?Moses::DALMState::DALMState()?:
> mosesdecoder/moses/LM/DALMWrapper.cpp:49:13: error: no matching function
> for call to ?DALM::State::State()?
> mosesdecoder/moses/LM/DALMWrapper.cpp:49:13: note: candidates are:
> mosesdecoder/contrib/other-builds/../../DALM/include/state.h:22:4: note:
> DALM::State::State(const DALM::State&)
> mosesdecoder/contrib/other-builds/../../DALM/include/state.h:22:4:
> note: candidate expects 1 argument, 0 provided
> mosesdecoder/contrib/other-builds/../../DALM/include/state.h:12:4: note:
> DALM::State::State(short unsigned int)
> mosesdecoder/contrib/other-builds/../../DALM/include/state.h:12:4:
> note: candidate expects 1 argument, 0 provided
>
> if you mouseover with the same file inside Eclipse you get the same
> warnings on the function DALMState (no matching function call).
> Everything else seems to work, bjam build does.
>
> //LB
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>




------------------------------

Message: 3
Date: Thu, 5 Jun 2014 15:49:56 +0530
From: Pranjal Das <pranjal4456@gmail.com>
Subject: [Moses-support] Regarding Moses Server
To: moses-support <moses-support@mit.edu>
Message-ID:
<CAAGh44zaKyFv=Mx=5hydLoXW_a3M5iGto8FFHS8aEv7XEruyXQ@mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hello, I am trying to install the moses server, but i am not able to
activate the server. I am stuck at ./daemon.pl <hostname> <port>. I am
getting this error:

usage: daemon.pl <hostname> <port> <ini> at ./daemon.pl line 33.
How should i proceed ?

Regards,

*Pranjal Das*
Department of Information Technology,
Gauhati University Institute of Science and Technology,
Phone- +91-8399879454
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140605/1c003e30/attachment-0001.htm

------------------------------

Message: 4
Date: Thu, 05 Jun 2014 17:24:54 +0400
From: ????????? ????? <a.komin@bk.ru>
Subject: [Moses-support] Problem with GIZA on Windows (x64)
To: moses-support@MIT.EDU
Message-ID: <1401974694.544934684@f248.i.mail.ru>
Content-Type: text/plain; charset="utf-8"


Hi.

I'm trying to run script train-model.perl on Windows 7 (x64) via Cygwin (x64). I have problems.
I downloaded binaries from here: http://www.statmt.org/moses/RELEASE-2.1/binaries/cygwin-64bit/. I do everything as described in manual.
At first I tried to execute the command:

>>?????????@Komin /cygdrive/d/moses-cygwin-64bit/scripts/training
>>$ ./train-model.perl -root-dir . --corpus corpus/euro --f de --e en Using SCRIPTS_ROOTDIR: D:/moses-cygwin-64bit/scripts
>>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or string at ./train-model.perl line 239.
>>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or string at ./train-model.perl line 240.
>>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or string at ./train-model.perl line 248.
>>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or string at ./train-model.perl line 249.
>>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or string at ./train-model.perl line 251.
>>Using single-thread GIZA
>>????? ?? ????? ???? ?????? ????.
>>????? ?? ????? ???? ?????? ????.
>>Use of uninitialized value $_EXTERNAL_BINDIR in concatenation (.) or string at ./train-model.perl line 340.
>>ERROR: Cannot find mkcls, GIZA++/mgiza, & snt2cooc.out/snt2cooc in .
>>You MUST specify the parameter -external-bin-dir at ./train-model.perl line 340.

After adding parameters:?-external-bin-dir .. / training-snt2cooc snt2cooc.exe
these problems were solved , but new problems appeared:


>>?????????@Komin /cygdrive/d/moses-cygwin-64bit/scripts/training
>>$ ./train-model.perl -root-dir . -external-bin-dir ../training -snt2cooc snt2cooc.exe --corpus corpus/euro --f de --e en
>>Using SCRIPTS_ROOTDIR: D:/moses-cygwin-64bit/scripts
Using single-thread GIZA
>>?????????@Komin /cygdrive/d/moses-cygwin-64bit/scripts/training
>>$ ./train-model.perl -root-dir . -external-bin-dir ../training -snt2cooc snt2cooc.exe --corpus corpus/euro --f de --e en
>>Using SCRIPTS_ROOTDIR: D:/moses-cygwin-64bit/scripts
>>Using single-thread GIZA
>>????? ?? ????? ???? ?????? ????.
>>????? ?? ????? ???? ?????? ????.
>>(1) preparing corpus @ Thu Jun 5 16:58:36 MSK 2014
>>Executing: mkdir -p D:\moses-cygwin-64bit\scripts\training/corpus
>>(1.0) selecting factors @ Thu Jun 5 16:58:36 MSK 2014
>>(1.1) running mkcls @ Thu Jun 5 16:58:36 MSK 2014
>>D:\moses-cygwin-64bit\scripts\training/mkcls -c50 -n2 -pD:\moses-cygwin-64bit\scripts\training\corpus\euro.de -VD:\moses-cygwin-64bit\scripts\training/corpus/de.vcb.classes opt
>> D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb.classes already in place, reusing
>>(1.1) running mkcls @ Thu Jun 5 16:58:36 MSK 2014
>>D:\moses-cygwin-64bit\scripts\training/mkcls -c50 -n2 -pD:\moses-cygwin-64bit\scripts\training\corpus\euro.en -VD:\moses-cygwin-64bit\scripts\training/corpus/en.vcb.classes opt
>> D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb.classes already in place, reusing
>>(1.2) creating vcb file D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb @ Thu Jun 5 16:58:36 MSK 2014
>>(1.2) creating vcb file D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb @ Thu Jun 5 16:58:36 MSK 2014
>>(1.3) numberizing corpus D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt @ Thu Jun 5 16:58:36 MSK 2014
>> D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt already in place, reusing
>>(1.3) numberizing corpus D:\moses-cygwin-64bit\scripts\training/corpus/en-de-int-train.snt @ Thu Jun 5 16:58:36 MSK 2014
>> D:\moses-cygwin-64bit\scripts\training/corpus/en-de-int-train.snt already in place, reusing
>>(2) running giza @ Thu Jun 5 16:58:36 MSK 2014
>>(2.1a) running snt2cooc de-en @ Thu Jun 5 16:58:36 MSK 2014
>>Executing: mkdir -p D:\moses-cygwin-64bit\scripts\training/giza.de-en
>>Executing: D:\moses-cygwin-64bit\scripts\training/snt2cooc.exe D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt
>>D:\moses-cygwin-64bit\scripts\training/snt2cooc.exe D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt
>>END.
>>(2.1b) running giza de-en @ Thu Jun 5 16:58:36 MSK 2014
>>D:\moses-cygwin-64bit\scripts\training/GIZA++ -CoocurrenceFile D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc -c D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1 -nsmooth 4 -o D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en -onlyaldumps 1 -p0 0.999 -s D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb -t D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
>>Executing: D:\moses-cygwin-64bit\scripts\training/GIZA++ -CoocurrenceFile D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc -c D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1 -nsmooth 4 -o D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en -onlyaldumps 1 -p0 0.999 -s D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb -t D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
>>D:\moses-cygwin-64bit\scripts\training/GIZA++ -CoocurrenceFile D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.cooc -c D:\moses-cygwin-64bit\scripts\training/corpus/de-en-int-train.snt -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1 -nsmooth 4 -o D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en -onlyaldumps 1 -p0 0.999 -s D:\moses-cygwin-64bit\scripts\training/corpus/en.vcb -t D:\moses-cygwin-64bit\scripts\training/corpus/de.vcb
>>"D:\moses-cygwin-64bit\scripts\training/GIZA++" ?? ????? ???????? ??? ?????
>>????????, ??????? ?????? ??? ?????? ????.
>>Exit code: 1
>>ERROR: Giza did not produce the output file D:\moses-cygwin-64bit\scripts\training/giza.de-en/de-en.A3.final. Is your corpus clean (reasonably-sized sentences)? at ./train-model.perl line 1182.


I tried to clean the my corpus with a clean-corpus-n.perl. It did not help.
Can you help me?

Best regards,
Alexandr Komin.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140605/e35cffd7/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 92, Issue 11
*********************************************

Tweet