Moses-support Digest, Vol 99, Issue 39

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. replace giza++ by lf_aligner with moses (emna hkiri)
2. Re: MGIZA is slower than GIZA (Tom Hoar)


----------------------------------------------------------------------

Message: 1
Date: Sat, 17 Jan 2015 20:38:22 +0100
From: emna hkiri <emna.hkiri@gmail.com>
Subject: [Moses-support] replace giza++ by lf_aligner with moses
To: moses-support@mit.edu
Message-ID:
<CAAp-nZ3dY3q6246ap8jjuwnsXfBNqNkuWqEnfSuaAX-ZTk--WQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear friends
i'm trying to build an english-arabic SMT with moses
in the alignment with Giza++ i had a very bad results: poor quality of
alignment!!
i tried to uses the lf_aligner tool and it gives better results than
giza++ but i don't know if it is possible to use into/with moses
if yes !!! do you know how to proceed ???
if it is not possible please tell me how to improve the quality of alignment
thank you in advance
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150117/3ecec4d0/attachment-0001.htm

------------------------------

Message: 2
Date: Sun, 18 Jan 2015 15:25:32 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] MGIZA is slower than GIZA
To: moses-support@mit.edu
Message-ID: <54BB6DFC.5090800@precisiontranslationtools.com>
Content-Type: text/plain; charset="windows-1252"

Your command line sets "--mgiza-cpus 3" which assigns 3 CPUs to each
instance of mgiza on your quad-core machine. You also set the
"--parallel" flag. The notes say the --parallel flag run "forward and
inverse GIZA++ in parallel". This means the forward and reverse
instances of mgiza are trying to use 3 CPUs each, or a total of 6
threads on on 8-threaded CPU. Sounds reasonable.

We've been using dual-threaded quad-cores for a while. We set
"--mgiza-cpus 8" and never use the "--parallel" flag. In this
configuration, we never see a slow-down. So, I'm wondering if the
"--parallel" flag causes some other kind of resource bottleneck.

Try dropping the "--parallel" flag, and set "--mgiza-cpus 8" to see what
happens.




On 01/16/2015 11:34 PM, Hieu Hoang wrote:
> can you provide the training corpus so I can verify your results?
>
> On 16 January 2015 at 15:53, Li Xiang <lixiang.ict@gmail.com
> <mailto:lixiang.ict@gmail.com>> wrote:
>
> Hi all,
>
> I trained the alignment model on the same data with the same
> parameters using GIZA and MGIZA respectively. The training corpus
> includes 200K sentences. My server has an Intel Quad CPU i4790K
> which has 4 cores and each core has 2 threads. It costs 2905
> seconds for GIZA. But it costs 5259 seconds for MGIZA with 3
> threads. I think MGIZA is much faster than GIZA. But I got bad
> result. I do not know the reason is the compile way or others.
>
> Does anyone has relative experience? Thanks.
>
> The following is the training command for MGIZA. And the training
> data is the FBIS zh-en data. But I can not public the data because
> of copyright.
>
>
> ${mosesScript}/training/train-model.perl \
> --external-bin-dir "${binDir}" \
> --root-dir "${trainDir}" \
> --corpus train \
> --f src \
> --e ref \
> --alignment grow-diag-final-and \
> --parallel \
> --first-step 1 \
> --last-step 3 \
> --mgiza --mgiza-cpus 3
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150118/4ef0f047/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 99, Issue 39
*********************************************

Tweet