Moses-support Digest, Vol 113, Issue 14

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Survey on Optimization Methods for MT (Graham Neubig)
2. Re: Missing /usr/lib64/lib64/libboost_thread-mt.so.5 for
multithreaded GIZA (Hieu Hoang)
3. Training: ferility limit (Masa Taka)


----------------------------------------------------------------------

Message: 1
Date: Mon, 7 Mar 2016 10:24:25 +0900
From: Graham Neubig <neubig@is.naist.jp>
Subject: Re: [Moses-support] Survey on Optimization Methods for MT
To: Matt Post <post@cs.jhu.edu>
Cc: "<moses-support@mit.edu>" <moses-support@mit.edu>
Message-ID:
<CADkjOCNwWv+b8=Mxsu9KuQn2+JT78jE02hSt5g2Hw8mpCOdY3Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Matt,

The link there is our preprint version for CL.
You can also find the initial draft of the final version at the following
link:
http://www.mitpressjournals.org/doi/abs/10.1162/COLI_a_00241

The content is essentially the same, with only editing and formatting
changes.

Graham

On Sun, Mar 6, 2016 at 10:32 PM, Matt Post <post@cs.jhu.edu> wrote:

> Thanks, Graham! Is this the same as the CL preprint, or is your link an
> updated version?
>
> matt
>
>
> On Mar 5, 2016, at 10:36 AM, Graham Neubig <neubig@is.naist.jp> wrote:
>
> Hi Moses Folks,
>
> This is not related to a support request, but Taro Watanabe and I wrote a
> Computational Linguistics survey on optimization (parameter tuning) methods
> for machine translation:
> http://www.phontron.com/paper/neubig16cl.pdf
>
> If you're interested in learning in detail about the optimization methods
> used in Moses like MERT, Mira, PRO, etc., please take a look!
>
> Graham
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160306/f741a219/attachment-0001.html

------------------------------

Message: 2
Date: Mon, 7 Mar 2016 09:33:40 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Missing
/usr/lib64/lib64/libboost_thread-mt.so.5 for multithreaded GIZA
To: "Sergey A." <www.sergo@gmail.com>, moses-support@mit.edu
Message-ID: <56DD4AF4.7060601@gmail.com>
Content-Type: text/plain; charset="windows-1252"

where did you get the code for mgiza from and what was the exact
commands you used to compile?

I just tested mgiza compilation with the code from
https://github.com/moses-smt/mgiza
using the commands
cmake .
cmake .
make -j4
It seems to compile ok

On 06/03/2016 20:02, Sergey A. wrote:
> Hello.
>
> I'm trying to compile mgiza
> <http://www.statmt.org/moses/?n=Moses.ExternalTools#ntoc3>, but
> getting the below error. What am I doing wrong? Note that I don't have
> root access on the machine, so if libraries needed I'd like to know
> how to download and use them without installing on the server. BTW, I
> couldn't find anything in the archives
> <http://www.google.com/coop/cse?cx=006255449393150026232:wtqyknvwh4g>.
>
> make[2]: *** No rule to make target `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/hmmnorm'. Stop.
> make[2]: *** Waiting for unfinished jobs....
> make[2]: *** No rule to make target `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/d4norm'. Stop.
> make[2]: *** Waiting for unfinished jobs....
> make[2]: *** No rule to make target `/usr/lib64/lib64/libboost_thread-mt.so.5', needed by `bin/mgiza'. Stop.
> make[2]: *** Waiting for unfinished jobs....
> [ 96%] [ 98%] [100%] Building CXX object src/CMakeFiles/hmmnorm.dir/hmmnorm.cxx.o
> Building CXX object src/CMakeFiles/d4norm.dir/d4norm.cxx.o
> Building CXX object src/CMakeFiles/mgiza.dir/main.cpp.o
> make[1]: *** [src/CMakeFiles/hmmnorm.dir/all] Error 2
> make[1]: *** Waiting for unfinished jobs....
> make[1]: *** [src/CMakeFiles/d4norm.dir/all] Error 2
> make[1]: *** [src/CMakeFiles/mgiza.dir/all] Error 2
> make: *** [all] Error 2
>
> Thanks in advance, I'll really appreciate any help here.
>
> Sergey
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160307/8dae6a21/attachment-0001.html

------------------------------

Message: 3
Date: Mon, 07 Mar 2016 09:43:19 +0000
From: Masa Taka <grantaka36@gmail.com>
Subject: [Moses-support] Training: ferility limit
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAEJVhXcTT=z9eevzRqrQzaqbPt5m1aBfOyJWS7ezhKJNj+z3mg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

> the maximum allowed limit for a source word fertility
> source length = 1 target length = 28 ratio 28 ferility limit : 9

With GIZA++ training, we have found some warning as above (in the attached
.txt file.) This mailing list archive says the following and I know what
and why.

https://www.mail-archive.com/moses-support%40mit.edu/msg00603.html

Q1) Can we change the preset value "9" to others?
Q2) Why the initial value set to "9?"
Q3) I think the message "ferility limit" should be "fertility limit," so
how do I escalate or report this ? (Or, is a pull request to some
repository available?)

Regards,
Masataka
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160307/a8c01d04/attachment-0001.html
-------------- next part --------------
Executing: (path)bin/GIZA++ -CoocurrenceFile (path_to_train)train/align/trg-src.cooc -c (path_to_train)train/align/trg-src.snt -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1 -nsmooth 4 -o (path_to_train)train/align/trg-src.giza -onlyaldumps 1 -p0 0.999 -s (path_to_train)train/align/trg.vcb -t (path_to_train)train/align/src.vcb
Executing: (path)bin/GIZA++ -CoocurrenceFile (path_to_train)train/align/src-trg.cooc -c (path_to_train)train/align/src-trg.snt -m1 5 -m2 0 -m3 3 -m4 3 -model1dumpfrequency 1 -model4smoothfactor 0.4 -nodumps 1 -nsmooth 4 -o (path_to_train)train/align/src-trg.giza -onlyaldumps 1 -p0 0.999 -s (path_to_train)train/align/src.vcb -t (path_to_train)train/align/trg.vcb
Reading vocabulary file from:(path_to_train)train/align/src.vcb
Reading vocabulary file from:(path_to_train)train/align/trg.vcb
Reading vocabulary file from:(path_to_train)train/align/src.vcb
Reading vocabulary file from:(path_to_train)train/align/trg.vcb
{WARNING:(b)truncated sentence 1099}{WARNING:(b)truncated sentence 1137}{WARNING:(a)truncated sentence 1099}{WARNING:(a)truncated sentence 1137}{WARNING:(b)truncated sentence 2768}{WARNING:(a)truncated sentence 2768}{WARNING:(a)truncated sentence 4875}{WARNING:(b)truncated sentence 4875}{WARNING:(a)truncated sentence 8930}{WARNING:(b)truncated sentence 8930}{WARNING:(a)truncated sentence 12557}{WARNING:(b)truncated sentence 12557}WARNING: The following sentence pair has source/target sentence length ration more than
the maximum allowed limit for a source word fertility
source length = 1 target length = 28 ratio 28 ferility limit : 9
Shortening sentence
Sent No: 12864 , No. Occurrences: 1
0 1605
47199 39626 13909 29030 760 13920 5649 26337 4446 22689 5649 13729 34683 4600 20668 14153 5649 15533 46156 4531 7238 7182 8179 46156 4570 45769 50363 261

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 14
**********************************************

Tweet