Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. tokenizer.perl weirdness with some patterns (Ozan ?a?layan)
2. Fill-up combination (Marwa Refaie)
3. Re: Fill-up combination (t.dwojak@amu.edu.pl)
4. nplm / Bilingual LM (Marwa Refaie)
5. Re: Error compiling Moses on SUSE server (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Thu, 2 Jul 2015 21:48:28 +0200
From: Ozan ?a?layan <ozancag@gmail.com>
Subject: [Moses-support] tokenizer.perl weirdness with some patterns
To: moses-support@mit.edu
Message-ID:
<CAFub=KRLb_A97qN_FpasmXDH=Ag+X91FCMdOFnvvc_YPLNeVQQ@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8
Hello,
$ echo "tu ne peux pas me voir. blabla" | tokenizer.perl -l fr
tu ne peux pas me voir. blabla
$ echo -n "I don't understand your reactions. sorry." | tokenizer.perl -l en
I don 't understand your reactions. sorry .
So the problem is that if a dot is followed by a space and then a
lowercase letter, it is not tokenized. This is happening in at least
the french tasks of IWSLT. Is this expected? The responsible line for
this problem is tokenizer.perl:330. What should I lose if I comment
out the responsible part for this in large scale processing?
Thanks.
PS: I also filed an issue for this:
https://github.com/moses-smt/mosesdecoder/issues/118
--
Ozan ?a?layan
Research Assistant
Galatasaray University - Computer Engineering Dept.
http://www.ozancaglayan.com
------------------------------
Message: 2
Date: Fri, 3 Jul 2015 06:00:08 +0200
From: Marwa Refaie <marwa.refaie@gmail.com>
Subject: [Moses-support] Fill-up combination
To: moses-support@mit.edu
Message-ID:
<CADJOO167B941v74MHKX1Gf1OFvz-KR_CxZ_bYiu-oRXL1VBt-A@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi
My question now concerns the fill-up combination feature for combining
multiple phrase tables.
I already have the two phrase tables, when should I hold the TUNING (MERT)
Step ?? before using the "perl combine-ptables.pl --mode=fillup" or after
producing the new one ??
--
Marwa N. Refaie
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150703/9c75501c/attachment-0001.htm
------------------------------
Message: 3
Date: Fri, 03 Jul 2015 07:11:54 +0200
From: t.dwojak@amu.edu.pl
Subject: Re: [Moses-support] Fill-up combination
To: Marwa Refaie <marwa.refaie@gmail.com>
Cc: moses-support@mit.edu
Message-ID: <bae2fe4157f1e2e47ec1cf2371b0bf9f@amu.edu.pl>
Content-Type: text/plain; charset="us-ascii"
Hi,
the fill-up combination gives you a new phrase table. The tuning step
tries to find the weights for your model, in particular for the new
phase table. Hence, firstly fill-up combination step, then MERT.
--
Tomasz Dwojak
On 2015-07-03 06:00, Marwa Refaie wrote:
> Hi
> My question now concerns the fill-up combination feature for combining multiple phrase tables.
> I already have the two phrase tables, when should I hold the TUNING (MERT) Step ?? before using the "perl combine-ptables.pl [2] --mode=fillup" or after producing the new one ?? --
>
> Marwa N. Refaie
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support [1]
Links:
------
[1] http://mailman.mit.edu/mailman/listinfo/moses-support
[2] http://combine-ptables.pl
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150703/4abef9b4/attachment-0001.htm
------------------------------
Message: 4
Date: Fri, 3 Jul 2015 13:19:35 +0200
From: Marwa Refaie <marwa.refaie@gmail.com>
Subject: [Moses-support] nplm / Bilingual LM
To: moses-support@mit.edu
Message-ID:
<CADJOO17HKUwNwGoVkvAxBKFd1fU5dCZdC5jJXkyu-J_ocFYo3Q@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi
>From a month both the nplm & Bilingual NPLM was working great, suddenly now
they seems not linked to moses!!!!!!!!!!!!! .. I try to recompile but
always add nothing
./bjam --with-nplm=~/nplm-master/src
Tip: install tcmalloc for faster threading. See BUILD-INSTRUCTIONS.txt for
more information.
mkdir: cannot create directory ?bin?: File exists
warning: No toolsets are configured.
warning: Configuring default toolset "gcc".
warning: If the default is wrong, your build may not work correctly.
warning: Use the "toolset=xxxxx" option to override our guess.
warning: For more configuration options, please consult
warning:
http://boost.org/boost-build2/doc/html/bbv2/advanced/configuration.html
...patience...
...patience...
...found 4625 targets...
SUCCESS
*Then when try the featyre "NeuralLM " or "BilingualNPLM"*
Feature name NeuralLM is not registered.
Feature name BilingualNPLM is not registered
Any suggestion please ??
Marwa N. Refaie
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150703/19a2352e/attachment-0001.htm
------------------------------
Message: 5
Date: Fri, 3 Jul 2015 16:21:32 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Error compiling Moses on SUSE server
To: Fabian Boost <fabian.boost@googlemail.com>, moses-support@mit.edu
Message-ID: <55967E4C.7060001@gmail.com>
Content-Type: text/plain; charset="windows-1252"
there seems to be 2 errors.
1. moses/LM/IRST.cpp:29: error: 'irstlm' is not a namespace-name
- there are different versions of IRSTLM. Make sure you get the
latest 1 if you have the latest Moses code
2. phrase-extract/ScoreFeatureTest.cpp:92: error: ISO C++ does not
include variadic templates
- we've been test new C++11 features. However, this code had
been rolled back. git pull to get the latest version of Moses and you
won't see this error anymore
On 02/07/2015 20:07, Fabian Boost wrote:
> Hi,
>
> when trying to compile Moses 3.0 I get error messages, which are
> related to multi-threading I think. The command line to compile Moses is:
>
> ./bjam --prefix=/q_files/development/moses/moses3/mosesdecoder-master
> --install-scripts=/q_files/development/moses/moses3/mosesdecoder-master/scripts
> --with-irstlm=/q_files/development/moses/irstlm/irstlm-5.80.03
> --with-xmlrpc-c=/q_files/development/moses/xmlrpc/xmlrpc-c-1.25.28
> --with-boost=/q_files/development/moses/boost/boost_1_55_0
> --full-tcmalloc debug-symbols=off --notrace link=static
>
> I attached the build log.
> Please help me to compile Moses.
>
> Kind regards,
>
> Fabian Boost
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150703/81c9a712/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 105, Issue 7
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 105, Issue 7"
Post a Comment