Moses-support Digest, Vol 105, Issue 9

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: nplm / Bilingual LM (Nikolay Bogoychev)
2. Re: nplm / Bilingual LM (Raj Dabre)


----------------------------------------------------------------------

Message: 1
Date: Fri, 3 Jul 2015 15:03:17 +0100
From: Nikolay Bogoychev <nheart@gmail.com>
Subject: Re: [Moses-support] nplm / Bilingual LM
To: Marwa Refaie <marwa.refaie@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAJzPUExwRoNawBkoEmbP-Q8Ji5KqX0HLENC+ad4e7Nx3iVA9eA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hey Marwa,

I can't reproduce the problem. Using latest moses git and nplm from
https://github.com/rsennrich/nplm it compiles just file and I get both
BilingualNPLM and NeuralLM FFs
I can suggest that you do a ./bjam clean and try recompiling again.

Cheers,

Nick

On Fri, Jul 3, 2015 at 12:19 PM, Marwa Refaie <marwa.refaie@gmail.com>
wrote:

> Hi
> From a month both the nplm & Bilingual NPLM was working great, suddenly
> now they seems not linked to moses!!!!!!!!!!!!! .. I try to recompile but
> always add nothing
>
> ./bjam --with-nplm=~/nplm-master/src
>
> Tip: install tcmalloc for faster threading. See BUILD-INSTRUCTIONS.txt
> for more information.
> mkdir: cannot create directory ?bin?: File exists
> warning: No toolsets are configured.
> warning: Configuring default toolset "gcc".
> warning: If the default is wrong, your build may not work correctly.
> warning: Use the "toolset=xxxxx" option to override our guess.
> warning: For more configuration options, please consult
> warning:
> http://boost.org/boost-build2/doc/html/bbv2/advanced/configuration.html
> ...patience...
> ...patience...
> ...found 4625 targets...
> SUCCESS
>
> *Then when try the featyre "NeuralLM " or "BilingualNPLM"*
>
> Feature name NeuralLM is not registered.
> Feature name BilingualNPLM is not registered
>
> Any suggestion please ??
>
> Marwa N. Refaie
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150703/8cd9685b/attachment-0001.htm

------------------------------

Message: 2
Date: Fri, 3 Jul 2015 23:44:46 +0900
From: Raj Dabre <prajdabre@gmail.com>
Subject: Re: [Moses-support] nplm / Bilingual LM
To: Nikolay Bogoychev <nheart@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAB3gfjAXpeOKnHNBTc5w2z+6D_tOhNiTpQKCUodFEC190xmhLQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

On that note.
I tried to use KENLM and NeuralLM together but for some reason the decoder
simply exits.
I am attaching my moses-nplm-kenlm.ini file.

By the way:
I compiled my mosesdecoder (latest pull) wit the command: ./bjam
--with-boost=/share/usr-x86_64
--with-nplm=/home/raj/softwares-and-scripts/nplm-master --max-factors=10
-j10
Compilation with nplm integration was a success.

Here is where it gets weird. I ran 2 tuning experiments: 1 with no Language
model and 1 with NeuralLM (not the bilingual version). The moses-nplm.ini
is also attached.
The tuning proceeds for both but the tuning set BLEU for both are the same
(for each run from run 2 to run 25).
I made sure that the LM was trained on the target side training data.
Am I missing something?


On Fri, Jul 3, 2015 at 11:03 PM, Nikolay Bogoychev <nheart@gmail.com> wrote:

> Hey Marwa,
>
> I can't reproduce the problem. Using latest moses git and nplm from
> https://github.com/rsennrich/nplm it compiles just file and I get both
> BilingualNPLM and NeuralLM FFs
> I can suggest that you do a ./bjam clean and try recompiling again.
>
> Cheers,
>
> Nick
>
> On Fri, Jul 3, 2015 at 12:19 PM, Marwa Refaie <marwa.refaie@gmail.com>
> wrote:
>
>> Hi
>> From a month both the nplm & Bilingual NPLM was working great, suddenly
>> now they seems not linked to moses!!!!!!!!!!!!! .. I try to recompile but
>> always add nothing
>>
>> ./bjam --with-nplm=~/nplm-master/src
>>
>> Tip: install tcmalloc for faster threading. See BUILD-INSTRUCTIONS.txt
>> for more information.
>> mkdir: cannot create directory ?bin?: File exists
>> warning: No toolsets are configured.
>> warning: Configuring default toolset "gcc".
>> warning: If the default is wrong, your build may not work correctly.
>> warning: Use the "toolset=xxxxx" option to override our guess.
>> warning: For more configuration options, please consult
>> warning:
>> http://boost.org/boost-build2/doc/html/bbv2/advanced/configuration.html
>> ...patience...
>> ...patience...
>> ...found 4625 targets...
>> SUCCESS
>>
>> *Then when try the featyre "NeuralLM " or "BilingualNPLM"*
>>
>> Feature name NeuralLM is not registered.
>> Feature name BilingualNPLM is not registered
>>
>> Any suggestion please ??
>>
>> Marwa N. Refaie
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
Raj Dabre.
Doctoral Student,
Graduate School of Informatics,
Kyoto University.
CSE MTech, IITB., 2011-2014
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150703/681168bd/attachment-0001.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: moses-nplm-kenlm.ini
Type: application/octet-stream
Size: 1084 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150703/681168bd/attachment-0002.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: moses-nplm.ini
Type: application/octet-stream
Size: 1086 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150703/681168bd/attachment-0003.obj

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 105, Issue 9
*********************************************

Tweet