Moses-support Digest, Vol 107, Issue 48

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Blingual neural lm, log-likelihood: -nan (jian zhang)


----------------------------------------------------------------------

Message: 1
Date: Sat, 19 Sep 2015 20:58:20 +0100
From: jian zhang <zhangj@computing.dcu.ie>
Subject: [Moses-support] Blingual neural lm, log-likelihood: -nan
To: moses-support@mit.edu
Message-ID:
<CALA=z0AZk4kP-K70Hg4Bhp_4ezV0qsP0Pr4VWMFgMAAM43G7GA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi all,

I got

Epoch xxxx
Current learning rate: 1
Training minibatches: Validation log-likelihood: -nan
perplexity: nan

during bilingual neural lm training.

I use command:
/home/user/tools/nplm-master-rsennrich/src/trainNeuralNetwork --train_file
work_dir/blm/train.numberized --num_epochs 30 --model_prefix
work_dir/blm/train.10k.model.nplm --learning_rate 1 --minibatch_size 1000
--num_noise_samples 100 --num_hidden 2 --input_embedding_dimension 512
--output_embedding_dimension 192 --num_threads 6 --loss_function log
--activation_function tanh --validation_file work_dir/blm/valid.numberized
--validation_minibatch_size 10

where train.numberized and valid.numberized files are splitted from the
file generated by
script ${moses}/scripts/training/bilingual-lm/extract_training.py.

Training/Validation numbers are:
Number of training instances: 4128195
Number of validation instances: 217274


Thanks,

Jian


Jian Zhang
Centre for Next Generation Localisation (CNGL)
<http://www.cngl.ie/index.html>
Dublin City University <http://www.dcu.ie/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150919/9d3975b8/attachment-0001.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 107, Issue 48
**********************************************

Tweet