Moses-support Digest, Vol 161, Issue 3

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Tuning a factored model -> crash (Haukur P?ll J?nsson)
2. Re: Tuning a factored model -> crash (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Mon, 9 Mar 2020 17:04:53 +0000
From: Haukur P?ll J?nsson <haukurpj@ru.is>
Subject: [Moses-support] Tuning a factored model -> crash
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <f0747a9615a74964922b3c2c6c95195e@ru.is>
Content-Type: text/plain; charset="iso-8859-1"

Hi all,


For the last few weeks, I have been trying to train and tune a factored model. I have found it difficult to implement and I now seek some assistance.


I am trying to build a simple factored model from English to Icelandic: T0-0, T0,1-1. Where factor 0 is the surface and factor 1 is the POS. The training data (source and target) I have has three factors `surface|pos|lemma`, the lemma is ignored for now.


When tuning a factored model I run into problems. My first question is, what factors should be in tuning data? It seems that I can have all factors as the input/source but I'm unsure about the output/target.


I run the tuning like so (using 10 threads):


"$MOSESDECODER"/scripts/training/mert-moses.pl \
"$DEV_DATA_IN"."$LANG_FROM" \
"$DEV_DATA_OUT"."$LANG_TO" \
"$MOSESDECODER"/bin/moses "$BASE_MOSES_INI" \
--mertdir "$MOSESDECODER"/bin \
--working-dir "$TUNE_DIR" \
--decoder-flags="-threads $THREADS"


But then when starting to decode the decoder crashes.


Line Line 9: Initialize search took leave|VBP0.103 seconds total
soft|JJ hands|NNS ,|, Jess|NNP you|PRP very|RB weak|JJ ,|, including|VBG 4: Initialize search took .|.
: Collecting options took 0.003severe|JJ ,|, his|PRP$I|PRP loved|VBD Sean|NNP .|. you|PRP know|VBP .|.
seconds at moses/Manager.cpp Line 0.129 seconds total
joint|JJ examination|NN Line 2: Initialize search took 141
Segmentation fault
Exit code: 139


I am monitoring the memory usage and the decoder is only using about 4GB of memory from the 32GB allocated when it crashes. Why the is the decoder crashing? Are there some recommendations for settings when training a factored model?



Haukur P?ll J?nsson

Ranns?knars?rfr??ingur | T?lvunarfr??ideild

Research Specialist | School of Computer Science

P?stfang / E-mail: haukurpj@ru.is

[1568888021669]

H?sk?linn ? Reykjav?k | Reykjavik University

Menntavegur 1 | 101 Reykjav?k | Iceland

S?mi/Tel: +354 599 6200

www.hr.is


-------------- next part --------------
A non-text attachment was scrubbed...
Name: OutlookEmoji-1568888021669ad2739c2-a02c-4116-b00e-9861a354e5e0.png
Type: image/png
Size: 8439 bytes
Desc: OutlookEmoji-1568888021669ad2739c2-a02c-4116-b00e-9861a354e5e0.png
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20200309/03ab3ee7/attachment-0001.png

------------------------------

Message: 2
Date: Mon, 9 Mar 2020 13:22:08 -0700
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Tuning a factored model -> crash
To: Haukur P?ll J?nsson <haukurpj@ru.is>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAEKMkbjcgb=eqb+0gW3yR1UPkPr-U+ZJAkKWsZQvWDx68q4JSw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hieu Hoang
http://statmt.org/hieu


On Mon, 9 Mar 2020 at 10:08, Haukur P?ll J?nsson <haukurpj@ru.is> wrote:

> Hi all,
>
>
> For the last few weeks, I have been trying to train and tune a factored
> model. I have found it difficult to implement and I now seek some
> assistance.
>
>
> I am trying to build a simple factored model from English to Icelandic:
> T0-0, T0,1-1. Where factor 0 is the surface and factor 1 is the POS. The
> training data (source and target) I have has three factors
> `surface|pos|lemma`, the lemma is ignored for now.
>
>
> When tuning a factored model I run into problems. My first question is,
> what factors should be in tuning data? It seems that I can have all factors
> as the input/source but I'm unsure about the output/target.
>
The tuning data needs to also have factors 0 and 1. You should pre-process
ttraining, tuning and test data in the same way

I run the tuning like so (using 10 threads):

>
>
> "$MOSESDECODER"/scripts/training/mert-moses.pl \
> "$DEV_DATA_IN"."$LANG_FROM" \
> "$DEV_DATA_OUT"."$LANG_TO" \
> "$MOSESDECODER"/bin/moses "$BASE_MOSES_INI" \
> --mertdir "$MOSESDECODER"/bin \
> --working-dir "$TUNE_DIR" \
> --decoder-flags="-threads $THREADS"
>
>
> But then when starting to decode the decoder crashes.
>
>
> Line Line 9: Initialize search took leave|VBP0.103 seconds total
> soft|JJ hands|NNS ,|, Jess|NNP you|PRP very|RB weak|JJ ,|, including|VBG
> 4: Initialize search took .|.
> : Collecting options took 0.003severe|JJ ,|, his|PRP$I|PRP loved|VBD
> Sean|NNP .|. you|PRP know|VBP .|.
> seconds at moses/Manager.cpp Line 0.129 seconds total
> joint|JJ examination|NN Line 2: Initialize search took 141
> Segmentation fault
> Exit code: 139
>
>
> I am monitoring the memory usage and the decoder is only using about 4GB
> of memory from the 32GB allocated when it crashes. Why the is the decoder
> crashing? Are there some recommendations for settings when training a
> factored model?


>
>
> Haukur P?ll J?nsson
>
> Ranns?knars?rfr??ingur | T?lvunarfr??ideild
>
> Research Specialist | School of Computer Science
>
> P?stfang / E-mail: haukurpj@ru.is
>
> [1568888021669]
>
> H?sk?linn ? Reykjav?k | Reykjavik University
>
> Menntavegur 1 | 101 Reykjav?k | Iceland
>
> S?mi/Tel: +354 599 6200
>
> www.hr.is
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20200309/a354fe18/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 161, Issue 3
*********************************************

Tweet