Moses-support Digest, Vol 98, Issue 48

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Train tree-to-tree model fail to generate right rules
(Steven Huang)


----------------------------------------------------------------------

Message: 1
Date: Fri, 19 Dec 2014 22:09:49 +0800
From: Steven Huang <d98922047@ntu.edu.tw>
Subject: [Moses-support] Train tree-to-tree model fail to generate
right rules
To: Moses-support@mit.edu
Cc: ??? <farmer.tw@gmail.com>
Message-ID:
<CAG-iPUr73KOwH6f63GdZh1_3QLeYDj7h2=OhdqN9Qc=V-0VTeQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi,

I am trying to train an English to Chinese tree-to-tree model with manually
generated corpus. The translation is unacceptable. It seems that the model
doen't know reordering at all. So I look into the rule-table, there is no
useful rule in it (see the attached file "rule-table.gz").

Here is how I generate the training corpus (see the attached file "tree.en"
and "tree.ch"):
The basic sentence is "What should Steven do?"
I made all combinations with the following rule:
1. "What" is replaced by "When" or "What".
2. "should" is replaced by "can" or "should".
3. "Steven" is replaced by 10 different names.
4. "do" is replaced by "say", "think", or "do"

The train-model command I used is shown below:
$MOSES_DIR/scripts/training/train-model.perl \
--root-dir train \
--mgiza \
--mgiza-cpus 20 \
--corpus $WORK_DIR/tree \
--f en \
--e ch \
--lm 0:3:$LANG_MOD_DIR/utf8/en-ch.blm.ch:8 \
--source-syntax \
--target-syntax \
--glue-grammar \
--max-phrase-length 10 \
--alignment grow-diag-final-and \
--external-bin-dir $MOSES_DIR/tools

Is there any suggestions?

Best,

Steven Huang
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20141219/f10e0bb5/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: rule-table.gz
Type: application/x-gzip
Size: 260 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141219/f10e0bb5/attachment.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: tree.ch
Type: application/octet-stream
Size: 31049 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141219/f10e0bb5/attachment.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: tree.en
Type: application/octet-stream
Size: 28385 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20141219/f10e0bb5/attachment-0001.obj

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 98, Issue 48
*********************************************

Tweet