Home » Uncategories » Moses-support Digest, Vol 92, Issue 6

Moses-support Digest, Vol 92, Issue 6

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. annotations (charmaine ponay)
2. Re: annotations (Philipp Koehn)
3. what is wrong with my data (charmaine ponay)
4. Importing Eclipse projects (Lars Bungum)
5. Re: what is wrong with my data (Benjamin K?rner)


----------------------------------------------------------------------

Message: 1
Date: Mon, 2 Jun 2014 19:06:45 -0700
From: charmaine ponay <csponay@gmail.com>
Subject: [Moses-support] annotations
To: moses-support@mit.edu
Message-ID:
<CAB0nykdPbbHXMQXfg4xRYiSDpkXtCzGN6sFjVxa-kvjCCO5RFQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

can MOSES train data with annotations?

like [LOC] Manila [\LOC]?

Regards,

*Charmaine Salvador - Ponay*
Instructor
Information and Computer Studies Dept.
University of Santo Tomas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140602/d7febbde/attachment-0001.htm

------------------------------

Message: 2
Date: Mon, 2 Jun 2014 22:23:12 -0400
From: Philipp Koehn <pkoehn@inf.ed.ac.uk>
Subject: Re: [Moses-support] annotations
To: charmaine ponay <csponay@gmail.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAAFADDAV+xz47vFvUBdx7Qeqp14gn_5SBbEhYRkY2OUaLidN_Q@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

Hi,

depends on what you what to do with these annotations -
by default they are treated just like any other words.

There is some support for handling of markup here,
if that is what you have in mind:
https://code.google.com/p/m4loc/

-phi

On Mon, Jun 2, 2014 at 10:06 PM, charmaine ponay <csponay@gmail.com> wrote:
> can MOSES train data with annotations?
>
> like [LOC] Manila [\LOC]?
>
> Regards,
>
> Charmaine Salvador - Ponay
> Instructor
> Information and Computer Studies Dept.
> University of Santo Tomas
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>


------------------------------

Message: 3
Date: Mon, 2 Jun 2014 22:30:20 -0700
From: charmaine ponay <csponay@gmail.com>
Subject: [Moses-support] what is wrong with my data
To: moses-support@mit.edu
Message-ID:
<CAB0nykcxJ5J_xgxL2OnvS=J7vZbkMctP8N8wHcn85o7R4n6dEQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

hi, what is wrong with my data if i get errors like these after training?

$ ../mosesdecoder-master/bin/moses -f Charmaine/training/model/moses.ini <
Charmaine/testing.fl > Charmaine/Testing/CharmaineOut
Defined parameters (per moses.ini or switch):
config: Charmaine/training/model/moses.ini
distortion-limit: 6
feature: UnknownWordPenalty WordPenalty PhrasePenalty
PhraseDictionaryMemory name=TranslationModel0 table-limit=20 num-features=4
path=/Masters/Charmaine/training/model/phrase-table.gz input-factor=0
output-factor=0 Distortion SRILM name=LM0 factor=0 path=/Masters/Charmaine/
order=3
input-factors: 0
mapping: 0 T 0
weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2
TranslationModel0= 0.2 0.2 0.2 0.2 Distortion0= 0.3 LM0= 0.5
../mosesdecoder-master/bin
line=UnknownWordPenalty
FeatureFunction: UnknownWordPenalty0 start: 0 end: 0
line=WordPenalty
FeatureFunction: WordPenalty0 start: 1 end: 1
line=PhrasePenalty
FeatureFunction: PhrasePenalty0 start: 2 end: 2
line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20
num-features=4 path=/Masters/Charmaine/training/model/phrase-table.gz
input-factor=0 output-factor=0
FeatureFunction: TranslationModel0 start: 3 end: 6
line=Distortion
FeatureFunction: Distortion0 start: 7 end: 7
line=SRILM name=LM0 factor=0 path=/Masters/Charmaine/ order=3
FeatureFunction: LM0 start: 8 end: 8
/Masters/Charmaine/: line 0: reached EOF before \end\
Start loading text SCFG phrase table. Moses format : [0.000] seconds
Reading /Masters/Charmaine/training/model/phrase-table.gz
----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
Check nextPos != string::npos failed in moses\Phrase.cpp:214
Aborted (core dumped)

Regards,

*Charmaine Salvador - Ponay*
Instructor
Information and Computer Studies Dept.
University of Santo Tomas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140602/0745e4cf/attachment-0001.htm

------------------------------

Message: 4
Date: Tue, 03 Jun 2014 09:44:21 +0200
From: Lars Bungum <lars.bungum@idi.ntnu.no>
Subject: [Moses-support] Importing Eclipse projects
To: moses-support@mit.edu
Message-ID: <538D7CD4.2030104@idi.ntnu.no>
Content-Type: text/plain; charset=UTF-8; format=flowed

Hi,

I try to import the Eclipse projects in the contrib/other-builds
directory, but I am having some problems. Despite following the steps
exactly, the projects fail to build with this error message:

/usr/bin/ld: cannot find -lmoses

(and more for the other modules I didn't symlink in yet). When I look
into the other-builds/moses directory, it is empty. What do I have to
do to get this working?

//LB


------------------------------

Message: 5
Date: Tue, 3 Jun 2014 09:54:03 +0200
From: Benjamin K?rner <b.koerner@stud.uni-heidelberg.de>
Subject: Re: [Moses-support] what is wrong with my data
To: "'charmaine ponay'" <csponay@gmail.com>, <moses-support@mit.edu>
Message-ID: <002101cf7f00$fd4419e0$f7cc4da0$@stud.uni-heidelberg.de>
Content-Type: text/plain; charset="utf-8"

Did you try to escape special chars in your data? See scripts/tokenizer/escape-special-chars.perl.



Best,



Benjamin



Von: moses-support-bounces@mit.edu [mailto:moses-support-bounces@mit.edu] Im Auftrag von charmaine ponay
Gesendet: Dienstag, 3. Juni 2014 07:30
An: moses-support@mit.edu
Betreff: [Moses-support] what is wrong with my data



hi, what is wrong with my data if i get errors like these after training?



$ ../mosesdecoder-master/bin/moses -f Charmaine/training/model/moses.ini < Charmaine/testing.fl > Charmaine/Testing/CharmaineOut

Defined parameters (per moses.ini or switch):

config: Charmaine/training/model/moses.ini

distortion-limit: 6

feature: UnknownWordPenalty WordPenalty PhrasePenalty PhraseDictionaryMemory name=TranslationModel0 table-limit=20 num-features=4 path=/Masters/Charmaine/training/model/phrase-table.gz input-factor=0 output-factor=0 Distortion SRILM name=LM0 factor=0 path=/Masters/Charmaine/ order=3

input-factors: 0

mapping: 0 T 0

weight: UnknownWordPenalty0= 1 WordPenalty0= -1 PhrasePenalty0= 0.2 TranslationModel0= 0.2 0.2 0.2 0.2 Distortion0= 0.3 LM0= 0.5

../mosesdecoder-master/bin

line=UnknownWordPenalty

FeatureFunction: UnknownWordPenalty0 start: 0 end: 0

line=WordPenalty

FeatureFunction: WordPenalty0 start: 1 end: 1

line=PhrasePenalty

FeatureFunction: PhrasePenalty0 start: 2 end: 2

line=PhraseDictionaryMemory name=TranslationModel0 table-limit=20 num-features=4 path=/Masters/Charmaine/training/model/phrase-table.gz input-factor=0 output-factor=0

FeatureFunction: TranslationModel0 start: 3 end: 6

line=Distortion

FeatureFunction: Distortion0 start: 7 end: 7

line=SRILM name=LM0 factor=0 path=/Masters/Charmaine/ order=3

FeatureFunction: LM0 start: 8 end: 8

/Masters/Charmaine/: line 0: reached EOF before \end\

Start loading text SCFG phrase table. Moses format : [0.000] seconds

Reading /Masters/Charmaine/training/model/phrase-table.gz

----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100

Check nextPos != string::npos failed in moses\Phrase.cpp:214

Aborted (core dumped)



Regards,



Charmaine Salvador - Ponay

Instructor
Information and Computer Studies Dept.
University of Santo Tomas

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140603/54d05006/attachment.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 92, Issue 6
********************************************

0 Response to "Moses-support Digest, Vol 92, Issue 6"

Post a Comment

Subscribe to: Post Comments (Atom)