Moses-support Digest, Vol 112, Issue 23

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Scoring string-to-tree rules (Felipe S?nchez Mart?nez)
2. Segmentation Fault (Jasneet Sabharwal)
3. Dumb question: Environment variables in Moses config
(Jeremy Gwinnup)


----------------------------------------------------------------------

Message: 1
Date: Thu, 11 Feb 2016 18:48:54 +0100
From: Felipe S?nchez Mart?nez <fsanchez@dlsi.ua.es>
Subject: Re: [Moses-support] Scoring string-to-tree rules
To: moses-support <moses-support@mit.edu>
Cc: Juan Antonio P?rez Ortiz <japerez@dlsi.ua.es>
Message-ID: <56BCC986.6090302@dlsi.ua.es>
Content-Type: text/plain; charset=utf-8; format=flowed

Hi all,

This is to let you know that I found out that my extract.inv.sorted.gz
had the variables on the right side of the rules in the wrong order
(source, target instead of target, source), so it was my mistake.

Sorry for the noise!

Cheers
--
Felipe


El 09/02/16 a las 23:30, Felipe S?nchez Mart?nez escribi?:
>
> Hello all,
>
> I am trying to score a set of rules that, even thought they do not come
> from any tree in either the source or the target language, they look
> like those used for string-to-tree SMT. An excerpt of the
> extract.sorted.gz file follows:
>
> King Solomon [X][X0] [X] ||| [X][X0] rey salom?n [X0] ||| 0-1 1-2 2-0
> ||| 0.2 |||
> King Solomon [X][X0] [X] ||| [X][X0] rey salom?n [X0] ||| 0-1 1-2 2-0
> ||| 0.333333 |||
> King [X] ||| rey [X0] ||| 0-0 ||| 1 |||
> Solomon [X] ||| salom?n [X0] ||| 0-0 ||| 1 |||
> [X][X0] mines [X] ||| las minas [X][X0] [X0] ||| 1-0 1-1 0-2 ||| 0.2 |||
> [X][X0] mines [X] ||| las minas [X][X0] [X0] ||| 1-0 1-1 0-2 ||| 0.5 |||
>
> When I try to score these rules to obtain the rule table I get the
> following error:
> ERROR: target phrase does not match in line 1: '&apos; s [X]' != '&apos;
> s [X0]'
> which is produced in the process of consolidating direct and indirect
> rule tables.
>
> Is there any way to overcome this problem other than editing the code to
> avoid the corresponding checking?
>
> PS: I saw a similar question in the archive, but with no answer; see
> http://moses-support.mit.narkive.com/r4NooMQR/score-externally-acquired-phrases
>
> Thanks you very much in advance!!
> Best wishes
>

--
Felipe S?nchez Mart?nez
Dep. de Llenguatges i Sistemes Inform?tics
Universitat d'Alacant, E-03071 Alacant (Spain)
Tel.: +34 965 903 400, ext: 2966
http://www.dlsi.ua.es/~fsanchez


------------------------------

Message: 2
Date: Thu, 11 Feb 2016 15:23:45 -0800
From: Jasneet Sabharwal <jasneet.sabharwal@sfu.ca>
Subject: [Moses-support] Segmentation Fault
To: moses-support <moses-support@mit.edu>
Message-ID: <7387D3A6-9495-4734-8F80-E49F4B40F6E2@sfu.ca>
Content-Type: text/plain; charset="utf-8"

Hi,

I was adding a new feature function in Moses (https://github.com/KonceptGeek/mosesdecoder/blob/master/moses/FF/CoarseBiLM.cpp <https://github.com/KonceptGeek/mosesdecoder/blob/master/moses/FF/CoarseBiLM.cpp>). It works fine when I test it for 1-2 sentences, but when I?m trying to tune my parameters, I?m getting segmentation faults or sometimes it is bad_alloc. Following was one of the commands that was executed during the tuning process which caused the Segmentation Fault or bad_alloc:

moses -threads 40 -v 0 -config filtered/moses.ini -weight-overwrite 'CoarseLM100= 0.075758 LM0= 0.075758 CoarseBiLMNotClustered= 0.075758 WordPenalty0= -0.151515 PhrasePenalty0= 0.030303 CoarseBiLMClustered= 0.075758 TranslationModel0= 0.030303 0.030303 0.030303 0.030303 Distortion0= 0.045455 CoarseLM1600= 0.075758 LexicalReordering0= 0.045455 0.045455 0.045455 0.045455 0.045455 0.045455' -n-best-list run1.best100.out 100 distinct -input-file tune.word.lc.cn <http://tune.word.lc.cn/>

The log is enclosed in this email.

Any pointers would be very useful.

Thanks,
Jasneet

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160211/aa3dec49/attachment-0002.html
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: error.txt
Url: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160211/aa3dec49/attachment-0001.txt
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160211/aa3dec49/attachment-0003.html

------------------------------

Message: 3
Date: Fri, 12 Feb 2016 09:33:38 -0500
From: Jeremy Gwinnup <jeremy@gwinnup.org>
Subject: [Moses-support] Dumb question: Environment variables in Moses
config
To: moses-support@mit.edu
Message-ID: <35913870-E206-40E6-87DE-D3D382A5BB5F@gwinnup.org>
Content-Type: text/plain; charset=us-ascii

Hi,

Dumb question - can I reference environment variables in a moses.ini ?

Thanks!
-Jeremy


------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 112, Issue 23
**********************************************

Tweet