Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. mert.out error (emna hkiri)
2. Re: Duplicated source files (Hieu Hoang)
3. Re: Duplicated source files (Barry Haddow)
4. Re: Factored Model decoder fail !! (Hieu Hoang)
----------------------------------------------------------------------
Message: 1
Date: Fri, 1 May 2015 17:54:34 +0100
From: emna hkiri <emna.hkiri@gmail.com>
Subject: [Moses-support] mert.out error
To: moses-support@mit.edu
Message-ID:
<CAAp-nZ1Z92fd4ptNZtEbdUNK369fYe7dTtWw9sZDojB_ZYbdag@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
dear friends
I am stuck with this message in my mert.out after going through line 1539:
Scoring the nbestlist.
exec: /home/emna/emna/working/mert-work/extractor.sh
Executing: /home/emna/emna/working/mert-work/extractor.sh > extract.out 2>
extract.err
Exit code: 1
ERROR: Failed to run '/home/emna/emna/working/mert-work/extractor.sh'. at
/home/emna/emna/mosesdecoder/scripts/training/mert-moses.pl line 1539.
any help please? ? the file mert-work/extractor.sh is in the correct place
thank you in advance
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150501/803dbead/attachment-0001.htm
------------------------------
Message: 2
Date: Fri, 01 May 2015 22:13:26 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Duplicated source files
To: Jeroen Vermeulen <jtv@precisiontranslationtools.com>,
"moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <5543C246.3080509@gmail.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
i suppose everything should reference the moses lib.
that's getting a bit bloated, one day we should look at splitting it up
On 30/04/2015 10:24, Jeroen Vermeulen wrote:
> Any chance we could re-unify the gzfilebuf and InputFileStream modules?
> Looks like we're carrying around 4 copies of each, and they're starting
> to diverge.
>
> I'd be happy to make the change, if we know a good reusable place to put it.
>
>
> Jeroen
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu
------------------------------
Message: 3
Date: Fri, 01 May 2015 19:37:19 +0100
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] Duplicated source files
To: Hieu Hoang <hieuhoang@gmail.com>, Jeroen Vermeulen
<jtv@precisiontranslationtools.com>, "moses-support@mit.edu"
<moses-support@mit.edu>
Message-ID: <04FA94C6-7BB5-47D1-A29E-BF85EAC2AA4C@staffmail.ed.ac.uk>
Content-Type: text/plain; charset="utf-8"
What about the util directory?
On 1 May 2015 19:13:26 BST, Hieu Hoang <hieuhoang@gmail.com> wrote:
>i suppose everything should reference the moses lib.
>
>that's getting a bit bloated, one day we should look at splitting it up
>
>On 30/04/2015 10:24, Jeroen Vermeulen wrote:
>> Any chance we could re-unify the gzfilebuf and InputFileStream
>modules?
>> Looks like we're carrying around 4 copies of each, and they're
>starting
>> to diverge.
>>
>> I'd be happy to make the change, if we know a good reusable place to
>put it.
>>
>>
>> Jeroen
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>--
>Hieu Hoang
>Researcher
>New York University, Abu Dhabi
>http://www.hoang.co.uk/hieu
>
>_______________________________________________
>Moses-support mailing list
>Moses-support@mit.edu
>http://mailman.mit.edu/mailman/listinfo/moses-support
--
Sent from my Android device with K-9 Mail. Please excuse my brevity.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150501/02852100/attachment-0001.htm
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: not available
Url: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150501/02852100/attachment-0001.bat
------------------------------
Message: 4
Date: Fri, 01 May 2015 22:59:21 +0400
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Factored Model decoder fail !!
To: Marwa Refaie <basmallah@hotmail.com>, "moses-support@mit.edu"
<moses-support@mit.edu>
Message-ID: <5543CD09.9030502@gmail.com>
Content-Type: text/plain; charset="utf-8"
in the moses.ini file, change
PhraseDictionaryOnDisk ... input-factor=0
to
PhraseDictionaryOnDisk ... input-factor=0,1
On 01/05/2015 13:33, Marwa Refaie wrote:
>
> I try to build a factored model with word|pos. After fixing all
> erroros, I got the "segmentation fault" error, so I compress the
> phrase table by
>
> ~/mosesdecoder/bin/CreateOnDiskPt 2 2 4 100 2
> ~/April/small/-dir/model/phrase-table.0-0,1.gz phrase-table.folder
>
> Now I have this error !!! I change the ini file but still stuck here
> ... Please any help ??
>
> On-disk phrase table has 2 source factors.. The ini file specified 1
> source factors .... Aborted (core dumped)
> or
> SegmentationFault (core dumped)
> or
> No phrase dictionary with index 1 available!
>
> as I change ini Input factor or mapping steps.
>
> English / Arabic corpus
>
>
> Its|VBD complement|NN the|NN error|NN rate,|NN is|NN the|NN
> proportion|NN of|NN incorrect|NN predictions|NN on|NN the|NN same|NN
> data.|NN
>
> See|VBD Also:|NN hold|NN out|NN sample,|NN Machine|DTNN Learning.|DTJJ
>
>
> ???????|NN ?????|NN ????????|DTNN ????????|VBD ???|NN ????|NN ?????|JJ
> ??????|VBP ?????|NN ?????|VBP ???|IN ????????|DTNN .|PUNC
> ????|VB ????|NN :|PUNC ?????|NN ?????|VBP ???|IN ????????.|DTNN
>
> Phrase Table 0-0,1
> ] proposed the ||| ]|NN ?????|VBD ||| 1 0.102035 1 0.124013
> ||| 0-0 1-1 2-1 ||| 1 1 1 ||| |||
> ] suggests analysis of ||| ]|NN ????|VBP ?????|NN ||| 1
> 0.00298151 1 0.00967381 ||| 0-0 1-1 2-2 3-2 ||| 1 1 1 ||| |||
>
> Moses.ini
> # input factors
> [input-factors]
> 0
> 1
>
> # mapping steps
> [mapping]
> 0 T 0
>
> [distortion-limit]
> 6
>
> # feature functions
> [feature]
> UnknownWordPenalty
> WordPenalty
> PhrasePenalty
> #PhraseDictionaryMemory name=TranslationModel0 num-features=4
> path=/home/marwa/Phd/April/bilmpos/small/-dir/model/phrase-table.0-0,1.gz
> input-factor=0 output-factor=0,1
>
> PhraseDictionaryOnDisk name=TranslationModel0 num-features=4
> path=/home/marwa/Phd/April/bilmpos/small/-dir/model/phrase-table.folder input-factor=0
> output-factor=0,1
>
> Distortion
> KENLM name=LM0 factor=2
> path=/home/marwa/Phd/April/bilmpos/small/pos.binary order=5
> KENLM name=LM1 factor=0
> path=/home/marwa/Phd/April/bilmpos/small/surface.binary order=5
>
>
> /*Marwa N. Refaie*/
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150501/5f128702/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 103, Issue 2
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 103, Issue 2"
Post a Comment