Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Requirement of sorting tables before compacting: unclear
documentation (Christophe Servan)
2. Re: Requirement of sorting tables before compacting: unclear
documentation (Marcin Junczys-Dowmunt)
3. Server development (Tomas Fulajtar)
4. Binarize phrase table with domain feature throws "Already
saved" exception (jian zhang)
----------------------------------------------------------------------
Message: 1
Date: Tue, 31 Mar 2015 19:02:26 +0200
From: Christophe Servan <christophe.servan@gmail.com>
Subject: Re: [Moses-support] Requirement of sorting tables before
compacting: unclear documentation
To: Eleftherios Avramidis <eleftherios.avramidis@dfki.de>
Cc: Moses-Support <moses-support@mit.edu>
Message-ID:
<CAAsGDkr+speSxm4y47wuvBFbm-hbD7UtBxhNvBKv0wwMfnNppw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hello,
this means the phrase table should be sorted using LC_ALL=C like this :
LC_ALL=C sort myPhraseTable > mySortedPhraseTable
But if you used the script train-model.pl then it was done automatically.
Cheers,
Christophe
2015-03-31 16:37 GMT+02:00 Eleftherios Avramidis <
eleftherios.avramidis@dfki.de>:
> Hi,
>
> there is an unclear piece of documentation concerning the required
> "sorting" of compact phrase and reordering tables
> http://www.statmt.org/moses/?n=Advanced.RuleTables
>
> "Phrase tables are required to be sorted as above." but there is no
> sorting mentioned "above". It appears twice. Can somebody clarify this
> to me, so that I can proceed with table processing; and could you also
> possibly fix the documentation?
>
> best
> Lefteris
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150331/9114f548/attachment-0001.htm
------------------------------
Message: 2
Date: Tue, 31 Mar 2015 19:15:50 +0200
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Requirement of sorting tables before
compacting: unclear documentation
To: moses-support@mit.edu
Message-ID: <551AD646.9080101@amu.edu.pl>
Content-Type: text/plain; charset="windows-1252"
Correct. The phrase-table will also complain and croak if the input data
is not correctly sorted. So if it does not fail, your data was OK
(hopefully).
W dniu 31.03.2015 o 19:02, Christophe Servan pisze:
> Hello,
> this means the phrase table should be sorted using LC_ALL=C like this :
> LC_ALL=C sort myPhraseTable > mySortedPhraseTable
> But if you used the script train-model.pl
> <http://train-model.pl/> then it was done automatically.
>
> Cheers,
>
> Christophe
>
> 2015-03-31 16:37 GMT+02:00 Eleftherios Avramidis
> <eleftherios.avramidis@dfki.de <mailto:eleftherios.avramidis@dfki.de>>:
>
> Hi,
>
> there is an unclear piece of documentation concerning the required
> "sorting" of compact phrase and reordering tables
> http://www.statmt.org/moses/?n=Advanced.RuleTables
>
> "Phrase tables are required to be sorted as above." but there is no
> sorting mentioned "above". It appears twice. Can somebody clarify this
> to me, so that I can proceed with table processing; and could you
> also
> possibly fix the documentation?
>
> best
> Lefteris
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150331/01182c7c/attachment-0001.htm
------------------------------
Message: 3
Date: Wed, 1 Apr 2015 08:48:30 +0000
From: Tomas Fulajtar <TomasFu@moravia.com>
Subject: [Moses-support] Server development
To: "moses-support (moses-support@mit.edu)" <moses-support@mit.edu>
Message-ID:
<BY1PR0201MB09651FE5B9F722053DC2E272ADF30@BY1PR0201MB0965.namprd02.prod.outlook.com>
Content-Type: text/plain; charset="utf-8"
Dear all,
I have spotted there were numerous commits in the server side development - could the developers share the news/goals with the forum? I think it might be interesting for more users ? especially those out of core team.
Thank you,
Tom?? Fulajt?r | Researcher
T: +420-545-552-340
tomasfu@moravia.com<mailto:tomasfu@moravia.com> | moravia.com<http://www.moravia.com/> | Skype: tomasfulajtar
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150401/3036641e/attachment-0001.htm
------------------------------
Message: 4
Date: Wed, 1 Apr 2015 11:27:58 +0100
From: jian zhang <zhangj@computing.dcu.ie>
Subject: [Moses-support] Binarize phrase table with domain feature
throws "Already saved" exception
To: moses-support@mit.edu
Message-ID:
<CALA=z0DmX+5TFywcqM1Fdv25wKfqg+vGEzqiTDVv3yX1LkrSSw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi,
When I am binarizing phrase table with domain sparse features, I got
exception:
Executing: /system/mosesdecoder-master/bin/CreateOnDiskPt 1 1 4 100 2
/experiments/de-en/domains-30-03-2015/domain-indicator/tuning/filtered.1/phrase-table.0-0.1.1
/experiments/de-en/domains-30-03-2015/domain-indicator/tuning/filtered.1/phrase-table.0-0.1.1.bin
terminate called after throwing an instance of 'util::Exception'
what(): OnDiskPt/PhraseNode.cpp:97 in void
OnDiskPt::PhraseNode::Save(OnDiskPt::OnDiskWrapper&, size_t, size_t) threw
util::Exception because `m_saved'.
Already saved
I am using ems on moses version 3.0, and the configuration for domain
feature is
domain-features = "subset"
The phrase table entries look like:
! ! ! ! ! ! ! ||| ! ! ! ! ! ! ! ||| 0.41129 0.0415342 0.344595 9.9589e-05
2.718 1 1 ||| 0-0 1-1 2-2 3-3 4-4 5-5 6-6 ||| 124 148 51 ||| |||
! ! ! ! ! ! ! ||| ! ! ! ! ! ! ||| 0.00574516 0.0415342 0.00590043
0.000371446 2.718 1 1 ||| 1-0 0-1 2-1 3-2 4-3 5-4 6-5 ||| 152 148 2 ||| |||
! ! ! ! ! ! ! ||| ! ! ! ! ! ||| 0.000320174 0.0415342 0.00044132 0.00138541
2.718 1 1 ||| 0-0 1-0 1-1 2-1 3-1 2-2 4-2 3-3 5-3 4-4 6-4 ||| 204 148 1 |||
|||
Did I miss anything?
Thanks,
Jian
--
Jian Zhang
Centre for Next Generation Localisation (CNGL)
<http://www.cngl.ie/index.html>
Dublin City University <http://www.dcu.ie/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150401/16f1d485/attachment.htm
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 102, Issue 1
*********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 102, Issue 1"
Post a Comment