Moses-support Digest, Vol 119, Issue 31

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. accessing the compact format of the phrase-table
(Dimitar Shterionov)
2. Re: accessing the compact format of the phrase-table
(Marcin Junczys-Dowmunt)
3. Re: accessing the compact format of the phrase-table
(Dimitar Shterionov)
4. Re: accessing the compact format of the phrase-table
(Marcin Junczys-Dowmunt)


----------------------------------------------------------------------

Message: 1
Date: Fri, 23 Sep 2016 10:16:13 +0100
From: Dimitar Shterionov <dimitars@kantanmt.com>
Subject: [Moses-support] accessing the compact format of the
phrase-table
To: moses-support@mit.edu
Message-ID:
<CALi0KgEcibyKxVwQcNnZ9Oq+eEEk4S7-2kT+pSApmhtYcMN+AA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear all,

I want to extract some specific data from the table after the model has
been built. Before it is compacted I have it in raw format and it is easy.
But I don't know how to process and read the compacted format of the
phrase-table. Is there a way to read the phrase-table.minphr format as
text? Any suggestions?

Thank you very much.
Kind regards,
Dimitar.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160923/75216392/attachment-0001.html

------------------------------

Message: 2
Date: Fri, 23 Sep 2016 10:19:41 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] accessing the compact format of the
phrase-table
To: moses-support@mit.edu
Message-ID: <210ff868-fd5a-1c18-3ccc-886dd3c13050@amu.edu.pl>
Content-Type: text/plain; charset="windows-1252"

Hi,
If you want a complete dump of the phrase table as text, this is not
possible. The compact phrase table is not reversible. You can use
queryPhraseTableMin to ask for the translations of specific phrases.
Best,
Marcin

W dniu 23/09/16 o 10:16, Dimitar Shterionov pisze:
> Dear all,
>
> I want to extract some specific data from the table after the model
> has been built. Before it is compacted I have it in raw format and it
> is easy. But I don't know how to process and read the compacted format
> of the phrase-table. Is there a way to read the phrase-table.minphr
> format as text? Any suggestions?
>
> Thank you very much.
> Kind regards,
> Dimitar.
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160923/bf25c8f6/attachment-0001.html

------------------------------

Message: 3
Date: Fri, 23 Sep 2016 10:24:51 +0100
From: Dimitar Shterionov <dimitars@kantanmt.com>
Subject: Re: [Moses-support] accessing the compact format of the
phrase-table
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: moses-support@mit.edu
Message-ID:
<CALi0KgEKjM2oSYAN=RHFpRpgsYfnUykFyeHD2NKUX-7EmjO4aA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Marcin and thanks for the quick reply.

With the queryPhraseTableMin do I always need to provide exact string to
match an entry or can I actually provide partial string? or regex?
Basically I want to extract all 1-grams. Any suggestions?

Thanks once again.
Dimitar.

Dimitar Shterionov | dimitars@kantanmt.com | Machine Translation Researcher

www.KantanMT.com <http://www.kantanmt.com/> | Easy Translation - No
Software. No Hardware. No Hassle MT.

<https://www.facebook.com/KantanMT>
<https://plus.google.com/+Kantanmt_cloudmachinetranslation>
<https://twitter.com/KantanMT> <https://www.linkedin.com/company/kantanmt>
<http://www.slideshare.net/kantanmt> <https://www.youtube.com/user/KantanMT>
<http://kantanmtblog.com/> <https://kantanmt.com/rssfeeds.php>
<info@kantanmt.com>


On 23 September 2016 at 10:19, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
wrote:

> Hi,
> If you want a complete dump of the phrase table as text, this is not
> possible. The compact phrase table is not reversible. You can use
> queryPhraseTableMin to ask for the translations of specific phrases.
> Best,
> Marcin
>
> W dniu 23/09/16 o 10:16, Dimitar Shterionov pisze:
>
> Dear all,
>
> I want to extract some specific data from the table after the model has
> been built. Before it is compacted I have it in raw format and it is easy.
> But I don't know how to process and read the compacted format of the
> phrase-table. Is there a way to read the phrase-table.minphr format as
> text? Any suggestions?
>
> Thank you very much.
> Kind regards,
> Dimitar.
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160923/cfe42b28/attachment-0001.html

------------------------------

Message: 4
Date: Fri, 23 Sep 2016 10:26:45 +0100
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] accessing the compact format of the
phrase-table
To: Dimitar Shterionov <dimitars@kantanmt.com>
Cc: moses-support@mit.edu
Message-ID: <49f55426-b98f-04f8-f688-41aec92a49aa@amu.edu.pl>
Content-Type: text/plain; charset="utf-8"

Hi Dimitar,
full string unfortunately. This is a hash table, so no partial methods
possible. The source string itself isn't stored anywhere.
Best,
Marcin

W dniu 23/09/16 o 10:24, Dimitar Shterionov pisze:
> Hi Marcin and thanks for the quick reply.
>
> With the queryPhraseTableMin do I always need to provide exact string
> to match an entry or can I actually provide partial string? or regex?
> Basically I want to extract all 1-grams. Any suggestions?
>
> Thanks once again.
> Dimitar.
>
> Dimitar Shterionov | dimitars@kantanmt.com
> <mailto:dimitars@kantanmt.com> | Machine Translation Researcher
>
> www.KantanMT.com <http://www.kantanmt.com/> | Easy Translation - No
> Software. No Hardware. No Hassle MT.
>
> <https://www.facebook.com/KantanMT> [Follow on Google+]
> <https://plus.google.com/+Kantanmt_cloudmachinetranslation> [Tweet
> with your friends] <https://twitter.com/KantanMT> [Share on LinkedIn]
> <https://www.linkedin.com/company/kantanmt> [Slide share]
> <http://www.slideshare.net/kantanmt> [Follow on Youtube]
> <https://www.youtube.com/user/KantanMT> [Read our Blog]
> <http://kantanmtblog.com/> [RSS Feed]
> <https://kantanmt.com/rssfeeds.php> [Email us] <mailto:info@kantanmt.com>
>
>
> On 23 September 2016 at 10:19, Marcin Junczys-Dowmunt
> <junczys@amu.edu.pl <mailto:junczys@amu.edu.pl>> wrote:
>
> Hi,
> If you want a complete dump of the phrase table as text, this is
> not possible. The compact phrase table is not reversible. You can
> use queryPhraseTableMin to ask for the translations of specific
> phrases.
> Best,
> Marcin
>
> W dniu 23/09/16 o 10:16, Dimitar Shterionov pisze:
>> Dear all,
>>
>> I want to extract some specific data from the table after the
>> model has been built. Before it is compacted I have it in raw
>> format and it is easy. But I don't know how to process and read
>> the compacted format of the phrase-table. Is there a way to read
>> the phrase-table.minphr format as text? Any suggestions?
>>
>> Thank you very much.
>> Kind regards,
>> Dimitar.
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu <mailto:Moses-support@mit.edu>
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>> <http://mailman.mit.edu/mailman/listinfo/moses-support>
>
> _______________________________________________ Moses-support
> mailing list Moses-support@mit.edu <mailto:Moses-support@mit.edu>
> http://mailman.mit.edu/mailman/listinfo/moses-support
> <http://mailman.mit.edu/mailman/listinfo/moses-support>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160923/6e1cb028/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 119, Issue 31
**********************************************

Tweet