Moses-support Digest, Vol 113, Issue 25

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Print list of translation options (Lane Schwartz)
2. Re: Print list of translation options (Lane Schwartz)


----------------------------------------------------------------------

Message: 1
Date: Wed, 9 Mar 2016 13:09:16 -0600
From: Lane Schwartz <dowobeha@gmail.com>
Subject: Re: [Moses-support] Print list of translation options
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CABv3vZnh2vv_1gR=teFnL=wC-VSpt7e7m7J7vA0snoaJ5e4dwg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Right. So I added that, and now I get a crash. Here's the backtrace:

Program received signal SIGABRT, Aborted.
> 0x00007ffff5f985e9 in raise () from /lib64/libc.so.6
> Missing separate debuginfos, use: debuginfo-install
> bzip2-libs-1.0.6-12.el7.x86_64 glibc-2.17-78.el7.x86_64
> libgcc-4.8.3-9.el7.x86_64 libstdc++-4.8.3-9.el7.x86_64
> libxml2-2.9.1-5.el7_1.2.x86_64 xmlrpc-c-1.32.5-1905.svn2451.el7.x86_64
> xmlrpc-c-c++-1.32.5-1905.svn2451.el7.x86_64
> xz-libs-5.1.2-12alpha.el7.x86_64 zlib-1.2.7-13.el7.x86_64
> (gdb) bt
> #0 0x00007ffff5f985e9 in raise () from /lib64/libc.so.6
> #1 0x00007ffff5f99cf8 in abort () from /lib64/libc.so.6
> #2 0x00007ffff5fd8dd7 in __libc_message () from /lib64/libc.so.6
> #3 0x00007ffff5fe01bd in _int_free () from /lib64/libc.so.6
> #4 0x000000000041e763 in std::__valarray_release_memory (__p=0x1039600)
> at /usr/include/c++/4.8.2/bits/valarray_array.h:66
> #5 0x0000000000420c7b in std::valarray<float>::~valarray (this=0x1039558,
> __in_chrg=<optimized out>) at /usr/include/c++/4.8.2/valarray:703
> #6 0x000000000041ff1b in Moses::FVector::~FVector (this=0x1039528,
> __in_chrg=<optimized out>) at moses/FeatureVector.h:127
> #7 0x0000000000436078 in
> Moses::ScoreComponentCollection::~ScoreComponentCollection (this=0x1039528,
> __in_chrg=<optimized out>) at ./moses/ScoreComponentCollection.h:87
> #8 0x000000000055f865 in Moses::TargetPhrase::~TargetPhrase
> (this=0x10394c0, __in_chrg=<optimized out>) at moses/TargetPhrase.cpp:151
> #9 0x00000000004c0db7 in std::_Destroy<Moses::TargetPhrase>
> (__pointer=0x10394c0) at /usr/include/c++/4.8.2/bits/stl_construct.h:93
> #10 0x00000000004bfdde in
> std::_Destroy_aux<false>::__destroy<Moses::TargetPhrase*>
> (__first=0x10394c0, __last=0x10395f0) at
> /usr/include/c++/4.8.2/bits/stl_construct.h:103
> #11 0x00000000004bebbb in std::_Destroy<Moses::TargetPhrase*>
> (__first=0x10394c0, __last=0x10395f0) at
> /usr/include/c++/4.8.2/bits/stl_construct.h:126
> #12 0x00000000004bdc4b in std::_Destroy<Moses::TargetPhrase*,
> Moses::TargetPhrase> (__first=0x10394c0, __last=0x10395f0) at
> /usr/include/c++/4.8.2/bits/stl_construct.h:151
> #13 0x000000000052028a in std::vector<Moses::TargetPhrase,
> std::allocator<Moses::TargetPhrase> >::_M_insert_aux (this=0x1039080,
> __position=warning: can't find linker symbol for virtual table for
> `Moses::TargetPhrase' value
> ..., __x=...) at /usr/include/c++/4.8.2/bits/vector.tcc:384
> #14 0x000000000051d873 in std::vector<Moses::TargetPhrase,
> std::allocator<Moses::TargetPhrase> >::push_back (this=0x1039080, __x=...)
> at /usr/include/c++/4.8.2/bits/stl_vector.h:913
> #15 0x000000000083341e in Moses::PhraseDecoder::DecodeCollection
> (this=0xfd5130, tpv=..., encodedBitStream=..., sourcePhrase=...,
> topLevel=true, eval=false)
> at moses/TranslationModel/CompactPT/PhraseDecoder.cpp:279
> #16 0x0000000000833087 in
> Moses::PhraseDecoder::CreateTargetPhraseCollection (this=0xfd5130,
> sourcePhrase=..., topLevel=true, eval=false) at
> moses/TranslationModel/CompactPT/PhraseDecoder.cpp:237
> #17 0x00000000004bbb1f in
> Moses::PhraseDictionaryCompact::GetTargetPhraseCollectionRaw
> (this=0x7fffffffda50, sourcePhrase=...) at
> moses/TranslationModel/CompactPT/PhraseDictionaryCompact.cpp:148
> #18 0x000000000040ef67 in main (argc=6, argv=0x7fffffffe298) at
> misc/queryPhraseTableMin.cpp:64


On Wed, Mar 9, 2016 at 1:02 PM, Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
wrote:

> Your phrase table has 11 scores, you need to add "-n 11"
>
> W dniu 09.03.2016 o 19:01, Lane Schwartz pisze:
>
> $ ./bin/queryPhraseTableMin -t
>> newstest2013.filtered.3/phrase-table.0-0.1.1.minphr <<< "une"
>> terminate called after throwing an instance of 'util::Exception'
>> what(): moses/ScoreComponentCollection.cpp:252 in void
>> Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*,
>> const std::vector<float>&) threw util::Exception.
>> Feature function PhraseDictionaryCompact0 specified 4 dense scores or
>> weights. Actually has 11
>> Aborted (core dumped)
>
>
> Am I calling this correctly? Something's not right.
>
> On Wed, Mar 9, 2016 at 12:56 PM, Marcin Junczys-Dowmunt <
> junczys@amu.edu.pl> wrote:
>
>> There is queryPhraseTableMin that reads phrases from stdin and returns
>> all entries in the compact phrase table. Just do a script that generates
>> all substrings from a sentence and pass it to that program.
>>
>> W dniu 09.03.2016 o 18:53, Lane Schwartz pisze:
>>
>> Ah, excellent! Can this info be gotten via one of the standalone query
>> programs? I've never used those, but I'm guessing that's what they're for?
>>
>> I have a phrase-table.0-0.1.1.gz that looks like this:
>>
>> a , au contraire , ||| , however , ||| 6.70231e-06 1.67288e-09 0.0150266
>>> 0.00200436 2.718 1 1 1 1 1 1 ||| 1-0 2-1 3-1 4-2 ||| 17936 8 1 ||| |||
>>> a , au contraire , ||| , instead , ||| 0.000785703 5.71013e-05 0.0150266
>>> 0.022757 2.718 1 1 1 1 1 1 ||| 1-0 2-1 3-1 4-2 ||| 153 8 1 ||| |||
>>
>> And I have a phrase-table.0-0.1.1.minphr.
>>
>> What would be the recommended mechanism for getting phrases for a
>> particular sentence using a query program?
>>
>> Thanks,
>>
>> Lane
>>
>>
>>
>> On Wed, Mar 9, 2016 at 12:42 PM, Marcin Junczys-Dowmunt <
>> junczys@amu.edu.pl> wrote:
>>
>>> With verbose 3 it's actually there, just before it starts outputting the
>>> search graph, take another look. There is a list sorted by source sentence
>>> spans.
>>>
>>> W dniu 09.03.2016 o 18:39, Lane Schwartz pisze:
>>>
>>> I don't suppose anyone knows of a relatively easy way to print the list
>>> of translation options for each sentence?
>>>
>>> verbose=2 tells how many translation options there are, but not what
>>> they are
>>> verbose=3 prints the search graph as it's being constructed, but still
>>> not what I'm looking for
>>>
>>> Thanks,
>>> Lane
>>>
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>>
>>>
>>
>>
>> --
>> When a place gets crowded enough to require ID's, social collapse is not
>> far away. It is time to go elsewhere. The best thing about space travel
>> is that it made it possible to go elsewhere.
>> -- R.A. Heinlein, "Time Enough For Love"
>>
>>
>>
>
>
> --
> When a place gets crowded enough to require ID's, social collapse is not
> far away. It is time to go elsewhere. The best thing about space travel
> is that it made it possible to go elsewhere.
> -- R.A. Heinlein, "Time Enough For Love"
>
>
>


--
When a place gets crowded enough to require ID's, social collapse is not
far away. It is time to go elsewhere. The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, "Time Enough For Love"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160309/db9d090d/attachment-0001.html

------------------------------

Message: 2
Date: Wed, 9 Mar 2016 13:11:13 -0600
From: Lane Schwartz <dowobeha@gmail.com>
Subject: Re: [Moses-support] Print list of translation options
To: Ulrich Germann <ugermann@inf.ed.ac.uk>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CABv3vZmDu3FY2e5_7auu_es7SpF_GS-6_Jf_Kbm5LULngVuWJg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Thanks, Uli! That's what I wanted.

On Wed, Mar 9, 2016 at 12:54 PM, Ulrich Germann <ulrich.germann@gmail.com>
wrote:

> cat <corpus> | ${MOSES_ROOT}/bin/ptable-lookup-corpus -f moses.ini
>
> will print a custom phrase table for the corpus
>
> compile with --with-mm-extras --with-mm to include ptable-lookup-corpus in
> the build
>
> - Uli
>
> On Wed, Mar 9, 2016 at 6:39 PM, Lane Schwartz <dowobeha@gmail.com> wrote:
>
>> I don't suppose anyone knows of a relatively easy way to print the list
>> of translation options for each sentence?
>>
>> verbose=2 tells how many translation options there are, but not what they
>> are
>> verbose=3 prints the search graph as it's being constructed, but still
>> not what I'm looking for
>>
>> Thanks,
>> Lane
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
>
> --
> Ulrich Germann
> Senior Researcher
> School of Informatics
> University of Edinburgh
>



--
When a place gets crowded enough to require ID's, social collapse is not
far away. It is time to go elsewhere. The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, "Time Enough For Love"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160309/a50c3b2e/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 25
**********************************************

Tweet