Moses-support Digest, Vol 113, Issue 29

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Print list of translation options (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 10 Mar 2016 01:23:08 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Print list of translation options
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbi1BtW+Zs6bU508xTw52LRPM_ASHuTVf+4uqKJJOzmLtg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Which memory pool are you talking about?

Hieu Hoang
http://www.hoang.co.uk/hieu
On 9 Mar 2016 7:13 pm, "Marcin Junczys-Dowmunt" <junczys@amu.edu.pl> wrote:

> Hm, that's new.
> I guess this is connected with moses switching recently to memory pools
> and no one bothered to check whether the query tool still works after that.
>
> You could check out branch "wipoNew" which still has a Moses 2.1 version,
> the tool should work there.
>
> W dniu 09.03.2016 o 19:09, Lane Schwartz pisze:
>
> Right. So I added that, and now I get a crash. Here's the backtrace:
>
> Program received signal SIGABRT, Aborted.
>> 0x00007ffff5f985e9 in raise () from /lib64/libc.so.6
>> Missing separate debuginfos, use: debuginfo-install
>> bzip2-libs-1.0.6-12.el7.x86_64 glibc-2.17-78.el7.x86_64
>> libgcc-4.8.3-9.el7.x86_64 libstdc++-4.8.3-9.el7.x86_64
>> libxml2-2.9.1-5.el7_1.2.x86_64 xmlrpc-c-1.32.5-1905.svn2451.el7.x86_64
>> xmlrpc-c-c++-1.32.5-1905.svn2451.el7.x86_64
>> xz-libs-5.1.2-12alpha.el7.x86_64 zlib-1.2.7-13.el7.x86_64
>> (gdb) bt
>> #0 0x00007ffff5f985e9 in raise () from /lib64/libc.so.6
>> #1 0x00007ffff5f99cf8 in abort () from /lib64/libc.so.6
>> #2 0x00007ffff5fd8dd7 in __libc_message () from /lib64/libc.so.6
>> #3 0x00007ffff5fe01bd in _int_free () from /lib64/libc.so.6
>> #4 0x000000000041e763 in std::__valarray_release_memory (__p=0x1039600)
>> at /usr/include/c++/4.8.2/bits/valarray_array.h:66
>> #5 0x0000000000420c7b in std::valarray<float>::~valarray
>> (this=0x1039558, __in_chrg=<optimized out>) at
>> /usr/include/c++/4.8.2/valarray:703
>> #6 0x000000000041ff1b in Moses::FVector::~FVector (this=0x1039528,
>> __in_chrg=<optimized out>) at moses/FeatureVector.h:127
>> #7 0x0000000000436078 in
>> Moses::ScoreComponentCollection::~ScoreComponentCollection (this=0x1039528,
>> __in_chrg=<optimized out>) at ./moses/ScoreComponentCollection.h:87
>> #8 0x000000000055f865 in Moses::TargetPhrase::~TargetPhrase
>> (this=0x10394c0, __in_chrg=<optimized out>) at moses/TargetPhrase.cpp:151
>> #9 0x00000000004c0db7 in std::_Destroy<Moses::TargetPhrase>
>> (__pointer=0x10394c0) at /usr/include/c++/4.8.2/bits/stl_construct.h:93
>> #10 0x00000000004bfdde in
>> std::_Destroy_aux<false>::__destroy<Moses::TargetPhrase*>
>> (__first=0x10394c0, __last=0x10395f0) at
>> /usr/include/c++/4.8.2/bits/stl_construct.h:103
>> #11 0x00000000004bebbb in std::_Destroy<Moses::TargetPhrase*>
>> (__first=0x10394c0, __last=0x10395f0) at
>> /usr/include/c++/4.8.2/bits/stl_construct.h:126
>> #12 0x00000000004bdc4b in std::_Destroy<Moses::TargetPhrase*,
>> Moses::TargetPhrase> (__first=0x10394c0, __last=0x10395f0) at
>> /usr/include/c++/4.8.2/bits/stl_construct.h:151
>> #13 0x000000000052028a in std::vector<Moses::TargetPhrase,
>> std::allocator<Moses::TargetPhrase> >::_M_insert_aux (this=0x1039080,
>> __position=warning: can't find linker symbol for virtual table for
>> `Moses::TargetPhrase' value
>> ..., __x=...) at /usr/include/c++/4.8.2/bits/vector.tcc:384
>> #14 0x000000000051d873 in std::vector<Moses::TargetPhrase,
>> std::allocator<Moses::TargetPhrase> >::push_back (this=0x1039080, __x=...)
>> at /usr/include/c++/4.8.2/bits/stl_vector.h:913
>> #15 0x000000000083341e in Moses::PhraseDecoder::DecodeCollection
>> (this=0xfd5130, tpv=..., encodedBitStream=..., sourcePhrase=...,
>> topLevel=true, eval=false)
>> at moses/TranslationModel/CompactPT/PhraseDecoder.cpp:279
>> #16 0x0000000000833087 in
>> Moses::PhraseDecoder::CreateTargetPhraseCollection (this=0xfd5130,
>> sourcePhrase=..., topLevel=true, eval=false) at
>> moses/TranslationModel/CompactPT/PhraseDecoder.cpp:237
>> #17 0x00000000004bbb1f in
>> Moses::PhraseDictionaryCompact::GetTargetPhraseCollectionRaw
>> (this=0x7fffffffda50, sourcePhrase=...) at
>> moses/TranslationModel/CompactPT/PhraseDictionaryCompact.cpp:148
>> #18 0x000000000040ef67 in main (argc=6, argv=0x7fffffffe298) at
>> misc/queryPhraseTableMin.cpp:64
>
>
> On Wed, Mar 9, 2016 at 1:02 PM, Marcin Junczys-Dowmunt <junczys@amu.edu.pl
> > wrote:
>
>> Your phrase table has 11 scores, you need to add "-n 11"
>>
>> W dniu 09.03.2016 o 19:01, Lane Schwartz pisze:
>>
>> $ ./bin/queryPhraseTableMin -t
>>> newstest2013.filtered.3/phrase-table.0-0.1.1.minphr <<< "une"
>>> terminate called after throwing an instance of 'util::Exception'
>>> what(): moses/ScoreComponentCollection.cpp:252 in void
>>> Moses::ScoreComponentCollection::Assign(const Moses::FeatureFunction*,
>>> const std::vector<float>&) threw util::Exception.
>>> Feature function PhraseDictionaryCompact0 specified 4 dense scores or
>>> weights. Actually has 11
>>> Aborted (core dumped)
>>
>>
>> Am I calling this correctly? Something's not right.
>>
>> On Wed, Mar 9, 2016 at 12:56 PM, Marcin Junczys-Dowmunt <
>> junczys@amu.edu.pl> wrote:
>>
>>> There is queryPhraseTableMin that reads phrases from stdin and returns
>>> all entries in the compact phrase table. Just do a script that generates
>>> all substrings from a sentence and pass it to that program.
>>>
>>> W dniu 09.03.2016 o 18:53, Lane Schwartz pisze:
>>>
>>> Ah, excellent! Can this info be gotten via one of the standalone query
>>> programs? I've never used those, but I'm guessing that's what they're for?
>>>
>>> I have a phrase-table.0-0.1.1.gz that looks like this:
>>>
>>> a , au contraire , ||| , however , ||| 6.70231e-06 1.67288e-09 0.0150266
>>>> 0.00200436 2.718 1 1 1 1 1 1 ||| 1-0 2-1 3-1 4-2 ||| 17936 8 1 ||| |||
>>>> a , au contraire , ||| , instead , ||| 0.000785703 5.71013e-05
>>>> 0.0150266 0.022757 2.718 1 1 1 1 1 1 ||| 1-0 2-1 3-1 4-2 ||| 153 8 1 ||| |||
>>>
>>> And I have a phrase-table.0-0.1.1.minphr.
>>>
>>> What would be the recommended mechanism for getting phrases for a
>>> particular sentence using a query program?
>>>
>>> Thanks,
>>>
>>> Lane
>>>
>>>
>>>
>>> On Wed, Mar 9, 2016 at 12:42 PM, Marcin Junczys-Dowmunt <
>>> junczys@amu.edu.pl> wrote:
>>>
>>>> With verbose 3 it's actually there, just before it starts outputting
>>>> the search graph, take another look. There is a list sorted by source
>>>> sentence spans.
>>>>
>>>> W dniu 09.03.2016 o 18:39, Lane Schwartz pisze:
>>>>
>>>> I don't suppose anyone knows of a relatively easy way to print the list
>>>> of translation options for each sentence?
>>>>
>>>> verbose=2 tells how many translation options there are, but not what
>>>> they are
>>>> verbose=3 prints the search graph as it's being constructed, but still
>>>> not what I'm looking for
>>>>
>>>> Thanks,
>>>> Lane
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> When a place gets crowded enough to require ID's, social collapse is not
>>> far away. It is time to go elsewhere. The best thing about space travel
>>> is that it made it possible to go elsewhere.
>>> -- R.A. Heinlein, "Time Enough For Love"
>>>
>>>
>>>
>>
>>
>> --
>> When a place gets crowded enough to require ID's, social collapse is not
>> far away. It is time to go elsewhere. The best thing about space travel
>> is that it made it possible to go elsewhere.
>> -- R.A. Heinlein, "Time Enough For Love"
>>
>>
>>
>
>
> --
> When a place gets crowded enough to require ID's, social collapse is not
> far away. It is time to go elsewhere. The best thing about space travel
> is that it made it possible to go elsewhere.
> -- R.A. Heinlein, "Time Enough For Love"
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20160309/824d5c6c/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 113, Issue 29
**********************************************

0 Response to "Moses-support Digest, Vol 113, Issue 29"

Post a Comment