Moses-support Digest, Vol 89, Issue 20

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Reg : Segmentation Fault while loading
(Marcin Junczys-Dowmunt)
2. Re: Reg : Segmentation Fault while loading (Rajen Chatterjee)


----------------------------------------------------------------------

Message: 1
Date: Mon, 10 Mar 2014 16:05:24 +0000
From: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Subject: Re: [Moses-support] Reg : Segmentation Fault while loading
To: moses-support@mit.edu
Message-ID: <531DE2C4.9030209@amu.edu.pl>
Content-Type: text/plain; charset="iso-8859-1"

Hi Kunal,
I am not sure this is causing the segfault, but take a look at the
alignment. You are removing tokens from the source phrase, before 5, now
3, but you leave the alignment untouched which still maps 5 to 5 tokens.
You would either need to shift and remove the alignment points or get
rid of the alignment altogether.
Best,
Marcin

W dniu 10.03.2014 16:01, Kunal Sachdeva pisze:
> Hello all,
> i tried to clean my phrase table my removing some characters from
> phrases, like
>
> ' ' ' ' comments Remain Rolland ||| - - ??????? ????? ?? |||
> 0.112086 2.80203e-05 0.0373621 8.65407e-07 2.718 0.030868 ||| 0-1 0-2
> 1-2 2-2 4-2 3-3 4-3 4-4 ||| 1 3 1
>
> changed to ====>
>
> comments Remain Rolland ||| - - ??????? ????? ?? ||| 0.112086
> 2.80203e-05 0.0373621 8.65407e-07 2.718 0.030868 ||| 0-1 0-2 1-2 2-2
> 4-2 3-3 4-3 4-4 ||| 1 3 1
>
> so when now i am try to decode a sentence, i get an eroor
>
> Reading /home/seecat/WMT/eng-hin/WMT_new/model/temp1.gz
> ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
> *******Segmentation fault (core dumped)
>
> this error doesn't come always, when i try to use it with -v(verbose)
> option.
>
> It will be great, if someone could help me.
>
> Regards,
> Kunal Sachdeva
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140310/bfe86aca/attachment-0001.htm

------------------------------

Message: 2
Date: Mon, 10 Mar 2014 16:18:39 +0000
From: Rajen Chatterjee <rajen.k.chatterjee@gmail.com>
Subject: Re: [Moses-support] Reg : Segmentation Fault while loading
To: Marcin Junczys-Dowmunt <junczys@amu.edu.pl>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAC4-+NzwJWf38p8o7NEm4gvLYDKkwSkFaOpaJgksbx4xbQ_xBQ@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Kunal,
I would suggest you not to edit phrase table, rather clean your
training corpus and retrain the system. If you edit phrases then it may
lead to inconsistent probability score and alignment in the phrase table.


On Mon, Mar 10, 2014 at 4:05 PM, Marcin Junczys-Dowmunt
<junczys@amu.edu.pl>wrote:

> Hi Kunal,
> I am not sure this is causing the segfault, but take a look at the
> alignment. You are removing tokens from the source phrase, before 5, now 3,
> but you leave the alignment untouched which still maps 5 to 5 tokens. You
> would either need to shift and remove the alignment points or get rid of
> the alignment altogether.
> Best,
> Marcin
>
> W dniu 10.03.2014 16:01, Kunal Sachdeva pisze:
>
> Hello all,
> i tried to clean my phrase table my removing some characters from
> phrases, like
>
> ' ' ' ' comments Remain Rolland ||| - - ??????? ????? ?? ||| 0.112086
> 2.80203e-05 0.0373621 8.65407e-07 2.718 0.030868 ||| 0-1 0-2 1-2 2-2 4-2
> 3-3 4-3 4-4 ||| 1 3 1
>
> changed to ====>
>
> comments Remain Rolland ||| - - ??????? ????? ?? ||| 0.112086 2.80203e-05
> 0.0373621 8.65407e-07 2.718 0.030868 ||| 0-1 0-2 1-2 2-2 4-2 3-3 4-3 4-4
> ||| 1 3 1
>
> so when now i am try to decode a sentence, i get an eroor
>
> Reading /home/seecat/WMT/eng-hin/WMT_new/model/temp1.gz
>
> ----5---10---15---20---25---30---35---40---45---50---55---60---65---70---75---80---85---90---95--100
> *******Segmentation fault (core dumped)
>
> this error doesn't come always, when i try to use it with -v(verbose)
> option.
>
> It will be great, if someone could help me.
>
> Regards,
> Kunal Sachdeva
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>


--
-Regards,
Rajen Chatterjee.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140310/a35f7810/attachment-0001.htm

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 89, Issue 20
*********************************************

Tweet