Moses-support Digest, Vol 146, Issue 7

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Segmentation fault and tcmalloc errors (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Thu, 6 Dec 2018 22:41:12 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Segmentation fault and tcmalloc errors
To: Jin Nan Lu <owenljn@gmail.com>, <moses-support@mit.edu>
Message-ID:
<CAEKMkbiqv5iO2vbRyEBHQTGqePHfSM31Wtrdr5Qt=sqtEdVDBw@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Don't use TCmallov with moses2.

On Thu, 6 Dec 2018, 22:32 Jin Nan Lu <owenljn@gmail.com wrote:

> Dear Hieu,
>
> It's been some time after the last time I contacted you, now I've some new
> problems with the trained models.
>
> So I have trained two models regarding English to French and English to
> Chinese, they are binarized for moses2, but I have this weird tcmalloc
> errors when moses2 is trying to load the translation model, this English to
> French model is very large, but English to Chinese model is very small, so
> I doubt it's due to not enough memory, besides, my server has a memory size
> of 252GB, the screenshot is attached herewith:
> [image: tcmalloc_error.JPG]
>
> I also trained another model for English to Arabic, the translation model
> loads without problem, I give it a text of 3000 English sentences to
> translate, and there's a segmentation fault happens during the translation
> process, I've tre-tried many times, and this problem always happen after
> line 431 is translated
> [image: segFault.JPG]
>
> So I thought something is wrong with line 432, what I did is starting a
> moses2 server loading English to Arabic model, and send line 432 to this
> server, then it gets translated without a problem. Then I send 3000
> sentences one by one to this server, and they all get translated without
> any problem. If I let moses2 batch translate them once for all, then it
> always has Seg Fault at line 432.
> [image: correctly_translated.JPG]
> I've uploaded all three trained models to Google drive, they're still in
> uploading process right now, I will share them with you once it's done.
>
> I'm really appreciated if you can help me with this. Thank you!
> Best Regards,
> Owen
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20181206/b0699d6e/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: segFault.JPG
Type: image/jpeg
Size: 123509 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20181206/b0699d6e/attachment.jpe
-------------- next part --------------
A non-text attachment was scrubbed...
Name: correctly_translated.JPG
Type: image/jpeg
Size: 94086 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20181206/b0699d6e/attachment-0001.jpe
-------------- next part --------------
A non-text attachment was scrubbed...
Name: tcmalloc_error.JPG
Type: image/jpeg
Size: 158602 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20181206/b0699d6e/attachment-0002.jpe

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 146, Issue 7
*********************************************

Tweet