Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Re: Regarding Decoding Time (Shubham Khandelwal)
2. Re: SegFault using XML Markup (Ryan ADLER)
----------------------------------------------------------------------
Message: 1
Date: Thu, 15 Dec 2016 19:12:01 +0530
From: Shubham Khandelwal <skhlnmiit@gmail.com>
Subject: Re: [Moses-support] Regarding Decoding Time
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAHweNTvYeALYrAfJDgDiH51t5_AHSPRV0KwLCABC2td27yoHmA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hello,
Currently, I am using phrase-table.minphr , reordering-table.minlexr and
language model (total size of these 3 are 6 GB). Now, I tried to decode on
two different machines (8 core-16GB RAM *&* 4 core-40GB RAM) using them.
So, During decoding of around 500 words, it took 90 seconds and 100 seconds
respectively on those machines. I am already using compact phrase and
reordering table representations for faster decoding. Is there any other
way to reduce this decoding time.
Also, In Moses, Do we have distributed way of decoding on multiple machines
?
Looking forward for your response.
On Tue, Dec 6, 2016 at 4:25 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:
> have a look at this page
> http://www.statmt.org/moses/?n=Moses.Optimize
>
> Hieu Hoang
> http://www.hoang.co.uk/hieu
>
> On 5 December 2016 at 14:15, Shubham Khandelwal <skhlnmiit@gmail.com>
> wrote:
>
>> Hello,
>>
>> I have created one translation model (German to English) and converted it
>> to Compact format.
>> Now when I run the command:
>> ~/mosesdecoder/bin/moses2 -f moses.ini
>> Then, It loads the model very quickly but when I pass the German Text
>> (around 4-5 lines) for the translation then it translates the text in 10
>> minutes.
>> Can you please tell me that how can I reduce this time for the
>> translation ?
>>
>> Thanking You.
>>
>> Regards,
>> Shubham
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>
--
Yours Sincerely,
Shubham Khandelwal
Masters in Informatics (M2-MoSIG),
University Joseph Fourier-Grenoble INP,
Grenoble, France
Webpage: https://sites.google.com/site/skhandelwl21/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161215/e658f6bd/attachment-0001.html
------------------------------
Message: 2
Date: Thu, 15 Dec 2016 15:10:02 +0100
From: Ryan ADLER <ryan.adler@unodc.org>
Subject: Re: [Moses-support] SegFault using XML Markup
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<OF5D469E36.3A523320-ONC125808A.004D934F-C125808A.004DB731@unvienna.org>
Content-Type: text/plain; charset="iso-8859-1"
Dear Hieu,
As you mention, it looks like the RELEASE-3.0 branch doesn't support
multiple factors. I see a commit on the master code which adds this
support (pretty recently, actually):
https://github.com/moses-smt/mosesdecoder/commit/25f0165db76c68f02110f91b6a297f950a3f80e7
I will try applying this patch to my code and test it out. Thank you!
Kind regards,
Ryan Adler
From: Hieu Hoang <hieuhoang@gmail.com>
To: Ryan ADLER/VIENNA/UNO@UNOV
Cc: moses-support <moses-support@mit.edu>
Date: 15/12/2016 11:40
Subject: Re: [Moses-support] SegFault using XML Markup
that's the only thing I can think of. It may be that XML doesn't support
multiple factors.
If you have model files for me to download and replicate the problem, I can
let you know for sure
Hieu Hoang
http://www.hoang.co.uk/hieu
On 15 December 2016 at 10:19, Ryan ADLER <ryan.adler@unodc.org> wrote:
Dear Hieu,
Unfortunately, this results in the same error.? Am I possibly still
missing something somewhere else?
Kind regards,
Ryan Adler
Inactive hide details for Hieu Hoang ---15/12/2016 10:36:02---your output
has 2 factors so the phrases in the xml should have 2Hieu Hoang
---15/12/2016 10:36:02---your output has 2 factors so the phrases in the
xml should have 2 factors eg ? ?'<n translation="abc
From: Hieu Hoang <hieuhoang@gmail.com>
To: Ryan ADLER/VIENNA/UNO@UNOV
Cc: moses-support <moses-support@mit.edu>
Date: 15/12/2016 10:36
Subject: Re: [Moses-support] SegFault using XML Markup
your output has 2 factors so the phrases in the xml should have 2 factors
eg
?? '<n translation="abc|NNS">def</n>'
Hieu Hoang
http://www.hoang.co.uk/hieu
On 15 December 2016 at 07:28, Ryan ADLER <ryan.adler@unodc.org> wrote:
Dear Hieu,
Thank you for your reply.? Attached, please find the requested
information.? I will try to build a mini-model where I can
reproduce this as well.
(See attached file: moses.mert.ini)
Command line:
echo '<n translation="abc">def</n>'
| /data/smt/mosesdecoder3.0/bin/moses -f moses.mert.ini -xml-input
exclusive
I would appreciate any insight you can offer.
Kind regards,
Ryan Adler
Inactive hide details for Hieu Hoang ---14/12/2016 17:23:01---can
you attach the moses.ini file you use and the exact command yHieu
Hoang ---14/12/2016 17:23:01---can you attach the moses.ini file
you use and the exact command you ran Hieu Hoang
From: Hieu Hoang <hieuhoang@gmail.com>
To: Ryan ADLER/VIENNA/UNO@UNOV
Cc: moses-support <moses-support@mit.edu>
Date: 14/12/2016 17:23
Subject: Re: [Moses-support] SegFault using XML Markup
can you attach the moses.ini file you use and the exact command you
ran
Hieu Hoang
http://www.hoang.co.uk/hieu
On 14 December 2016 at 14:19, Ryan ADLER <ryan.adler@unodc.org>
wrote:
Hi,
When submitting text with XML markup like:
Some <np translation="abc">def</np> stuff.
I am getting a segfault at:
Moses::LanguageModelKen<lm::ngram::QuantArrayTrieModel>::CalcScore
(this=0xa570b0, phrase=..., fullScore=@0x7fffffffd110,
ngramScore=@0x7fffffffd120, oovCount=@0x7fffffffd130) at
moses/LM/Ken.h:77
77 ? ? ? ? ?std::size_t factor = word.GetFactor
(m_factorType)->GetId();
This is using the RELEASE-3.0 branch.? Does anyone have any
ideas here?
Kind regards,
Ryan Adler
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20161215/86ddd63b/attachment-0001.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20161215/86ddd63b/attachment-0001.gif
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 122, Issue 29
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 122, Issue 29"
Post a Comment