Send Moses-support mailing list submissions to
moses-support@mit.edu
To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu
You can reach the person managing the list at
moses-support-owner@mit.edu
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."
Today's Topics:
1. Is incremental training automatic by default ? (Vincent Nguyen)
2. Sparse features (Marco Damonte)
3. Re: decoding-graph-backoff (Saumitra Yadav)
4. Performance issue using Moses Server with Moses 3 (probably
same as Oren's) (Martin Baumg?rtner)
----------------------------------------------------------------------
Message: 1
Date: Thu, 23 Jul 2015 20:34:14 +0200
From: Vincent Nguyen <vnguyen@neuf.fr>
Subject: [Moses-support] Is incremental training automatic by default
?
To: moses-support <moses-support@mit.edu>
Message-ID: <55B133A6.30307@neuf.fr>
Content-Type: text/plain; charset=utf-8; format=flowed
Hi,
Quick question.
When we run several experiements, does it train the model incrementally ?
or this the model reset ?
thanks
------------------------------
Message: 2
Date: Fri, 24 Jul 2015 10:03:35 +0000
From: Marco Damonte <mdtux89@gmail.com>
Subject: [Moses-support] Sparse features
To: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CAD2JQQNUHTTjqOVx3_b6vo+_3hv=E-dkLAVtFrz8Xmx=wpEEng@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
Hi everyone,
I'm using EMS to run experiments involving semantic annotations as factors.
I would like to try adding sparse features to use the fact that when a word
and its translation have the same annotation, there is good chances that it
is a good translation.
I read the tutorials on Moses website but it's still not clear to me how
this works. Can anyone help me with this?
Regards,
Marco
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150724/d953d762/attachment-0001.htm
------------------------------
Message: 3
Date: Fri, 24 Jul 2015 16:10:49 +0530
From: Saumitra Yadav <yadav.saumitra07@gmail.com>
Subject: Re: [Moses-support] decoding-graph-backoff
To: Hieu Hoang <hieuhoang@gmail.com>
Cc: moses-support@mit.edu
Message-ID:
<CAPeFGXam9EZkLPib=VgusqZi1Ou60rFdDE=4ke=DNBJ6fVTYdA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"
But sir when i did that there was * segmentation fault* while loading first
phrase-table, one walk around i got was giving phrase-table uncompressed to
decoder.
Regards,
Saumitra Yadav
M.Tech.
Department Of Computer Science And Technology
Goa University
On Thu, Jul 23, 2015 at 8:06 PM, Hieu Hoang <hieuhoang@gmail.com> wrote:
> i think you have to swap the phrase tables around. The decoder always
> looks at the 1st phrase-table, then backoff to the 2nd if nothing is found
>
>
> On 22/07/2015 16:59, Saumitra Yadav wrote:
>
> Sir/Ma'am,
> I'm trying to use multiple phrase tables for translation in Moses
> decoder, with preference to 1st phrase-table, but was getting a
> segmentation fault while loading 1st phrase table, so just switched the
> positions of phrase-tables in moses configuration file and it was working ,
> now the table i want to give preference is 2nd in list , can i use
>
> [decoding-graph-backoff]
> 1
> 3
> in configuration file for backoff so that moses uses 2nd table and uses
> 1st table only for words it couldn't find in 2nd phrase-table?
>
> Regards,
> Saumitra Yadav
> M.Tech.
> Department Of Computer Science And Technology
> Goa University
>
>
>
> _______________________________________________
> Moses-support mailing listMoses-support@mit.eduhttp://mailman.mit.edu/mailman/listinfo/moses-support
>
>
> --
> Hieu Hoang
> Researcher
> New York University, Abu Dhabihttp://www.hoang.co.uk/hieu
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150724/ed11aaf5/attachment-0001.htm
------------------------------
Message: 4
Date: Fri, 24 Jul 2015 13:07:33 +0200
From: Martin Baumg?rtner <martin.baumgaertner@star-group.net>
Subject: [Moses-support] Performance issue using Moses Server with
Moses 3 (probably same as Oren's)
To: moses-support@mit.edu
Message-ID: <55B21C75.70502@star-group.net>
Content-Type: text/plain; charset="utf-8"
Hi,
followed your discussion about mosesserver performance issue with much
interest so far.
We're having similar behaviour in our perfomance tests with a current
github master clone. Both, mosesserver and complete engine run from same
local machine, i.e. no NFS. Machine is virtualized CentOS 7 using Hyper-V:
> lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 8
On-line CPU(s) list: 0-7
Thread(s) per core: 1
Core(s) per socket: 8
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 30
Model name: Intel(R) Core(TM) i7 CPU 860 @ 2.80GHz
Stepping: 5
CPU MHz: 2667.859
BogoMIPS: 5335.71
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 8192K
Following experiments using an engine with 75000 segments for TM/LM
(--minphr-memory, --minlexr-memory):
1.)
server: --threads: 8
client: shoots 8 threads => about 12 seconds, server shows full CPU
workload => OK
2.)
server: --threads: 8
client: shoots 10 threads => about 85 seconds, server shows mostly low
activity, full CPU workload only near end of process => NOT OK
3.)
server: --threads: 16
client: shoots 10 threads => about 12 seconds, server shows busy CPU
workload => OK
4.)
server: --threads: 16
client: shoots 16 threads => about 11 seconds, server shows busy CPU
workload => OK
5.)
server: --threads: 16
client: shoots 20 threads => about 40-60 seconds (depending), server
shows mostly low activity, full CPU workload only near end of process =>
NOT OK
We've seen a breakdown in performance always when the client threads
exceed the number of threads given by the --threads param.
Kind regards,
Martin
--
*STAR Group* <http://www.star-group.net>
<http://www.star-group.net/>
*Martin Baumg?rtner*
STAR Language Technology & Solutions GmbH
Umberto-Nobile-Stra?e 19 | 71063 Sindelfingen | Germany
Tel. +49 70 31-4 10 92-0 martin.baumgaertner@star-group.net
<mailto:martin.baumgaertner@star-group.net>
Fax +49 70 31-4 10 92-70 www.star-group.net <http://www.star-group.net/>
Gesch?ftsf?hrer: Oliver Rau, Bernd Barth
Handelsregister Stuttgart HRB 245654 | St.-Nr. 56098/11677
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20150724/79d336fa/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ciehfbji.gif
Type: image/gif
Size: 8030 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150724/79d336fa/attachment.gif
------------------------------
_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support
End of Moses-support Digest, Vol 105, Issue 52
**********************************************
Subscribe to:
Post Comments (Atom)
0 Response to "Moses-support Digest, Vol 105, Issue 52"
Post a Comment