Issue 3: Needs to minimize memory usage
Status:  Accepted
Owner:
Reported by jadest...@gmail.com, Dec 9, 2007
 Posted by motienko at 2005-08-04 19:49:28

PyICQ-t on FreeBSD 5.4

SIZE    RES STATE    TIME   WCPU    CPU COMMAND
1 connected user
17580K 12564K kserel   1:40  0.00%  0.00% python
2 connected users
18036K 12876K kserel   1:40  0.00%  0.00% python
3 connected users
18296K 13236K kserel   1:41  0.00%  0.00% python
4 connected users
18448K 13492K kserel   1:42  0.00%  0.00% python

JIT with 59 connected users
13328K  9496K poll    14:53  0.00%  0.00% jabberd-jit

Is it possible to minimize memory usage?
Maybe some python options can do that?

Posted by motienko at 2005-08-04 20:04:51

update:

After disconnection of all users memory usage is bigger .
18792K 13564K kserel   1:43  0.00%  0.00% python

After restarting and zero users online it is:
9828K  7980K select   0:01  3.47%  1.66% python

I guess memory leak is somewhere.

Posted by maxbritov at 2005-08-05 08:50:46

Confirm issue! I just test with my online/offline switching and log top's
report.
Virt / Res / Shr
47108 / 6112 / 1928
79964 / 6248 / 1928 - online
79964 / 6248 / 1928 - offline
47180 / 6216 / 1928 - waiting in offline
63652 / 6408 / 1928 - online
55456 / 6408 / 1928 - waiting in online
55456 / 6408 / 1928 - offline
47260 / 6400 / 1928 - waiting in offline
71912 / 6592 / 1928 - online
47324 / 6604 / 1928 - waiting in online

Posted by jadestorm at 2005-08-08 03:29:11

This is a repeat of  bug 56 ...

Posted by jadestorm at 2005-12-14 16:21:46

http://www.blathersource.org/bugs_view.php?projid=pyicq-t&bugid=56
(I closed the other bug since this has more info)

Posted by jadestorm at 2006-03-25 16:10:12

I'm open for any suggestions anyone might have for this.  I can't figure
out how
to really DO anything about Python memory usage as it holds onto memory that
it's not even using anymore.  (keeps it in a pool for later use)

Posted by avb at 2006-12-09 18:12:11

http://twistedmatrix.com/trac/ticket/1495

it seems that the problem looks like that. 

The problem is very urgent. i need to reboot icq transport on jabber.org.by
twice a day.

Hope that tomorrow i will provide more information

Posted by jadestorm at 2006-12-09 18:13:36

I'm open to patches!  I haven't had time to work on PyICQt as of late.

Posted by avb at 2006-12-10 01:12:37

i'm examining code now. Hope i will find a problem soon.

Posted by guest at 2007-05-23 09:00:13

Have anybody solution? pyicqt drives me mad :((


Jun 27, 2008
#1 vsviri...@gmail.com
I get ~256 megs on start up with 5 users in the spool, not all of them connected...
This is quite insane memory consumption.
Jun 27, 2008
#2 vsviri...@gmail.com
I get ~256 megs on start up with 5 users in the spool, not all of them connected...
This is quite insane memory consumption.
Feb 7, 2009
#3 commi1...@gmail.com
Hey ho - some bugfix available??
Mar 15, 2009
#4 vic...@gmail.com
It is important to correct the memory leak. Memory consumption in quantities not
allowed. At the moment version 8.1.3 Transport consumption by 20 users connected 659 Mb
Mar 20, 2009
#5 motie...@gmail.com
I tried to run PyICQt on OpenVZ VE node but it failed.
Problem with memory consumption is very actual. 1,3G memory for ~ 50 connected users.
Jun 7, 2009
#6 ky6uk.kun
170 Mb memory usage for 1 day with 10-20 users online. It's abnormal...
Jul 21, 2009
#7 fabio.fo...@gmail.com
I confirm the same behavior with twisted 8.2, with just few tens of users the memory
consumption never decreases until the transports dies