[CalendarServer-dev] [CalendarServer] #336: Memcache dies on store

13 May 2009

      #336: Memcache dies on store
----------------------------------------+-----------------------------------
 Reporter:  cosmin@…                    |       Owner:  wsanchez@…        
     Type:  Defect                      |      Status:  new               
 Priority:  5: Not set                  |   Milestone:                    
Component:  Calendar Server             |    Severity:  Other             
 Keywords:  memcache                    |  
----------------------------------------+-----------------------------------
 Pretty much standard installation from revision 4252.

 When I add an event with sunbird to a calendar, that event does not show
 up.

 {{{
 ==> /home/calendar/log/access.log <==
 172.17.0.30 - ccraciun [13/May/2009:17:40:45 -0400] "PUT
 /calendars/users/ccraciun/calendar/a9637f95-bab9-4fe2-b287-e3e501549121.ics
 HTTP/1.1" 500 201 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US;
 rv:1.8.1.8pre) Gecko/20071204 Ubuntu/8.04 (hardy) Calendar/0.7" [3110.5
 ms] [8008 1]

 ==> /home/calendar/log/error.log <==
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient socket marked dead (timed out)
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-]
 [twistedcaldav.memcacheprops.MemcachePropertyCollection#debug] Loaded keys
 for children of <CalDAVFile (calendar collection):
 /home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar>:
 ['a9637f95-bab9-4fe2-b287-e3e501549121.ics']
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-]
 [twistedcaldav.memcacheprops.MemcachePropertyCollection#debug] Building
 cache for <CalDAVFile (calendar collection):
 /home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar>
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-]
 [twistedcaldav.memcacheprops.ChildPropertyStore#debug] List for
 /home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar/a9637f95-bab9-4fe2-b287-e3e501549121.ics
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-]
 [twistedcaldav.memcacheprops.MemcachePropertyCollection#debug] Storing
 cache for <CalDAVFile (calendar collection):
 /home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar>
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_server( ) failed to connect
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-]
 [twistedcaldav.memcacheprops.MemcachePropertyCollection#debug] Loading
 cache for <CalDAVFile (calendar collection):
 /home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar>
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_socket() found dead socket
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-] [memcacheclient#error]
 Memcacheclient _get_server( ) failed to connect
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-]
 [twistedcaldav.memcacheprops.MemcachePropertyCollection#debug] Loaded keys
 for missing children of <CalDAVFile (calendar collection):
 /home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar>:
 ['a9637f95-bab9-4fe2-b287-e3e501549121.ics']
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-]
 [twistedcaldav.memcacheprops.MemcachePropertyCollection#debug] [CC]
 Missing: ('a9637f95-bab9-4fe2-b287-e3e501549121.ics',)
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-]
 [twistedcaldav.index.MemcachedUIDReserver#debug] Unreserving UID
 'a9637f95-bab9-4fe2-b287-e3e501549121' @
 '/home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar'
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-]
 [twistedcaldav.memcachepool.MemCachePool#debug] Busied client:
 <twistedcaldav.memcachepool.PooledMemCacheProtocol instance at 0x8d25ecc>
 2009-05-13 17:40:45-0400 [-] [caldav-8008]  [-]
 [twistedcaldav.memcachepool.MemCachePool#debug] Clients #free: 0, #busy:
 1, #pending: 0, #queued: 0
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client]
 [twistedcaldav.memcachepool.MemCachePool#debug] Freed client:
 <twistedcaldav.memcachepool.PooledMemCacheProtocol instance at 0x8d25ecc>
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client]
 [twistedcaldav.memcachepool.MemCachePool#debug] Clients #free: 1, #busy:
 0, #pending: 0, #queued: 0
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client]
 [twistedcaldav.memcachelock.MemcacheLock#debug] Deleting Cache Token for
 u'a9637f95-bab9-4fe2-b287-e3e501549121'
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client]
 [twistedcaldav.memcachepool.MemCachePool#debug] Busied client:
 <twistedcaldav.memcachepool.PooledMemCacheProtocol instance at 0x8d25ecc>
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client]
 [twistedcaldav.memcachepool.MemCachePool#debug] Clients #free: 0, #busy:
 1, #pending: 0, #queued: 0
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client]
 [twistedcaldav.memcachepool.MemCachePool#debug] Freed client:
 <twistedcaldav.memcachepool.PooledMemCacheProtocol instance at 0x8d25ecc>
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client]
 [twistedcaldav.memcachepool.MemCachePool#debug] Clients #free: 1, #busy:
 0, #pending: 0, #queued: 0
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client] [twistedcaldav.method.put_common#debug]
 Rollback: rollback
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client] [twistedcaldav.method.put_common#debug]
 Destination index removed
 /home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar/a9637f95-bab9-4fe2-b287-e3e501549121.ics
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client] [twistedcaldav.method.put_common#debug]
 Rollback: destination index removed
 /home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar/a9637f95-bab9-4fe2-b287-e3e501549121.ics
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client] [twistedcaldav.method.put_common#debug]
 Rollback: destination removed
 /home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar/a9637f95-bab9-4fe2-b287-e3e501549121.ics
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client] Exception rendering:
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 [PooledMemCacheProtocol,client] Unhandled Error
 2009-05-13 17:40:45-0400 [-] [caldav-8008]      Traceback (most recent
 call last):
 2009-05-13 17:40:45-0400 [-] [caldav-8008]        File "/usr/lib/python2.5
 /site-packages/twisted/internet/defer.py", line 261, in errback
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 2009-05-13 17:40:45-0400 [-] [caldav-8008]        File "/usr/lib/python2.5
 /site-packages/twisted/internet/defer.py", line 304, in _startRunCallbacks
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 2009-05-13 17:40:45-0400 [-] [caldav-8008]        File "/usr/lib/python2.5
 /site-packages/twisted/internet/defer.py", line 317, in _runCallbacks
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 2009-05-13 17:40:45-0400 [-] [caldav-8008]        File "/usr/lib/python2.5
 /site-packages/twisted/internet/defer.py", line 746, in gotResult
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 2009-05-13 17:40:45-0400 [-] [caldav-8008]      --- <exception caught
 here> ---
 2009-05-13 17:40:45-0400 [-] [caldav-8008]        File "/usr/lib/python2.5
 /site-packages/twisted/internet/defer.py", line 724, in _inlineCallbacks
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 2009-05-13 17:40:45-0400 [-] [caldav-8008]        File "/usr/lib/python2.5
 /site-packages/twistedcaldav/method/put.py", line 68, in http_PUT
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 2009-05-13 17:40:45-0400 [-] [caldav-8008]        File "/usr/lib/python2.5
 /site-packages/twisted/internet/defer.py", line 726, in _inlineCallbacks
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 2009-05-13 17:40:45-0400 [-] [caldav-8008]        File "/usr/lib/python2.5
 /site-packages/twistedcaldav/method/put_common.py", line 1111, in run
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 2009-05-13 17:40:45-0400 [-] [caldav-8008]
 memcacheclient.MemcacheError: Unable to fully load cache for <CalDAVFile
 (calendar collection):
 /home/calendar/caldavd/Documents/calendars/__uids__/3c/d7/3cd7ee95-ebc7-57df-a218-349e6887d274/calendar>
 }}}

-- 
Ticket URL: <http://trac.calendarserver.org/ticket/336>
CalendarServer </>
HTTP/WebDAV/CalDAV Server