Hello, are there limitations on the amount of events each user can have? I have several users with 1000+ events that seems to cause the server to fail, returning null: iCal[5423]: CalDAV CalDAVCalendarRefreshOperation failed: status 'HTTP/1.1 207 Multi-Status' request:\n <?xml version="1.0" encoding="utf-8"?> <x0:propfind xmlns:x0="DAV:"> <x0:prop> <x0:getetag/> <x0:resourcetype/> </x0:prop> </x0:propfind> ... response: (null)
Hi Sean, --On February 11, 2009 5:25:06 PM +0100 Sean McAvoy <smcavoy@ripe.net> wrote:
are there limitations on the amount of events each user can have? I have several users with 1000+ events that seems to cause the server to fail, returning null: iCal[5423]: CalDAV CalDAVCalendarRefreshOperation failed: status 'HTTP/1.1 207 Multi-Status' request:\n
<?xml version="1.0" encoding="utf-8"?> <x0:propfind xmlns:x0="DAV:"> <x0:prop> <x0:getetag/> <x0:resourcetype/> </x0:prop> </x0:propfind>
... response:
The server does not have limits on PROPFINDs, but does on some other requests, but iCal is typically aware of those and knows how to query in smaller batches. What does the server's access.log and error.log look like for this problem? Also, what are the timestamps on iCal's log entries? In particular, it could be that iCal is timing out waiting on the server (i.e. a performance issue rather than a limit). -- Cyrus Daboo
On Feb 11, 2009, at 17:57, Cyrus Daboo wrote:
Hi Sean,
--On February 11, 2009 5:25:06 PM +0100 Sean McAvoy <smcavoy@ripe.net> wrote:
are there limitations on the amount of events each user can have? I have several users with 1000+ events that seems to cause the server to fail, returning null: iCal[5423]: CalDAV CalDAVCalendarRefreshOperation failed: status 'HTTP/1.1 207 Multi-Status' request:\n
<?xml version="1.0" encoding="utf-8"?> <x0:propfind xmlns:x0="DAV:"> <x0:prop> <x0:getetag/> <x0:resourcetype/> </x0:prop> </x0:propfind>
... response:
The server does not have limits on PROPFINDs, but does on some other requests, but iCal is typically aware of those and knows how to query in smaller batches. we have it configured so all users can see all calendars, about 130 users in total
What does the server's access.log and error.log look like for this problem? Also, what are the timestamps on iCal's log entries? In particular, it could be that iCal is timing out waiting on the server (i.e. a performance issue rather than a limit). I would hope it not a performance issue, its single quad core with 4gb of RAM :) acting as a OD Server and running the calendar server. I've included a lot of the error log as nothing stands out for me, perhaps for you?
access.log: 193.0.20.121 - smcavoy [11/Feb/2009:18:05:39 +0200] "PROPFIND / calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ HTTP/ 1.1" 207 496208 "-" "D AVKit/3.0.6 (653); CalendarStore/3.0.6 (847); iCal/3.0.6 (1273); Mac OS X/10.5.6 (9G55)" [80504.2 ms] error.log 2009-02-11 18:05:01+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/81275781-0280-4187-9F24-706407494160/ HTTP/1.1 2009-02-11 18:05:01+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/EB2E94EF-72F4-4F03-A3A2-8B5834FFFC30/ HTTP/1.1 2009-02-11 18:05:02+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/ED9E2332-DE0B-4371-8C36-2050B44E11E4/ HTTP/1.1 2009-02-11 18:05:02+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/E0BAF540-5FB2-4248-8543-0E2377F47ECE/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8011] [-] AMP connection established (HOST:UNIXSocket(None) PEER:UNIXSocket('/var/run/caldavd- pydir.sock')) 2009-02-11 18:05:03+0100 [-] [caldav-8011] [AMP,client] "Directory service <SudoDirectoryService '/Search': FilePath('/etc/caldavd/ sudoers.plist')> has no GUID; generating service GUID from realm name." 2009-02-11 18:05:03+0100 [-] [caldav-8011] [AMP,client] PROPFIND / calendars/__uids__/81275781-0280-4187-9F24-706407494160/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/FF6931C6-75A8-49DB-B5D1-12C32CFFA4D8/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/E0BAF540-5FB2-4248-8543-0E2377F47ECE/calendar/ HTTP/ 1.1 2009-02-11 18:05:03+0100 [-] [caldav-8011] [AMP,client] PROPFIND / calendars/__uids__/DFCC515F-F31A-4468-895F-D9D463761327/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8011] [AMP,client] PROPFIND / principals/__uids__/DFCC515F-F31A-4468-895F-D9D463761327/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8011] [AMP,client] PROPFIND / principals/__uids__/DFCC515F-F31A-4468-895F-D9D463761327/ HTTP/1.1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [AMP,client] PROPFIND / principals/__uids__/A06DF3B5-E154-4887-B59D-8EDB2B5C09F3/ HTTP/1.1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [AMP,client] PROPFIND / principals/__uids__/81275781-0280-4187-9F24-706407494160/ HTTP/1.1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 0C1736E1-FE01-4B99-A0A6-DAFD70E9D6C1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 0C1736E1-FE01-4B99-A0A6-DAFD70E9D6C1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 0C1736E1-FE01-4B99-A0A6-DAFD70E9D6C1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 0C1736E1-FE01-4B99-A0A6-DAFD70E9D6C1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [-] u'No principal found for UID: 0C1736E1-FE01-4B99-A0A6-DAFD70E9D6C1#calendar-proxy-read' 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 1CD8B1ED-B9CB-4A48-9915-5D255AF21487 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 1CD8B1ED-B9CB-4A48-9915-5D255AF21487 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 1CD8B1ED-B9CB-4A48-9915-5D255AF21487 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 1CD8B1ED-B9CB-4A48-9915-5D255AF21487 2009-02-11 18:05:04+0100 [-] [caldav-8011] [-] u'No principal found for UID: 1CD8B1ED-B9CB-4A48-9915-5D255AF21487#calendar-proxy-read' 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID F0362F7C-C986-4923-A163-AC5B19EC5500 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID F0362F7C-C986-4923-A163-AC5B19EC5500 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID F0362F7C-C986-4923-A163-AC5B19EC5500 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID F0362F7C-C986-4923-A163-AC5B19EC5500 2009-02-11 18:05:04+0100 [-] [caldav-8011] [-] u'No principal found for UID: F0362F7C-C986-4923-A163-AC5B19EC5500#calendar-proxy-read' 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 4D051172-1DEB-4D81-9FB4-C1D8ABCA8FB1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 4D051172-1DEB-4D81-9FB4-C1D8ABCA8FB1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 4D051172-1DEB-4D81-9FB4-C1D8ABCA8FB1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 4D051172-1DEB-4D81-9FB4-C1D8ABCA8FB1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [-] u'No principal found for UID: 4D051172-1DEB-4D81-9FB4-C1D8ABCA8FB1#calendar-proxy-read' 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 303FE15B-BCE1-43BD-A0F5-3E65787DF952 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 303FE15B-BCE1-43BD-A0F5-3E65787DF952 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 303FE15B-BCE1-43BD-A0F5-3E65787DF952 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 303FE15B-BCE1-43BD-A0F5-3E65787DF952 2009-02-11 18:05:04+0100 [-] [caldav-8011] [-] u'No principal found for UID: 303FE15B-BCE1-43BD-A0F5-3E65787DF952#calendar-proxy-read' 2009-02-11 18:05:05+0100 [-] [caldav-8011] [AMP,client] PROPFIND / principals/__uids__/38EA1E61-54C8-4B97-8346-3315D20B01F9/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/F994F62C-E46D-416E-BA5A-9275C9FFA191/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/441F9C5A-EA9C-4400-B325-FBAE5B1A487E/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/60F393F2-8EC9-428B-9E3B-E2FD2813FFF9/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/D4B98A62-A8A5-4F55-8182-1E259C0F1457/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/947D467E-9898-4C08-A698-C6E7A5ADBC60/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/7D797DEB-AE7A-4BB7-A177-3234A69913D8/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/F8B37EB9-1EB5-427A-8D57-457F5E078F88/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/BFAB71B6-46DE-467C-9739-365BDE9D3FEA/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/A3AB7E94-9E52-4595-9751-90574AA12622/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/FF10AF68-E161-4CDD-873A-4B71C0A53F3F/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8012] [AMP,client] POST / calendars/__uids__/31F6B1F2-AE7F-435F-9F81-9550EB589A81/outbox/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/F119A379-958F-40C0-BB93-88024678FA4B/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/9FF5B56F-29DE-42F6-B231-EFA289BEF6A9/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/23CA7D15-4776-469F-974B-E8A48C4EF320/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/5265CF49-5614-4C34-8FA9-03364FC861B2/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/874709BA-11F7-463C-99A3-D6E63A79E21E/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/DFCC515F-F31A-4468-895F-D9D463761327/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/58E0BD88-D794-4EED-8A1E-8D7D42EF75AC/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/9124CDAF-9F09-4B50-8DBF-0A86BFB51821/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/59B7E727-1DF1-4F05-8D09-2760A4A1543F/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/B826E85C-E2EC-4A7E-BD9A-94AE39981D63/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/C9486D6B-DCF3-44F1-AE69-4C75F67AF31E/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/AEBAC4D3-AA97-4272-82FD-2F686CBE6ABC/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/4A5774C5-30FD-4B6A-A1B0-0602BFBADB14/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/D04B24D0-74C6-4C12-B546-3EE3B710C645/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/63552FC3-C235-4A00-9D22-02EDE1F71542/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/A38794FF-4172-42FC-B0D0-F255B7976594/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/FA83BB66-ECFC-43C6-92D7-55AC4C2A418E/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/0D402FD3-6F30-4F33-B561-3CC8E5972BFA/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/8E2B0CBD-B354-4932-82DE-08E1B3F4D39F/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/FAC66251-B074-4E1A-98E7-21CDCE2ECA91/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/8AE767BF-1715-44F7-A5E5-E8ECA5D12B1B/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/00B3DA5A-F850-4369-8780-938DAB561667/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/3F65D66F-7A4F-47C6-B860-14C4D7021EAF/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/1F70B5C9-603E-4097-BB5D-C27FD5DC3867/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/0F894EC9-2ECB-409B-9D9D-80E1EF00E23F/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/04C63523-5293-4081-BC5E-F6F7C658ED59/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/B6B043CE-E77F-418D-99EC-A22B93AA038D/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/EA84E503-C2BB-483A-B4EB-D24CBF1C625B/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/B6742843-37A5-40D2-8E8D-39B97CC69D50/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/77FD03D7-C9CF-44E0-923F-A5AA77725A75/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/DE690C82-BE4C-4FE0-9C84-6D1F366B120E/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/C18993E2-FCBF-4D29-9C2F-BAEF5442839B/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/1563965A-9889-4ABA-8FEE-E3148282F261/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/7510DCC0-4C27-404A-8379-37DCC221EC03/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/64E26AF7-F273-4C79-9C3B-078ACFE67171/ HTTP/1.1 2009-02-11 18:05:19+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/81275781-0280-4187-9F24-706407494160/ HTTP/1.1 2009-02-11 18:05:19+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/46BAE0B5-5BD7-4F2D-9281-0094314C11F2/ HTTP/1.1 2009-02-11 18:05:42+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/B8A4CB9B-3931-4E83-8E8F-7500F1E1CB0D/ HTTP/1.1 2009-02-11 18:05:42+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/EA84E503-C2BB-483A-B4EB-D24CBF1C625B/ HTTP/1.1 2009-02-11 18:05:53+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/58F2A8BF-B593-475D-A312-809F09E37F0F/ HTTP/1.1 2009-02-11 18:05:53+0100 [-] [caldav-8011] [AMP,client] PROPFIND / calendars/__uids__/0569F124-F9AA-4609-A6BC-A1798C8B833A/ HTTP/1.1 2009-02-11 18:05:53+0100 [-] [caldav-8011] [AMP,client] PROPFIND / calendars/__uids__/0569F124-F9AA-4609-A6BC-A1798C8B833A/inbox/ HTTP/1.1
-- Cyrus Daboo
I had similar issues with large calendars and 1000+ events. In your case is does look like it is timing out:
[80504.2 ms]
That is a really long return time for a request. On my really busy server my typical responses are:
[3195.9 ms]
I'm not an expert yet with the iCal/CalDAV server but am very aware that there are a lot of moving pieces to getting it to work and perform correctly. I might look through your system log to see if there are other issues that might be delaying responses as well. I think more RAM might be helpful too as the iCal/CalDAV server spawns about 10 python processes that are very short lived but are constant and for brief periods (measured in milliseconds or a few seconds) can spike the CPU usage. - Don Kruse On Feb 11, 2009, at 9:22 AM, Sean McAvoy wrote:
On Feb 11, 2009, at 17:57, Cyrus Daboo wrote:
Hi Sean,
--On February 11, 2009 5:25:06 PM +0100 Sean McAvoy <smcavoy@ripe.net> wrote:
are there limitations on the amount of events each user can have? I have several users with 1000+ events that seems to cause the server to fail, returning null: iCal[5423]: CalDAV CalDAVCalendarRefreshOperation failed: status 'HTTP/1.1 207 Multi-Status' request:\n
<?xml version="1.0" encoding="utf-8"?> <x0:propfind xmlns:x0="DAV:"> <x0:prop> <x0:getetag/> <x0:resourcetype/> </x0:prop> </x0:propfind>
... response:
The server does not have limits on PROPFINDs, but does on some other requests, but iCal is typically aware of those and knows how to query in smaller batches. we have it configured so all users can see all calendars, about 130 users in total
What does the server's access.log and error.log look like for this problem? Also, what are the timestamps on iCal's log entries? In particular, it could be that iCal is timing out waiting on the server (i.e. a performance issue rather than a limit). I would hope it not a performance issue, its single quad core with 4gb of RAM :) acting as a OD Server and running the calendar server. I've included a lot of the error log as nothing stands out for me, perhaps for you?
access.log: 193.0.20.121 - smcavoy [11/Feb/2009:18:05:39 +0200] "PROPFIND / calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ HTTP/1.1" 207 496208 "-" "D AVKit/3.0.6 (653); CalendarStore/3.0.6 (847); iCal/3.0.6 (1273); Mac OS X/10.5.6 (9G55)" [80504.2 ms]
error.log 2009-02-11 18:05:01+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/81275781-0280-4187-9F24-706407494160/ HTTP/1.1 2009-02-11 18:05:01+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/EB2E94EF-72F4-4F03-A3A2-8B5834FFFC30/ HTTP/1.1 2009-02-11 18:05:02+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/ED9E2332-DE0B-4371-8C36-2050B44E11E4/ HTTP/1.1 2009-02-11 18:05:02+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/E0BAF540-5FB2-4248-8543-0E2377F47ECE/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8011] [-] AMP connection established (HOST:UNIXSocket(None) PEER:UNIXSocket('/var/run/caldavd- pydir.sock')) 2009-02-11 18:05:03+0100 [-] [caldav-8011] [AMP,client] "Directory service <SudoDirectoryService '/Search': FilePath('/etc/caldavd/ sudoers.plist')> has no GUID; generating service GUID from realm name." 2009-02-11 18:05:03+0100 [-] [caldav-8011] [AMP,client] PROPFIND / calendars/__uids__/81275781-0280-4187-9F24-706407494160/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/FF6931C6-75A8-49DB-B5D1-12C32CFFA4D8/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/E0BAF540-5FB2-4248-8543-0E2377F47ECE/calendar/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8011] [AMP,client] PROPFIND / calendars/__uids__/DFCC515F-F31A-4468-895F-D9D463761327/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8011] [AMP,client] PROPFIND / principals/__uids__/DFCC515F-F31A-4468-895F-D9D463761327/ HTTP/1.1 2009-02-11 18:05:03+0100 [-] [caldav-8011] [AMP,client] PROPFIND / principals/__uids__/DFCC515F-F31A-4468-895F-D9D463761327/ HTTP/1.1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [AMP,client] PROPFIND / principals/__uids__/A06DF3B5-E154-4887-B59D-8EDB2B5C09F3/ HTTP/1.1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [AMP,client] PROPFIND / principals/__uids__/81275781-0280-4187-9F24-706407494160/ HTTP/1.1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 0C1736E1-FE01-4B99-A0A6- DAFD70E9D6C1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 0C1736E1-FE01-4B99-A0A6- DAFD70E9D6C1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 0C1736E1-FE01-4B99-A0A6- DAFD70E9D6C1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 0C1736E1-FE01-4B99-A0A6- DAFD70E9D6C1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [-] u'No principal found for UID: 0C1736E1-FE01-4B99-A0A6-DAFD70E9D6C1#calendar-proxy-read' 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 1CD8B1ED- B9CB-4A48-9915-5D255AF21487 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 1CD8B1ED- B9CB-4A48-9915-5D255AF21487 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 1CD8B1ED- B9CB-4A48-9915-5D255AF21487 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 1CD8B1ED- B9CB-4A48-9915-5D255AF21487 2009-02-11 18:05:04+0100 [-] [caldav-8011] [-] u'No principal found for UID: 1CD8B1ED-B9CB-4A48-9915-5D255AF21487#calendar-proxy-read' 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID F0362F7C-C986-4923-A163- AC5B19EC5500 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID F0362F7C-C986-4923-A163- AC5B19EC5500 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID F0362F7C-C986-4923-A163- AC5B19EC5500 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID F0362F7C-C986-4923-A163- AC5B19EC5500 2009-02-11 18:05:04+0100 [-] [caldav-8011] [-] u'No principal found for UID: F0362F7C-C986-4923-A163-AC5B19EC5500#calendar-proxy-read' 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 4D051172-1DEB-4D81-9FB4- C1D8ABCA8FB1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 4D051172-1DEB-4D81-9FB4- C1D8ABCA8FB1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 4D051172-1DEB-4D81-9FB4- C1D8ABCA8FB1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 4D051172-1DEB-4D81-9FB4- C1D8ABCA8FB1 2009-02-11 18:05:04+0100 [-] [caldav-8011] [-] u'No principal found for UID: 4D051172-1DEB-4D81-9FB4-C1D8ABCA8FB1#calendar-proxy-read' 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 303FE15B-BCE1-43BD- A0F5-3E65787DF952 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 303FE15B-BCE1-43BD- A0F5-3E65787DF952 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 303FE15B-BCE1-43BD- A0F5-3E65787DF952 2009-02-11 18:05:04+0100 [-] [caldav-8011] [OpenDirectoryService] Unable to find any record with GUID 303FE15B-BCE1-43BD- A0F5-3E65787DF952 2009-02-11 18:05:04+0100 [-] [caldav-8011] [-] u'No principal found for UID: 303FE15B-BCE1-43BD-A0F5-3E65787DF952#calendar-proxy-read' 2009-02-11 18:05:05+0100 [-] [caldav-8011] [AMP,client] PROPFIND / principals/__uids__/38EA1E61-54C8-4B97-8346-3315D20B01F9/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/F994F62C-E46D-416E-BA5A-9275C9FFA191/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/441F9C5A-EA9C-4400-B325-FBAE5B1A487E/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/60F393F2-8EC9-428B-9E3B-E2FD2813FFF9/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/D4B98A62-A8A5-4F55-8182-1E259C0F1457/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/947D467E-9898-4C08-A698-C6E7A5ADBC60/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/7D797DEB-AE7A-4BB7-A177-3234A69913D8/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/F8B37EB9-1EB5-427A-8D57-457F5E078F88/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/BFAB71B6-46DE-467C-9739-365BDE9D3FEA/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/A3AB7E94-9E52-4595-9751-90574AA12622/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/FF10AF68-E161-4CDD-873A-4B71C0A53F3F/ HTTP/1.1 2009-02-11 18:05:09+0100 [-] [caldav-8012] [AMP,client] POST / calendars/__uids__/31F6B1F2-AE7F-435F-9F81-9550EB589A81/outbox/ HTTP/ 1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/F119A379-958F-40C0-BB93-88024678FA4B/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/9FF5B56F-29DE-42F6-B231-EFA289BEF6A9/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/23CA7D15-4776-469F-974B-E8A48C4EF320/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/5265CF49-5614-4C34-8FA9-03364FC861B2/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/874709BA-11F7-463C-99A3-D6E63A79E21E/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/DFCC515F-F31A-4468-895F-D9D463761327/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/58E0BD88-D794-4EED-8A1E-8D7D42EF75AC/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/9124CDAF-9F09-4B50-8DBF-0A86BFB51821/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/59B7E727-1DF1-4F05-8D09-2760A4A1543F/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/B826E85C-E2EC-4A7E-BD9A-94AE39981D63/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/C9486D6B-DCF3-44F1-AE69-4C75F67AF31E/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/AEBAC4D3-AA97-4272-82FD-2F686CBE6ABC/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/4A5774C5-30FD-4B6A-A1B0-0602BFBADB14/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/D04B24D0-74C6-4C12-B546-3EE3B710C645/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/63552FC3-C235-4A00-9D22-02EDE1F71542/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/A38794FF-4172-42FC-B0D0-F255B7976594/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/FA83BB66-ECFC-43C6-92D7-55AC4C2A418E/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/0D402FD3-6F30-4F33-B561-3CC8E5972BFA/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/8E2B0CBD-B354-4932-82DE-08E1B3F4D39F/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/FAC66251-B074-4E1A-98E7-21CDCE2ECA91/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/8AE767BF-1715-44F7-A5E5-E8ECA5D12B1B/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/00B3DA5A-F850-4369-8780-938DAB561667/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/3F65D66F-7A4F-47C6-B860-14C4D7021EAF/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/1F70B5C9-603E-4097-BB5D-C27FD5DC3867/ HTTP/1.1 2009-02-11 18:05:10+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/0F894EC9-2ECB-409B-9D9D-80E1EF00E23F/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/04C63523-5293-4081-BC5E-F6F7C658ED59/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/B6B043CE-E77F-418D-99EC-A22B93AA038D/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/EA84E503-C2BB-483A-B4EB-D24CBF1C625B/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/B6742843-37A5-40D2-8E8D-39B97CC69D50/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/77FD03D7-C9CF-44E0-923F-A5AA77725A75/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/DE690C82-BE4C-4FE0-9C84-6D1F366B120E/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/C18993E2-FCBF-4D29-9C2F-BAEF5442839B/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/1563965A-9889-4ABA-8FEE-E3148282F261/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/7510DCC0-4C27-404A-8379-37DCC221EC03/ HTTP/1.1 2009-02-11 18:05:11+0100 [-] [caldav-8010] [AMP,client] PROPFIND / principals/__uids__/64E26AF7-F273-4C79-9C3B-078ACFE67171/ HTTP/1.1 2009-02-11 18:05:19+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/81275781-0280-4187-9F24-706407494160/ HTTP/1.1 2009-02-11 18:05:19+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/46BAE0B5-5BD7-4F2D-9281-0094314C11F2/ HTTP/1.1 2009-02-11 18:05:42+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/B8A4CB9B-3931-4E83-8E8F-7500F1E1CB0D/ HTTP/1.1 2009-02-11 18:05:42+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/EA84E503-C2BB-483A-B4EB-D24CBF1C625B/ HTTP/1.1 2009-02-11 18:05:53+0100 [-] [caldav-8010] [AMP,client] PROPFIND / calendars/__uids__/58F2A8BF-B593-475D-A312-809F09E37F0F/ HTTP/1.1 2009-02-11 18:05:53+0100 [-] [caldav-8011] [AMP,client] PROPFIND / calendars/__uids__/0569F124-F9AA-4609-A6BC-A1798C8B833A/ HTTP/1.1 2009-02-11 18:05:53+0100 [-] [caldav-8011] [AMP,client] PROPFIND / calendars/__uids__/0569F124-F9AA-4609-A6BC-A1798C8B833A/inbox/ HTTP/ 1.1
-- Cyrus Daboo
_______________________________________________ calendarserver-users mailing list calendarserver-users@lists.macosforge.org http://lists.macosforge.org/mailman/listinfo.cgi/calendarserver-users
Hi Sean, --On February 11, 2009 6:22:37 PM +0100 Sean McAvoy <smcavoy@ripe.net> wrote:
What does the server's access.log and error.log look like for this problem? Also, what are the timestamps on iCal's log entries? In particular, it could be that iCal is timing out waiting on the server (i.e. a performance issue rather than a limit). I would hope it not a performance issue, its single quad core with 4gb of RAM :) acting as a OD Server and running the calendar server. I've included a lot of the error log as nothing stands out for me, perhaps for you?
access.log: 193.0.20.121 - smcavoy [11/Feb/2009:18:05:39 +0200] "PROPFIND /calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ HTTP/1.1" 207 496208 "-" "D AVKit/3.0.6 (653); CalendarStore/3.0.6 (847); iCal/3.0.6 (1273); Mac OS X/10.5.6 (9G55)" [80504.2 ms]
What do other PROPFINDs look like in terms of the [XXX ms] value reported in the access.log? What does cpu and memory use show on that machine? Note that according to the access log the server did send back a response for that PROPFIND, so I find it a little odd that the client saw nothing. Are there any intermediary devices (firewalls, routers etc) between the client and server? -- Cyrus Daboo
On Feb 11, 2009, at 22:07, Cyrus Daboo wrote:
Hi Sean,
--On February 11, 2009 6:22:37 PM +0100 Sean McAvoy <smcavoy@ripe.net> wrote:
What does the server's access.log and error.log look like for this problem? Also, what are the timestamps on iCal's log entries? In particular, it could be that iCal is timing out waiting on the server (i.e. a performance issue rather than a limit). I would hope it not a performance issue, its single quad core with 4gb of RAM :) acting as a OD Server and running the calendar server. I've included a lot of the error log as nothing stands out for me, perhaps for you?
access.log: 193.0.20.121 - smcavoy [11/Feb/2009:18:05:39 +0200] "PROPFIND /calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ HTTP/1.1" 207 496208 "-" "D AVKit/3.0.6 (653); CalendarStore/3.0.6 (847); iCal/3.0.6 (1273); Mac OS X/10.5.6 (9G55)" [80504.2 ms]
What do other PROPFINDs look like in terms of the [XXX ms] value reported in the access.log? What does cpu and memory use show on that machine? Both memory and load are quite high, around 40-50% average usage for CPU and 80% phys memory used.
Here is one of the problem calendars: access.log [12/Feb/2009:00:02:39 +0200] "PROPFIND /calendars/__uids__/ 819B6FB2-066B-446C-854F-DC14DDD937D8/ HTTP/1.1" 207 5184 "-" "DAVKit/ 3.0.6 (653); CalendarStore/3.0.6 (847); iCal/3.0.6 (1273); Mac OS X/ 10.5.6 (9G55)" [4048.2 ms] error.log 2009-02-12 00:02:38+0100 [-] [caldav-8009] [AMP,client] PROPFIND / calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/ HTTP/1.1 2009-02-12 00:02:40+0100 [-] [caldav-8009] [AMP,client] PROPFIND / calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ HTTP/ 1.1 iCal client: 2/12/09 12:04 iCal[4703] CalCalDAVCalendarSource: Error Domain=AYErrorDomain Code=2 UserInfo=0x167c7a20 "Async Operation timed out" 2/12/09 12:04 iCal[4703] The server at /calendars/__uids__/ 819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ responded with the error: "Async Operation timed out" 2/12/09 12:04 iCal[4703] The server at /calendars/__uids__/ 819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ responded with the error: "Async Operation timed out" many PROPFINDs are less then 100ms all problem ones are 3000ms+ I will look into possible network issues. Thanks!
Note that according to the access log the server did send back a response for that PROPFIND, so I find it a little odd that the client saw nothing. Are there any intermediary devices (firewalls, routers etc) between the client and server?
-- Cyrus Daboo
On Feb 12, 2009, at 00:14, Sean McAvoy wrote:
On Feb 11, 2009, at 22:07, Cyrus Daboo wrote:
Hi Sean,
--On February 11, 2009 6:22:37 PM +0100 Sean McAvoy <smcavoy@ripe.net> wrote:
What does the server's access.log and error.log look like for this problem? Also, what are the timestamps on iCal's log entries? In particular, it could be that iCal is timing out waiting on the server (i.e. a performance issue rather than a limit). I would hope it not a performance issue, its single quad core with 4gb of RAM :) acting as a OD Server and running the calendar server. I've included a lot of the error log as nothing stands out for me, perhaps for you?
access.log: 193.0.20.121 - smcavoy [11/Feb/2009:18:05:39 +0200] "PROPFIND /calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ HTTP/1.1" 207 496208 "-" "D AVKit/3.0.6 (653); CalendarStore/3.0.6 (847); iCal/3.0.6 (1273); Mac OS X/10.5.6 (9G55)" [80504.2 ms]
What do other PROPFINDs look like in terms of the [XXX ms] value reported in the access.log? What does cpu and memory use show on that machine? Both memory and load are quite high, around 40-50% average usage for CPU and 80% phys memory used.
Here is one of the problem calendars: access.log [12/Feb/2009:00:02:39 +0200] "PROPFIND /calendars/__uids__/ 819B6FB2-066B-446C-854F-DC14DDD937D8/ HTTP/1.1" 207 5184 "-" "DAVKit/ 3.0.6 (653); CalendarStore/3.0.6 (847); iCal/3.0.6 (1273); Mac OS X/ 10.5.6 (9G55)" [4048.2 ms]
error.log 2009-02-12 00:02:38+0100 [-] [caldav-8009] [AMP,client] PROPFIND / calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/ HTTP/1.1 2009-02-12 00:02:40+0100 [-] [caldav-8009] [AMP,client] PROPFIND / calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ HTTP/1.1
iCal client: 2/12/09 12:04 iCal[4703] CalCalDAVCalendarSource: Error Domain=AYErrorDomain Code=2 UserInfo=0x167c7a20 "Async Operation timed out" 2/12/09 12:04 iCal[4703] The server at /calendars/__uids__/ 819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ responded with the error: "Async Operation timed out" 2/12/09 12:04 iCal[4703] The server at /calendars/__uids__/ 819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ responded with the error: "Async Operation timed out"
many PROPFINDs are less then 100ms all problem ones are 3000ms+
I will look into possible network issues.
I connected a system to the same VLAN as the calendar server, calendars with about 1500 events work some of the time but take sometime. 3000+ event calendars still do not work at all. I will move a few of the large calendars to a almost unused similarly spec'd system to see if a single user downloading the calendar works. Has there been many tests of large calendars + iCal clients?
Thanks!
Note that according to the access log the server did send back a response for that PROPFIND, so I find it a little odd that the client saw nothing. Are there any intermediary devices (firewalls, routers etc) between the client and server?
-- Cyrus Daboo
_______________________________________________ calendarserver-users mailing list calendarserver-users@lists.macosforge.org http://lists.macosforge.org/mailman/listinfo.cgi/calendarserver-users
On Feb 12, 2009, at 12:14, Sean McAvoy wrote:
On Feb 12, 2009, at 00:14, Sean McAvoy wrote:
On Feb 11, 2009, at 22:07, Cyrus Daboo wrote:
Hi Sean,
--On February 11, 2009 6:22:37 PM +0100 Sean McAvoy <smcavoy@ripe.net
wrote:
What does the server's access.log and error.log look like for this problem? Also, what are the timestamps on iCal's log entries? In particular, it could be that iCal is timing out waiting on the server (i.e. a performance issue rather than a limit). I would hope it not a performance issue, its single quad core with 4gb of RAM :) acting as a OD Server and running the calendar server. I've included a lot of the error log as nothing stands out for me, perhaps for you?
access.log: 193.0.20.121 - smcavoy [11/Feb/2009:18:05:39 +0200] "PROPFIND /calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ HTTP/1.1" 207 496208 "-" "D AVKit/3.0.6 (653); CalendarStore/ 3.0.6 (847); iCal/3.0.6 (1273); Mac OS X/10.5.6 (9G55)" [80504.2 ms]
What do other PROPFINDs look like in terms of the [XXX ms] value reported in the access.log? What does cpu and memory use show on that machine? Both memory and load are quite high, around 40-50% average usage for CPU and 80% phys memory used.
Here is one of the problem calendars: access.log [12/Feb/2009:00:02:39 +0200] "PROPFIND /calendars/__uids__/ 819B6FB2-066B-446C-854F-DC14DDD937D8/ HTTP/1.1" 207 5184 "-" "DAVKit/3.0.6 (653); CalendarStore/3.0.6 (847); iCal/3.0.6 (1273); Mac OS X/10.5.6 (9G55)" [4048.2 ms]
error.log 2009-02-12 00:02:38+0100 [-] [caldav-8009] [AMP,client] PROPFIND / calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/ HTTP/1.1 2009-02-12 00:02:40+0100 [-] [caldav-8009] [AMP,client] PROPFIND / calendars/__uids__/819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ HTTP/1.1
iCal client: 2/12/09 12:04 iCal[4703] CalCalDAVCalendarSource: Error Domain=AYErrorDomain Code=2 UserInfo=0x167c7a20 "Async Operation timed out" 2/12/09 12:04 iCal[4703] The server at /calendars/__uids__/ 819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ responded with the error: "Async Operation timed out" 2/12/09 12:04 iCal[4703] The server at /calendars/__uids__/ 819B6FB2-066B-446C-854F-DC14DDD937D8/calendar/ responded with the error: "Async Operation timed out"
many PROPFINDs are less then 100ms all problem ones are 3000ms+
I will look into possible network issues.
I connected a system to the same VLAN as the calendar server, calendars with about 1500 events work some of the time but take sometime. 3000+ event calendars still do not work at all.
I will move a few of the large calendars to a almost unused similarly spec'd system to see if a single user downloading the calendar works. Has there been many tests of large calendars + iCal clients?
I have tried this and found the same basic problem, other users cannot access calendars with lots of events (tested 900-9500 event calendars). Do you have any other suggestions on how to narrow down the problem? Thanks!
Thanks!
Note that according to the access log the server did send back a response for that PROPFIND, so I find it a little odd that the client saw nothing. Are there any intermediary devices (firewalls, routers etc) between the client and server?
-- Cyrus Daboo
_______________________________________________ calendarserver-users mailing list calendarserver-users@lists.macosforge.org http://lists.macosforge.org/mailman/listinfo.cgi/calendarserver-users
_______________________________________________ calendarserver-users mailing list calendarserver-users@lists.macosforge.org http://lists.macosforge.org/mailman/listinfo.cgi/calendarserver-users
Hi Sean, --On February 13, 2009 11:49:13 AM +0100 Sean McAvoy <smcavoy@ripe.net> wrote:
I have tried this and found the same basic problem, other users cannot access calendars with lots of events (tested 900-9500 event calendars). Do you have any other suggestions on how to narrow down the problem?
Calendars of several thousand ought to be OK. A lot will depend on disk performance though - are you always using a local disk? -- Cyrus Daboo
On Feb 13, 2009, at 21:17, Cyrus Daboo wrote:
Hi Sean,
--On February 13, 2009 11:49:13 AM +0100 Sean McAvoy <smcavoy@ripe.net> wrote:
I have tried this and found the same basic problem, other users cannot access calendars with lots of events (tested 900-9500 event calendars). Do you have any other suggestions on how to narrow down the problem?
Calendars of several thousand ought to be OK. A lot will depend on disk performance though - are you always using a local disk? Yes, I am always using local disk RAID 5 on 3 73GB SAS drives. During the peak times I've run both top and iostat, top reports python processes at 100%, iostat reports little activity. I have also created 1000 entries via the iCal client and experienced the same problem, after removing 900 of the entires (using the command line) the problem disappeared.
-- Cyrus Daboo
Hi, I think I may have found something. After importing a very large calendar I ran the calendar server from the terminal (not detached) and noticed 1000s of similar entires: 2009-02-17 13:46:05+0100 [-] [caldav-8009] [-] [twistedcaldav.directory.appleopendirectory.OpenDirectoryService#info] Unable to find any record with email ***@ripe.net Could it be that every single event with users attached to it a look up is done and fails? This would explain why large calendars cause problems. It would not however, explain why 1000 entries (no attendees) made in the iCal client results in an non-viewable calendar (others attempting to view it timeout). On Feb 17, 2009, at 11:30, Sean McAvoy wrote:
On Feb 13, 2009, at 21:17, Cyrus Daboo wrote:
Hi Sean,
--On February 13, 2009 11:49:13 AM +0100 Sean McAvoy <smcavoy@ripe.net
wrote:
I have tried this and found the same basic problem, other users cannot access calendars with lots of events (tested 900-9500 event calendars). Do you have any other suggestions on how to narrow down the problem?
Calendars of several thousand ought to be OK. A lot will depend on disk performance though - are you always using a local disk? Yes, I am always using local disk RAID 5 on 3 73GB SAS drives. During the peak times I've run both top and iostat, top reports python processes at 100%, iostat reports little activity. I have also created 1000 entries via the iCal client and experienced the same problem, after removing 900 of the entires (using the command line) the problem disappeared.
-- Cyrus Daboo
_______________________________________________ calendarserver-users mailing list calendarserver-users@lists.macosforge.org http://lists.macosforge.org/mailman/listinfo.cgi/calendarserver-users
Looks like the lookups only happen on import :) I have used CalDAVClientLibrary to connect to the server and run a simple ls on a users calendar directory and it results in the script erroring with "Connection reset by peer", it really seems like the server cannot process large amounts of .ics files (this user has about 2500 .ics fileS). It took almost 5min before the reset by peer happened. this was done against a iCal server running 10.5.6, I plan to do the same with Calendar Server. On Feb 17, 2009, at 13:53, Sean McAvoy wrote:
Hi, I think I may have found something. After importing a very large calendar I ran the calendar server from the terminal (not detached) and noticed 1000s of similar entires: 2009-02-17 13:46:05+0100 [-] [caldav-8009] [-] [twistedcaldav .directory.appleopendirectory.OpenDirectoryService#info] Unable to find any record with email ***@ripe.net
Could it be that every single event with users attached to it a look up is done and fails? This would explain why large calendars cause problems. It would not however, explain why 1000 entries (no attendees) made in the iCal client results in an non-viewable calendar (others attempting to view it timeout).
On Feb 17, 2009, at 11:30, Sean McAvoy wrote:
On Feb 13, 2009, at 21:17, Cyrus Daboo wrote:
Hi Sean,
--On February 13, 2009 11:49:13 AM +0100 Sean McAvoy <smcavoy@ripe.net
wrote:
I have tried this and found the same basic problem, other users cannot access calendars with lots of events (tested 900-9500 event calendars). Do you have any other suggestions on how to narrow down the problem?
Calendars of several thousand ought to be OK. A lot will depend on disk performance though - are you always using a local disk? Yes, I am always using local disk RAID 5 on 3 73GB SAS drives. During the peak times I've run both top and iostat, top reports python processes at 100%, iostat reports little activity. I have also created 1000 entries via the iCal client and experienced the same problem, after removing 900 of the entires (using the command line) the problem disappeared.
-- Cyrus Daboo
_______________________________________________ calendarserver-users mailing list calendarserver-users@lists.macosforge.org http://lists.macosforge.org/mailman/listinfo.cgi/calendarserver-users
_______________________________________________ calendarserver-users mailing list calendarserver-users@lists.macosforge.org http://lists.macosforge.org/mailman/listinfo.cgi/calendarserver-users
On Wed, Feb 11, 2009 at 11:57:09AM -0500, Cyrus Daboo wrote:
Hi Sean,
--On February 11, 2009 5:25:06 PM +0100 Sean McAvoy <smcavoy@ripe.net> wrote:
are there limitations on the amount of events each user can have? I have several users with 1000+ events that seems to cause the server to fail, returning null: iCal[5423]: CalDAV CalDAVCalendarRefreshOperation failed: status 'HTTP/1.1 207 Multi-Status' request:\n
<?xml version="1.0" encoding="utf-8"?> <x0:propfind xmlns:x0="DAV:"> <x0:prop> <x0:getetag/> <x0:resourcetype/> </x0:prop> </x0:propfind>
... response:
The server does not have limits on PROPFINDs, but does on some other requests, but iCal is typically aware of those and knows how to query in smaller batches. You mean as the NumberOfMatchesWithinLimits exception (max_number_of_matches): http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=509195 Do you expect the clients to know about this and handle it? If so, this needs to be fixed up for other clients besides iCal. Cheers, -- Guido
participants (4)
-
Cyrus Daboo
-
Don Kruse
-
Guido Günther
-
Sean McAvoy