[CalendarServer-users] calendarserver behaves extreme slow, what is going on

11 Oct 2009

      Hello everybody,

I have been using calendarserver on Debian for a few years now, and 
since the beginning I have had issues that it takes around 20 to 30 
seconds to just show the agenda on client systems.

I first thought this is just an annoyance of using a caldav system. 
However I now also use a Zimbra caldav agenda and the agenda loads 
completely in less then a second while the darwin calendarserver appears 
many many seconds later.

When on the phone making an appointment, it is almost unable that it 
takes around 30 seconds to load the agenda. 30 seconds is a long time 
for the person on the other end of the conversation.

Could somebody have a look at my attachments, and maybe tell me why my 
calendarserver is behaving so extreme slow, or if this is just normal 
for calendarserver?

Thanks in advance,

Best regards,

Jelle

# tail --line=100 --follow /var/log/caldavd/access.log

192.168.1.236 - - [11/Oct/2009:13:55:34 +0200] "PROPFIND /calendars/users/jelle/calendar HTTP/1.1" 301 155 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.22) Gecko/20090701 Lightning/0.8 Thunderbird/2.0.0.22" [18.1 ms]
192.168.1.236 - - [11/Oct/2009:13:55:35 +0200] "GET /calendars/users/jelle/calendar/ HTTP/1.1" 401 141 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.22) Gecko/20090701 Lightning/0.8 Thunderbird/2.0.0.22" [156.2 ms]
192.168.1.236 - jelle [11/Oct/2009:13:55:37 +0200] "GET /calendars/users/jelle/calendar/ HTTP/1.1" 200 39975 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.22) Gecko/20090701 Lightning/0.8 Thunderbird/2.0.0.22" [1156.8 ms]
192.168.1.236 - jelle [11/Oct/2009:13:55:48 +0200] "REPORT /calendars/users/jelle/calendar/ HTTP/1.1" 207 2079 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.22) Gecko/20090701 Lightning/0.8 Thunderbird/2.0.0.22" [140.0 ms]
192.168.1.236 - jelle [11/Oct/2009:13:55:51 +0200] "REPORT /calendars/users/jelle/calendar/ HTTP/1.1" 207 37379 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.22) Gecko/20090701 Lightning/0.8 Thunderbird/2.0.0.22" [2209.2 ms]
192.168.1.236 - jelle [11/Oct/2009:13:55:58 +0200] "REPORT /calendars/users/jelle/calendar/ HTTP/1.1" 207 180867 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.22) Gecko/20090701 Lightning/0.8 Thunderbird/2.0.0.22" [7382.1 ms]
192.168.1.236 - jelle [11/Oct/2009:13:56:37 +0200] "PUT /calendars/users/jelle/calendar/ee495c28-c555-4943-9920-990cf965a16a.ics HTTP/1.1" 204 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.22) Gecko/20090701 Lightning/0.8 Thunderbird/2.0.0.22" [261.0 ms]
192.168.1.236 - jelle [11/Oct/2009:13:56:37 +0200] "REPORT /calendars/users/jelle/calendar/ HTTP/1.1" 207 1305 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.22) Gecko/20090701 Lightning/0.8 Thunderbird/2.0.0.22" [240.0 ms]

# tail --line=100 --follow /var/log/caldavd/error.log

2009-10-11 13:55:34+0200 [-] [caldav-8443]  [HTTPChannel,236,192.168.1.236] PROPFIND /calendars/users/jelle/calendar HTTP/1.1
2009-10-11 13:55:35+0200 [-] [caldav-8443]  [HTTPChannel,236,192.168.1.236] GET /calendars/users/jelle/calendar/ HTTP/1.1
2009-10-11 13:55:36+0200 [-] [caldav-8443]  [HTTPChannel,236,192.168.1.236] GET /calendars/users/jelle/calendar/ HTTP/1.1
2009-10-11 13:55:48+0200 [-] [caldav-8443]  [HTTPChannel,236,192.168.1.236] REPORT /calendars/users/jelle/calendar/ HTTP/1.1
2009-10-11 13:55:49+0200 [-] [caldav-8443]  [HTTPChannel,236,192.168.1.236] REPORT /calendars/users/jelle/calendar/ HTTP/1.1
2009-10-11 13:55:51+0200 [-] [caldav-8443]  [HTTPChannel,236,192.168.1.236] REPORT /calendars/users/jelle/calendar/ HTTP/1.1
2009-10-11 13:56:36+0200 [-] [caldav-8443]  [HTTPChannel,237,192.168.1.236] PUT /calendars/users/jelle/calendar/ee495c28-c555-4943-9920-990cf965a16a.ics HTTP/1.1
2009-10-11 13:56:36+0200 [-] [caldav-8443]  [-] Writing to file /var/spool/caldavd/calendars/__uids__/46be5973-37b0-5d5d-932f-34cebbe78f04/calendar/ee495c28-c555-4943-9920-990cf965a16a.ics
2009-10-11 13:56:37+0200 [-] [caldav-8443]  [HTTPChannel,237,192.168.1.236] REPORT /calendars/users/jelle/calendar/ HTTP/1.1

# mount
/dev/md0 on / type ext3 (rw,errors=remount-ro,user_xattr,usrquota,grpquota)

# cat /etc/caldavd/caldavd.plist
<?xml version="1.0" encoding="UTF-8"?>

<!--
Copyright (c) 2006-2007 Apple Inc. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
 -->

<!DOCTYPE plist PUBLIC "-//Apple Computer//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>

  <!--
    Public network address information

    This is the server's public network address, which is provided to
    clients in URLs and the like.  It may or may not be the network
    address that the server is listening to directly, though it is by
    default.  For example, it may be the address of a load balancer or
    proxy which forwards connections to the server.
  -->

  <!-- Network host name -->
  <key>ServerHostName</key>
  <string>ashley.powercraft.nl</string>

  <!-- HTTP port [0 = disable HTTP] -->
  <key>HTTPPort</key>
  <integer>0</integer>

  <!-- SSL port [0 = disable HTTPS] -->
  <!-- (Must also configure SSLCertificate and SSLPrivateKey below) -->

  <key>SSLPort</key>
  <integer>8443</integer>

  <!--
    Network address configuration information

    This configures the actual network address that the server binds to.
  -->

  <!-- List of IP addresses to bind to [empty = all] -->
  <key>BindAddresses</key>
  <array><string></string></array>

  <!-- List of port numbers to bind to for HTTP [empty = same as "Port"] -->
  <key>BindHTTPPorts</key>
  <array></array>

  <!-- List of port numbers to bind to for SSL [empty = same as "SSLPort"] -->
  <key>BindSSLPorts</key>
  <array></array>

  <!--
    Data Store
  -->

  <!-- Data root -->
  <key>DataRoot</key>
  <string>/var/run/caldavd</string>

  <!-- Document root -->
  <key>DocumentRoot</key>
  <string>/var/spool/caldavd</string>

  <!-- User quota (in bytes) -->
  <key>UserQuota</key>
  <integer>104857600</integer><!-- 100Mb -->

  <!-- Attachment size limit (in bytes) -->
  <key>MaximumAttachmentSize</key>
  <integer>1048576</integer><!-- 1Mb -->

  <!--
    Directory service

    A directory service provides information about principals (eg.
    users, groups, locations and resources) to the server.

    A variety of directory services are available for use.
  -->

  <!--  XML File Directory Service -->
  <key>DirectoryService</key>
  <dict>
    <key>type</key>
    <string>twistedcaldav.directory.xmlfile.XMLDirectoryService</string>

    <key>params</key>
    <dict>
      <key>xmlFile</key>
      <string>/etc/caldavd/accounts.xml</string>
    </dict>
  </dict>

  <!--  Open Directory Service
  <key>DirectoryService</key>
  <dict>
    <key>type</key>
    <string>twistedcaldav.directory.appleopendirectory.OpenDirectoryService</string>

    <key>params</key>
    <dict>
      <key>node</key>
      <string>/Search</string>
      <key>requireComputerRecord</key>
      <true/>
    </dict>
  </dict>
  -->

  <!--
    Special principals

    These principals are granted special access and/or perform
    special roles on the server.
  -->

  <!-- Principals with "DAV:all" access (relative URLs) -->
  <key>AdminPrincipals</key>
  <array>
    <!-- <string>/principals/users/admin/</string> -->
  </array>

  <!-- Principals that can pose as other principals -->
  <key>SudoersFile</key>
  <string>/etc/caldavd/sudoers.plist</string>

  <!-- Create "proxy access" principals -->
  <key>EnableProxyPrincipals</key>
  <true/>

  <!--
    Authentication
  -->

  <key>Authentication</key>
  <dict>

    <!-- Clear text; best avoided -->
    <key>Basic</key>
    <dict>
      <key>Enabled</key>
      <false/>
    </dict>

    <!-- Digest challenge/response -->
    <key>Digest</key>
    <dict>
      <key>Enabled</key>
      <true/>
      <key>Algorithm</key>
      <string>md5</string>
      <key>Qop</key>
      <string></string>
    </dict>

    <!-- Kerberos/SPNEGO -->
    <key>Kerberos</key>
    <dict>
      <key>Enabled</key>
      <true/>
      <key>ServicePrincipal</key>
      <string></string>
    </dict>

  </dict>

  <!--
    Logging
  -->

  <key>Verbose</key>
  <false/>

  <!-- Apache-style access log -->
  <key>AccessLogFile</key>
  <string>/var/log/caldavd/access.log</string>
  <key>RotateAccessLog</key>
  <false/>

  <!-- Server activity log -->
  <key>ErrorLogFile</key>
  <string>/var/log/caldavd/error.log</string>

  <!-- Server statistics file -->
  <key>ServerStatsFile</key>
  <string>/var/spool/caldavd/stats.plist</string>

  <!-- Server process ID file -->
  <key>PIDFile</key>
  <string>/var/run/caldavd/caldavd.pid</string>

  <!--
    SSL/TLS
  -->

  <!-- Public key -->
  <key>SSLCertificate</key>
  <string>/etc/tls/powercraft.nl/powercraft.nl-certificate.pem</string>

  <!-- Private key -->
  <key>SSLPrivateKey</key>
  <string>/etc/tls/powercraft.nl/powercraft.nl-privatekey.pem</string>

  <!--
    Process management
  -->

  <key>UserName</key>
  <string>caldavd</string>

  <key>GroupName</key>
  <string>caldavd</string>

  <key>ProcessType</key>
  <string>Combined</string>

  <key>MultiProcess</key>
  <dict>
    <key>ProcessCount</key>
    <integer>1</integer> <!-- 0 = one per CPU core -->
  </dict>

  <!--
    Service ACLs
  -->

  <key>EnableSACLs</key>
  <true/>

  <!--
    Non-standard CalDAV extensions
  -->

  <!-- Calendar Drop Box -->
  <key>EnableDropBox</key>
  <true/>

  <!-- Drop Box Notifications -->
  <key>EnableNotifications</key>
  <true/>

  <!--
    Miscellaneous items
  -->

  <key>Twisted</key>
  <dict>
      <key>twistd</key>
      <string>/usr/bin/twistd</string>
  </dict>

  <key>PythonDirector</key>
  <dict>
      <key>pydir</key>
      <string>/usr/share/pydirector/pydir.py</string>
      <key>ControlSocket</key>
      <string>/var/run/caldavd/caldavd-pydir.sock</string>
  </dict>

<key>ControlSocket</key>
  <string>/var/run/caldavd/caldavd.socket</string>

  <!-- Support for Content-Encoding compression options as specified in RFC2616 Section 3.5 -->
  <key>ResponseCompression</key>
  <true/>

</dict>
</plist>

[CalendarServer-users] calendarserver behaves extreme slow, what is going on

Jelle de Jong