November 2011 - calendarserver-dev - lists.macosforge.org

[Calendar and Contacts Server] #448: Server starts, but request issues "Message to long" error
by Calendar and Contacts Server 14 Aug '12

14 Aug '12

#448: Server starts, but request issues "Message to long" error -----------------------------+---------------------------------------------- Reporter: st.uf@… | Owner: wsanchez@… Type: Defect | Status: new Priority: 5: Not set | Milestone: Linux Port Component: Calendar Server | Severity: Other Keywords: | Radar: -----------------------------+---------------------------------------------- Hi, I have CalendarServer running on OpenSuse 11.3. It runs as its own user, so may it is a privileges problem... Nevertheless, the server starts up well (see below), but when I try to access it, I get an error message like "Message too long" (also see below). Is this some kind of misconfiguration? Best wishes, Stefan ---Log File--- Starting server... /home/calendar/DarwinCalDAVServer/Twisted/build/lib.linux- x86_64-2.6/twisted/mail/smtp.py:10: DeprecationWarning: the MimeWriter module is deprecated; use the email package instead import MimeWriter, tempfile, rfc822 Reading configuration from file: /home/calendar/DarwinCalDAVServer/CalendarServer/conf/caldavd-dev.plist 2011-05-22 21:23:08+0200 [-] Log opened. 2011-05-22 21:23:08+0200 [-] twistd 10.1.0 (/usr/bin/python2.6 2.6.5) starting up. 2011-05-22 21:23:08+0200 [-] reactor class: twisted.internet.selectreactor.SelectReactor. 2011-05-22 21:23:08+0200 [-] calendarserver.accesslog.AMPLoggingFactory starting on "'/home/didsrv/CalendarServerData/Logs/state/caldavd.sock'" 2011-05-22 21:23:08+0200 [-] calendarserver.tap.caldav.CalDAVStatisticsServer starting on "'/home/didsrv/CalendarServerData/Logs/state/caldavd-stats.sock'" 2011-05-22 21:23:08+0200 [-] [txdav.base.datastore.subpostgres#info] received postgres stdout 'waiting for server to start...' 2011-05-22 21:23:08+0200 [-] [txdav.base.datastore.subpostgres#info] received postgres stdout '.' 2011-05-22 21:23:09+0200 [-] [txdav.base.datastore.subpostgres#info] received postgres stdout ' done\nserver started\n' 2011-05-22 21:23:09+0200 [-] [txdav.base.datastore.subpostgres#info] postgres process ended <twisted.python.failure.Failure <class 'twisted.internet.error.ProcessDone'>> 2011-05-22 21:23:09+0200 [-] <class 'twext.web2.metafd.LimitingInheritingProtocolFactory'> starting on 8008 2011-05-22 21:23:09+0200 [-] <class 'twext.web2.metafd.LimitingInheritingProtocolFactory'> starting on 8443 2011-05-22 21:23:09+0200 [-] <class 'twext.web2.metafd.LimitingInheritingProtocolFactory'> starting on 8008 2011-05-22 21:23:09+0200 [-] <class 'twext.web2.metafd.LimitingInheritingProtocolFactory'> starting on 8443 2011-05-22 21:23:10+0200 [-] [caldav-0] /home/calendar/DarwinCalDAVServer/Twisted/build/lib.linux- x86_64-2.6/twisted/mail/smtp.py:10: DeprecationWarning: the MimeWriter module is deprecated; use the email package instead 2011-05-22 21:23:10+0200 [-] [caldav-0] import MimeWriter, tempfile, rfc822 2011-05-22 21:23:10+0200 [-] [caldav-0] Reading configuration from file: /home/calendar/DarwinCalDAVServer/CalendarServer/conf/caldavd-dev.plist 2011-05-22 21:23:10+0200 [-] [caldav-0] [-] Log opened. 2011-05-22 21:23:10+0200 [-] [caldav-0] [-] twistd 10.1.0 (/usr/bin/python2.6 2.6.5) starting up. 2011-05-22 21:23:10+0200 [-] [caldav-0] [-] reactor class: twisted.internet.selectreactor.SelectReactor. 2011-05-22 21:23:10+0200 [calendarserver.accesslog.AMPLoggingFactory] AMPLoggingProtocol connection established (HOST:UNIXAddress('/home/didsrv/CalendarServerData/Logs/state/caldavd.sock') PEER:UNIXAddress('')) 2011-05-22 21:23:10+0200 [-] [caldav-0] [-] AMP connection established (HOST:UNIXAddress(None) PEER:UNIXAddress('/home/didsrv/CalendarServerData/Logs/state/caldavd.sock')) 2011-05-22 21:23:14+0200 [-] Unhandled Error Traceback (most recent call last): File "/home/calendar/DarwinCalDAVServer/Twisted/build/lib.linux- x86_64-2.6/twisted/python/log.py", line 84, in callWithLogger return callWithContext({"system": lp}, func, *args, **kw) File "/home/calendar/DarwinCalDAVServer/Twisted/build/lib.linux- x86_64-2.6/twisted/python/log.py", line 69, in callWithContext return context.call({ILogContext: newCtx}, func, *args, **kw) File "/home/calendar/DarwinCalDAVServer/Twisted/build/lib.linux- x86_64-2.6/twisted/python/context.py", line 59, in callWithContext return self.currentContext().callWithContext(ctx, func, *args, **kw) File "/home/calendar/DarwinCalDAVServer/Twisted/build/lib.linux- x86_64-2.6/twisted/python/context.py", line 37, in callWithContext return func(*args,**kw) --- <exception caught here> --- File "/home/calendar/DarwinCalDAVServer/Twisted/build/lib.linux- x86_64-2.6/twisted/internet/selectreactor.py", line 146, in _doReadOrWrite why = getattr(selectable, method)() File "/home/calendar/DarwinCalDAVServer/CalendarServer/twext/internet/sendfdport.py", line 139, in doWrite sendfd(self.skt.fileno(), skt.fileno(), desc) File "/home/calendar/DarwinCalDAVServer/CalendarServer/twext/python/sendfd.py", line 42, in sendfd socketfd, description, 0, [(SOL_SOCKET, SCM_RIGHTS, pack("i", fd))] socket.error: [Errno 90] Message too long -- Ticket URL: <http://trac.calendarserver.org/ticket/448> Calendar and Contacts Server </> HTTP/WebDAV/CalDAV Server

1 5

[Calendar and Contacts Server] #410: remove derived translation files
by Calendar and Contacts Server 30 Jul '12

30 Jul '12

#410: remove derived translation files ----------------------------------+----------------------------------------- Reporter: mail@… | Owner: wsanchez@… Type: Defect | Status: new Priority: 5: Not set | Milestone: Component: Calendar Server | Severity: Other Keywords: | Radar: ----------------------------------+----------------------------------------- I am just looking into translations. It seems that with r3650 and r3651 the po files should not be the primary source anymore. But on startup .mo files are generated from the .lproj folder. If this is meant this way then please delete the .po and .mo files so people do not get confused. The .mo should be deleted anyways as they can be created from the .po at any time. -- Ticket URL: <http://trac.calendarserver.org/ticket/410> Calendar and Contacts Server </> HTTP/WebDAV/CalDAV Server

1 2

[Calendar and Contacts Server] #428: _parseConfigFromFile fails to parse the configuration file in Ubuntu.
by Calendar and Contacts Server 30 Jul '12

30 Jul '12

#428: _parseConfigFromFile fails to parse the configuration file in Ubuntu. ------------------------------------------------------------------------------------+ Reporter: sk@… | Owner: wsanchez@… Type: Defect | Status: new Priority: 1: Blocker | Milestone: Linux Port Component: Calendar Server | Severity: Serious Keywords: parser fail configuration ubuntu parseConfigFromFile caldavd-dev.plist | Radar: ------------------------------------------------------------------------------------+ The parser.parse() functions returns None from the following piece of code in CalendarServer/twistedcaldav/stdconfig.py def _parseConfigFromFile(self, filename): parser = NoUnicodePlistParser() configDict = None try: configDict = parser.parse(open(filename)) except (IOError, OSError): log.err("Configuration file does not exist or is inaccessible: %s" % (filename, )) raise ConfigurationError("Configuration file does not exist or is inaccessible: %s" % (filename, )) else: configDict = _cleanup(configDict, self._defaults) return configDict sangeetk@sk:/calendar/CalendarServer$ ./run -v Using system version of Zope Interface. Using system version of PyXML. Using system version of PyOpenSSL. Using system version of PyKerberos. A system version of xattr exists, but version is 0.4 (< 0.5). Current working copy (/calendar/xattr) is from the wrong URI: http://svn .red-bean.com/bob/xattr/releases/xattr-0.6.1 != http://svn.red- bean.com/bob/xattr/releases/xattr-0.6.1/ Performing repository switch for xattr... At revision 1038. Removing build directory /calendar/xattr/build... Removing pyc files from /calendar/xattr... Building xattr... Using system version of PyGreSQL. A system version of twisted exists, but version is 10.0.0 (< 10.1). Building Twisted... Using system version of dateutil. Building python-ldap... extra_compile_args: extra_objects: include_dirs: /usr/local/openldap-2.3/include /usr/include/sasl library_dirs: /usr/local/openldap-2.3/lib libs: ldap_r lber sasl2 ssl crypto file Lib/ldap.py (for module ldap) not found file Lib/ldap/schema.py (for module ldap.schema) not found file Lib/ldap.py (for module ldap) not found file Lib/ldap/schema.py (for module ldap.schema) not found Building SQLParse... Using system version of Pyflakes. Updating CalDAVTester... At revision 7290. Removing build directory /calendar/CalDAVTester/build... Removing pyc files from /calendar/CalDAVTester... Updating CalDAVClientLibrary... At revision 7290. Removing build directory /calendar/CalDAVClientLibrary/build... Removing pyc files from /calendar/CalDAVClientLibrary... Building pydoctor... Building our own extension modules... running build_ext Using python as Python Starting server... /calendar/Twisted/build/lib.linux-x86_64-2.6/twisted/mail/smtp.py:10: DeprecationWarning: the MimeWriter module is deprecated; use the email package instead import MimeWriter, tempfile, rfc822 Reading configuration from file: /calendar/CalendarServer/conf/caldavd- dev.plist Traceback (most recent call last): File "/calendar/Twisted/build/scripts-2.6/twistd", line 19, in <module> run() File "/calendar/Twisted/build/lib.linux- x86_64-2.6/twisted/scripts/twistd.py", line 27, in run app.run(runApp, ServerOptions) File "/calendar/Twisted/build/lib.linux- x86_64-2.6/twisted/application/app.py", line 621, in run config.parseOptions() File "/calendar/Twisted/build/lib.linux- x86_64-2.6/twisted/application/app.py", line 601, in parseOptions usage.Options.parseOptions(self, options) File "/calendar/Twisted/build/lib.linux- x86_64-2.6/twisted/python/usage.py", line 231, in parseOptions self.subOptions.parseOptions(rest) File "/calendar/Twisted/build/lib.linux- x86_64-2.6/twisted/python/usage.py", line 241, in parseOptions self.postOptions() File "/calendar/CalendarServer/calendarserver/tap/caldav.py", line 266, in postOptions self.loadConfiguration() File "/calendar/CalendarServer/calendarserver/tap/caldav.py", line 277, in loadConfiguration config.load(self["config"]) File "/calendar/CalendarServer/twistedcaldav/config.py", line 223, in load configDict = ConfigDict(self._provider.loadConfig()) File "/calendar/CalendarServer/twistedcaldav/stdconfig.py", line 756, in loadConfig configDict = self._parseConfigFromFile(self._configFileName) File "/calendar/CalendarServer/twistedcaldav/stdconfig.py", line 781, in _parseConfigFromFile configDict = _cleanup(configDict, self._defaults) File "/calendar/CalendarServer/twistedcaldav/stdconfig.py", line 1208, in _cleanup for key in configDict: TypeError: ''''NoneType'''' object is not iterable sangeetk@sk:/calendar/CalendarServer$ -- Ticket URL: <http://trac.calendarserver.org/ticket/428> Calendar and Contacts Server </> HTTP/WebDAV/CalDAV Server

1 3

[Calendar and Contacts Server] #415: calendarserver_bootstrap_database just works on english systems
by Calendar and Contacts Server 30 Jul '12

30 Jul '12

#415: calendarserver_bootstrap_database just works on english systems ----------------------------------+----------------------------------------- Reporter: mail@… | Owner: wsanchez@… Type: Defect | Status: new Priority: 5: Not set | Milestone: Component: Calendar Server | Severity: Other Keywords: | Radar: ----------------------------------+----------------------------------------- Hi, with r6920 a new calendarserver_bootstrap_database was added. It did not work for me doing some research I found the problem. source:/CalendarServer/trunk/calendarserver/tools/bootstrapdatabase.py?rev=6920#L76 just checks the output. The ouput does depend on the configuration in {{{/var/lib/pgsql/data/postgresql.conf}}} It just works with: {{{ lc_messages = 'en_US.UTF-8' # locale for system error message }}} My system had {{{de_DE.UTF-8}}} before. -- Ticket URL: <http://trac.calendarserver.org/ticket/415> Calendar and Contacts Server </> HTTP/WebDAV/CalDAV Server

1 4

[Calendar and Contacts Server] #397: Can't start caldavd binary Ubuntu 10.04
by Calendar and Contacts Server 19 Jul '12

19 Jul '12

#397: Can't start caldavd binary Ubuntu 10.04 --------------------------------------+------------------------------------- Reporter: clemens.kroell@… | Owner: wsanchez@… Type: Defect | Status: new Priority: 5: Not set | Milestone: CalendarServer-3.x Component: Calendar Server | Severity: Serious Keywords: | --------------------------------------+------------------------------------- clemens@hermann:/etc/caldavd$ sudo caldavd -X -L /usr/lib/python2.6/dist-packages/twisted/mail/smtp.py:10: DeprecationWarning: the MimeWriter module is deprecated; use the email package instead import MimeWriter, tempfile, rfc822 /usr/local/lib/python2.6/dist-packages/calendarserver/tap/caldav.py:50: DeprecationWarning: mktap and related support modules are deprecated as of Twisted 8.0. Use Twisted Application Plugins with the 'twistd' command directly, as described in 'Writing a Twisted Application Plugin for twistd' chapter of the Developer Guide. from twisted.scripts.mktap import getid Reading configuration from file: /etc/caldavd/caldavd.plist Removing stale pidfile /var/calendar/Logs/caldavd.pid 2010-08-25 12:25:31+0200 [-] Log opened. 2010-08-25 12:25:31+0200 [-] twistd 10.0.0 (/usr/bin/python 2.6.5) starting up. 2010-08-25 12:25:31+0200 [-] reactor class: twisted.internet.selectreactor.SelectReactor. 2010-08-25 12:25:31+0200 [-] /usr/lib/python2.6/dist- packages/twisted/application/internet.py:116: exceptions.DeprecationWarning: The mode parameter of IReactorUNIX.listenUNIX will be removed. Do not pass a value for it. Set permissions on the containing directory before calling IReactorUNIX.listenUNIX, instead. 2010-08-25 12:25:31+0200 [-] calendarserver.accesslog.AMPLoggingFactory starting on "'/var/calendar/Logs/caldavd.sock'" 2010-08-25 12:25:31+0200 [-] <class 'twext.web2.metafd.LimitingInheritingProtocolFactory'> starting on 8008 2010-08-25 12:25:31+0200 [-] calendarserver.tap.caldav.CalDAVStatisticsServer starting on "'/var/calendar/Logs/caldavd-stats.sock'" 2010-08-25 12:25:31+0200 [-] Traceback (most recent call last): 2010-08-25 12:25:31+0200 [-] File "/usr/bin/twistd", line 19, in <module> 2010-08-25 12:25:31+0200 [-] run() 2010-08-25 12:25:31+0200 [-] File "/usr/lib/python2.6/dist- packages/twisted/scripts/twistd.py", line 27, in run 2010-08-25 12:25:31+0200 [-] app.run(runApp, ServerOptions) 2010-08-25 12:25:31+0200 [-] File "/usr/lib/python2.6/dist- packages/twisted/application/app.py", line 693, in run 2010-08-25 12:25:31+0200 [-] runApp(config) 2010-08-25 12:25:31+0200 [-] File "/usr/lib/python2.6/dist- packages/twisted/scripts/twistd.py", line 23, in runApp 2010-08-25 12:25:31+0200 [-] _SomeApplicationRunner(config).run() 2010-08-25 12:25:31+0200 [-] File "/usr/lib/python2.6/dist- packages/twisted/application/app.py", line 423, in run 2010-08-25 12:25:31+0200 [-] self.postApplication() 2010-08-25 12:25:31+0200 [-] File "/usr/lib/python2.6/dist- packages/twisted/scripts/_twistd_unix.py", line 205, in postApplication 2010-08-25 12:25:31+0200 [-] self.startApplication(self.application) 2010-08-25 12:25:31+0200 [-] File "/usr/lib/python2.6/dist- packages/twisted/scripts/_twistd_unix.py", line 317, in startApplication 2010-08-25 12:25:31+0200 [-] app.startApplication(application, not self.config['no_save']) 2010-08-25 12:25:31+0200 [-] File "/usr/lib/python2.6/dist- packages/twisted/application/app.py", line 713, in startApplication 2010-08-25 12:25:31+0200 [-] service.IService(application).startService() 2010-08-25 12:25:31+0200 [-] File "/usr/lib/python2.6/dist- packages/twisted/application/service.py", line 278, in startService 2010-08-25 12:25:31+0200 [-] service.startService() 2010-08-25 12:25:31+0200 [-] File "/usr/lib/python2.6/dist- packages/twisted/application/service.py", line 278, in startService 2010-08-25 12:25:31+0200 [-] service.startService() 2010-08-25 12:25:31+0200 [-] File "/usr/local/lib/python2.6/dist- packages/txdav/datastore/subpostgres.py", line 401, in startService 2010-08-25 12:25:31+0200 [-] initdb = which("initdb")[0] 2010-08-25 12:25:31+0200 [-] IndexError: list index out of range clemens@hermann:/etc/caldavd$ -- Ticket URL: <http://trac.calendarserver.org/ticket/397> Calendar and Contacts Server </> HTTP/WebDAV/CalDAV Server

1 7

[CalendarServer] #342: Server doesn't start without http port
by CalendarServer 22 Jun '12

22 Jun '12

#342: Server doesn't start without http port ---------------------------------+------------------------------------------ Reporter: nicolas@… | Owner: wsanchez@… Type: Defect | Status: new Priority: 5: Not set | Milestone: Linux Port Component: Calendar Server | Severity: Security Keywords: https | ---------------------------------+------------------------------------------ On debian lenny disabling http (port set to 0) but with a valid https port (default 8443) the server doesn't start. Https only should be a valid option. -- Ticket URL: <http://trac.calendarserver.org/ticket/342> CalendarServer </> HTTP/WebDAV/CalDAV Server

2 3

[Calendar and Contacts Server] #466: Reliable ETag for GET on rolled-up calendar data
by Calendar and Contacts Server 06 Dec '11

06 Dec '11

#466: Reliable ETag for GET on rolled-up calendar data -----------------------------+---------------------------------------------- Reporter: apm@… | Owner: wsanchez@… Type: Feature | Status: new Priority: 5: Not set | Milestone: Component: Calendar Server | Severity: Other Keywords: | Radar: -----------------------------+---------------------------------------------- Doing a GET on a calendar collection to get rolled-up iCalendar data as an ".ics" file can be slow on large calendars. Therefore caching it and using HTTP conditional GET by ETags significantly improves performance if the calendar has not been changed. I see that CalendarServer 3.0 is no longer returning an ETag for the calendar collection resource on GET as described in: http://marc.info/?l=calendarserver-dev&m=126270712631748&w=2 So given the discussion in thread above and in Ticket #405, I'm hereby filing a request for a reliable ETag on calendar collections. -- Ticket URL: <http://trac.calendarserver.org/ticket/466> Calendar and Contacts Server </> HTTP/WebDAV/CalDAV Server

1 2

[Calendar and Contacts Server] #468: Cross domain queries in Web browsers
by Calendar and Contacts Server 01 Dec '11

01 Dec '11

#468: Cross domain queries in Web browsers -----------------------------+---------------------------------------------- Reporter: jan.mate@… | Owner: wsanchez@… Type: Enhancement | Status: new Priority: 3: Important | Milestone: Component: Calendar Server | Severity: Other Keywords: | Radar: -----------------------------+---------------------------------------------- It is impossible to access the calendarserver from javascript due to cross domain security limitations in modern browsers. To allow cross domain queries from javascript based caldav/carddav clients it is important to add several new headers to each response (see http://www.w3.org/TR/cors/) For example, to use my CardDavMATE client (fully javascript based) the user must patch the calendarserver (see the included patch). -- Ticket URL: <http://trac.calendarserver.org/ticket/468> Calendar and Contacts Server </> HTTP/WebDAV/CalDAV Server

1 2

[Calendar and Contacts Server] #470: Auto-schedule doesn't work
by Calendar and Contacts Server 01 Dec '11

01 Dec '11

#470: Auto-schedule doesn't work ---------------------------------+------------------------------------------ Reporter: brent@… | Owner: wsanchez@… Type: Defect | Status: new Priority: 2: Expected | Milestone: CalendarServer-3.1 Component: Calendar Server | Severity: Other Keywords: | Radar: ---------------------------------+------------------------------------------ Auto-schedule for principals doesn't appear to be working. I am using the release tagged 3.1. I have the XML file augment service configured: {{{  <key>AugmentService</key> <dict> <key>type</key> <string>twistedcaldav.directory.augment.AugmentXMLDB</string> <key>params</key> <dict> <key>xmlFiles</key> <array> <string>augments.xml</string> </array> </dict> </dict> }}} Augments.xml contains: {{{ <augments> <record> <uid>boardroom</uid> <enable>true</enable> <enable-calendar>true</enable-calendar> <enable-addressbook>true</enable-addressbook> <auto-schedule>true</auto-schedule> </record> </augments> }}} The boardroom calendar still needs to have events manually accepted. There appears to be no information in the logs regarding this, even set to debug. -- Ticket URL: <http://trac.calendarserver.org/ticket/470> Calendar and Contacts Server </> HTTP/WebDAV/CalDAV Server

1 4

[Calendar and Contacts Server] #469: incompatible with python-sqlparse 0.1.3 (Debian Testing)
by Calendar and Contacts Server 01 Dec '11

01 Dec '11

#469: incompatible with python-sqlparse 0.1.3 (Debian Testing) ---------------------------------+------------------------------------------ Reporter: patrick.ohly@… | Owner: wsanchez@… Type: Enhancement | Status: new Priority: 5: Not set | Milestone: Component: Calendar Server | Severity: Other Keywords: | Radar: ---------------------------------+------------------------------------------ When starting the server with the system's python-sqlparse 0.1.3 instead of the version 0.1.2 that it would use as fallback, the server fails with: ... File "/home/pohly/src/CalendarServer/CalendarServer/twext/enterprise/dal/parseschema.py", line 232, in nextColumn return self.parseColumn(maybeIdent.value) File "/home/pohly/src/CalendarServer/CalendarServer/twext/enterprise/dal/parseschema.py", line 307, in parseColumn theType = SQLType(typeName.value.encode("utf-8"), typeLength) AttributeError: 'NoneType' object has no attribute 'encode' Adding some print statements showed that it fails for varchar entries: txdav/common/datastore/sql_schema/current.sql create table CALENDAR_HOME ( RESOURCE_ID integer primary key default nextval('RESOURCE_ID_SEQ'), => OWNER_UID varchar(255) not null unique ); In python-sqlparse, typeName.value was "varchar", same as the string representation of typeName itself. Based on that observation here's a crude patch which uses str(typeName) as default. Works for me, no idea whether it is the right fix... diff --git a/CalendarServer/twext/enterprise/dal/parseschema.py b/CalendarServer/twext/enterprise/dal/parseschema.py index 0978b5f..4e3fcb1 100644 --- a/CalendarServer/twext/enterprise/dal/parseschema.py +++ b/CalendarServer/twext/enterprise/dal/parseschema.py @@ -304,7 +304,7 @@ class _ColumnParser(object): # something else typeLength = None self.pushback(maybeTypeArgs) - theType = SQLType(typeName.value.encode("utf-8"), typeLength) + theType = SQLType((typeName.value or str(typeName)).encode("utf-8"), typeLength) theColumn = self.table.addColumn( name=name.encode("utf-8"), type=theType ) -- Ticket URL: <http://trac.calendarserver.org/ticket/469> Calendar and Contacts Server </> HTTP/WebDAV/CalDAV Server

1 4