The issue is Yahoo is altering the ATTENDEE value in a way that Calendar Server doesn’t recognize it anymore.

Note that when Yahoo sends the reply, the ATTENDEE now has “\;X-COMMENT=\;” appended to it:

2013-08-08 10:44:05-0700 [-] [mailgateway]  ATTENDEE;CN=xxxxx@yahoo.com;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTS
2013-08-08 10:44:05-0700 [-] [mailgateway]   TAT=ACCEPTED:mailto:xxxxx@yahoo.com\;X-COMMENT=\;

I don’t know yet whether this is valid — I’ll have to check with someone more versed in ICALENDAR than I — but it’s probably what’s throwing off Calendar Server, and it’s setting the SCHEDULE-STATUS to “Service Unavailable” to give an indication that the reply could not be processed.  I’ll have to find out if this is something we need to ask Yahoo to fix.

If you invite a gmail user to a meeting and they reply via the gmail web UI, does it work?  That’s often how I test IMIP.  I just tried sending an invite to a Yahoo account and I got similar behavior to yours, while inviting a gmail user works.

~morgen

On Aug 8, 2013, at 12:07 PM, Technical Operations <tech@precisionpost.com> wrote:

Hi,

Running Calendar Server on OS X 10.8.4 and iCal clients on OS X 10.6.8.

I have internal events working. External iMIP events get sent out, and it appears that they're also fetched from the email account - but iCal doesn't update the events. Server's own mail service is off. Our email is hosted by gmail (Google Apps for Business).

Steps to recreate:
  1. Create event and invite an external invitee (masked as xxxxx@yahoo.com)
  2. Gmail shows the event was sent out
  3. Yahoo receives the event, and Yahoo's webmail allows to respond to caldav events.
  4. Gmail receives the caldav response from yahoo
  5. The response gets marked as read on its own, indicating that Calendar Server polled the account
  6. Organizer's iCal doesn't update with the invitee's response. (Just an exclamation mark next to the invitee's email)

I enabled debug logging on the server and client and scoured the logs. I was unable to pinpoint a problem - from my limited understanding, everything appears ok from the server's perspective.  On the client's iCal logs I just see that in all the client's DAVGETs, PARTSTAT for the attendee is NEEDS-ACTION instead of ACCEPTED.

I'm testing with Yahoo mail since it supports iMIP, but we see the same behavior from Outlook attendees.


A few excerpts from the server's caldavd logs:

2013-08-08 10:44:05-0700 [-] [mailgateway] 2013-08-08 10:44:05-0700 [POP3DownloadProtocol (TLSMemoryBIOProtocol),client] [twistedcaldav.mail.POP3DownloadProtocol#debug] POP downloaded message 0
2013-08-08 10:44:05-0700 [-] [mailgateway] 2013-08-08 10:44:05-0700 [POP3DownloadProtocol (TLSMemoryBIOProtocol),client] [twistedcaldav.mail.POP3DownloadFactory#debug] POP factory handle message
2013-08-08 10:44:05-0700 [-] [mailgateway] 2013-08-08 10:44:05-0700 [POP3DownloadProtocol (TLSMemoryBIOProtocol),client] [twistedcaldav.mail.POP3DownloadFactory#debug] Delivered-To: calendar+56cec50a-ea27-4bfa-8d57-6b8362631fce@ourcompany.com

2013-08-08 10:44:05-0700 [-] [mailgateway] SUMMARY:Accepted: yahoo
2013-08-08 10:44:05-0700 [-] [mailgateway] ATTENDEE;CN=xxxxx@yahoo.com;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTS
2013-08-08 10:44:05-0700 [-] [mailgateway] TAT=ACCEPTED:mailto:xxxxx@yahoo.com\;X-COMMENT=\;
2013-08-08 10:44:05-0700 [-] [mailgateway] ORGANIZER;CN=Drew Lahat:mailto:calendar+56cec50a-ea27-4bfa-8d57-6b8362631fce
2013-08-08 10:44:05-0700 [-] [mailgateway] @ourcompany.com

[twistedcaldav.mail#debug] Injecting to https://localhost:8443/inbox/: {'Originator': 'mailto:xxxxx@yahoo.com', 'Recipient': 'urn:uuid:4D380678-70D3-4C0D-AE54-F107C91B533E', 'Content-Type': 'text/calendar', 'x-calendarserver-internal': 'r8eBoszTjYaQJtGM'} BEGIN:VCALENDAR
013-08-08 10:44:05-0700 [-] [mailgateway] ATTENDEE;SCHEDULE-STATUS="5.1;Service unavailable":mailto:xxxxx@yahoo.
2013-08-08 10:44:05-0700 [-] [mailgateway] com

2013-08-08 10:44:05-0700 [-] [mailgateway] STATUS:CONFIRMED
2013-08-08 10:44:05-0700 [-] [mailgateway] SUMMARY:Accepted: yahoo

2013-08-08 10:44:08-0700 [-] [caldav-2]  [-] [twistedcaldav.scheduling.processing#debug] ImplicitProcessing - originator 'mailto:xxxxx@yahoo.com' to recipient 'urn:uuid:4D380678-70D3-4C0D-AE54-F107C91B533E' processing METHOD:REPLY, UID: '7EBA3AB4-A04B-4CF8-84A0-01578C774F60' - updating event
2013-08-08 10:44:08-0700 [-] [caldav-2]  [-] [txdav.common.datastore.sql_legacy.MemcachedUIDReserver#debug] Reserving UID '7EBA3AB4-A04B-4CF8-84A0-01578C774F60' @ <Calendar: 8>

2013-08-08 10:44:08-0700 [-] [caldav-2]  [PooledMemCacheProtocol,client] [twistedcaldav.notify.Notifier#debug] Notifications are enabled: update default CalDAV|4D380678-70D3-4C0D-AE54-F107C91B533E
2013-08-08 10:44:08-0700 [-] [caldav-2]  [PooledMemCacheProtocol,client] [twistedcaldav.notify.NotifierFactory#debug] Sending to notification server: update CalDAV|4D380678-70D3-4C0D-AE54-F107C91B533E
2013-08-08 10:44:08-0700 [-] [caldav-2]  [PooledMemCacheProtocol,client] [twistedcaldav.notify.Notifier#debug] Notifications are enabled: update collection CalDAV|4D380678-70D3-4C0D-AE54-F107C91B533E/calendar


2013-08-08 10:44:08-0700 [-] [mailgateway] 2013-08-08 10:44:08-0700 [AuthorizedHTTPGetter (TLSMemoryBIOProtocol),client] [twistedcaldav.mail#info] Mail gateway successfully injected message <247108620.64264.1375983795365.JavaMail.zimbra@store156.c106.cal.gq1.yahoo.com>
2013-08-08 10:44:08-0700 [-] [mailgateway] 2013-08-08 10:44:08-0700 [POP3DownloadProtocol (TLSMemoryBIOProtocol),client] [twistedcaldav.mail.POP3DownloadFactory#debug] POP factory connection lost
2013-08-08 10:44:08-0700 [-] [mailgateway] 2013-08-08 10:44:08-0700 [POP3DownloadProtocol (TLSMemoryBIOProtocol),client] [twistedcaldav.mail.POP3DownloadFactory#debug] Scheduling next POP3 poll
2013-08-08 10:44:08-0700 [-] [notifications] 2013-08-08 10:44:08-0700 [-] [twistedcaldav.notify.Coalescer#debug] Time to send: CalDAV|4D380678-70D3-4C0D-AE54-F107C91B533E
2013-08-08 10:44:08-0700 [-] [notifications] 2013-08-08 10:44:08-0700 [-] [twistedcaldav.notify.Coalescer#debug] Time to send: CalDAV|4D380678-70D3-4C0D-AE54-F107C91B533E/55A6B27E-E6A2-456B-97E5-C547FAC3ACD9
2013-08-08 10:44:08-0700 [-] [notifications] 2013-08-08 10:44:08-0700 [-] [calendarserver.push.applepush.ApplePushNotifierService#debug] Sending 3 APNS notifications for /CalDAV/ppserver.ourcompany.com/4D380678-70D3-4C0D-AE54-F107C91B533E/
2013-08-08 10:44:08-0700 [-] [notifications] 2013-08-08 10:44:08-0700 [-] [calendarserver.push.applepush.APNProviderProtocol#debug] Sending APNS notification to 2de124a10fb99cc2cdcd3fa53221a316b74fed61b1484b1b419dbc09a6be2839: id=10 payload={"key" : "/CalDAV/ppserver.ourcompany.com/4D380678-70D3-4C0D-AE54-F107C91B533E/"}

2013-08-08 10:44:12-0700 [-] [caldav-2]  [PooledMemCacheProtocol,client] [calendarserver.provision.root#info] Unauthenticated user denied by SACLs

((Is this latest message related at all, or a complete different user? No idea, I'm not seeing any user-identifying information adjacent, only caching messages. Obviously the user has the SACLs given its ongoing interaction with the server.))

“Unauthenticated user denied by SACLs” just means the client made a request without the HTTP authentication headers.  This happens often with Digest auth because when the server sees the first request it will send back an HTTP response with a Digest challenge, and the client is then supposed to repeat the HTTP request with the appropriate auth response.



Excerpt from the client's iCal:

Aug  8 10:45:49 LahatTech iCal[376]: -[DAVRequest:0x116f067c0 _readStreamEvent:] READ\n<?xml version='1.0' encoding='UTF-8'?>\n<multistatus xmlns='DAV:'>^M\n  <response>^M\n    <href>/calendars/__uids__/4D380678-70D3-4C0D-AE54-F107C91B533E/calendar/7EBA3AB4-A04B-4CF8-84A0-01578C774F60.ics</href>^M\n    <propstat>^M\n      <prop>^M\n        <getetag>"05d8aa30887f019dbca353228a5b404b"</getetag>^M\n        <calendar-data xmlns='urn:ietf:params:xml:ns:caldav'><![CDATA[BEGIN:VCALENDAR^M\nVERSION:2.0^M\nCALSCALE:GREGORIAN^M\nPRODID:-//Apple Inc.//iCal 4.0.4//EN^M\nBEGIN:VTIMEZONE^M\nTZID:America/Los_Angeles^M\nBEGIN:DAYLIGHT^M\nDTSTART:20070311T020000^M\nRRULE:FREQ=YEARLY;BYDAY=2SU;BYMONTH=3^M\nTZNAME:PDT^M\nTZOFFSETFROM:-0800^M\nTZOFFSETTO:-0700^M\nEND:DAYLIGHT^M\nBEGIN:STANDARD^M\nDTSTART:20071104T020000^M\nRRULE:FREQ=YEARLY;BYDAY=1SU;BYMONTH=11^M\nTZNAME:PST^M\nTZOFFSETFROM:-0700^M\nTZOFFSETTO:-0800^M\nEND:STANDARD^M\nEND:VTIMEZONE^M\nBEGIN:VEVENT^M\nUID:7EBA3AB4-A04B-4CF8-84A0-01578C774F60^M\nDTSTART;TZID=America/Los_Angeles:20130808T213000^M\nDTEND;TZID=America/Los_Angeles:20130808T220000^M\nATTENDEE;CN=xxxxx@yahoo.com;CUTYPE=INDIVIDUAL;EMAIL=xxxxx@yahoo.co^M\n m;PARTSTAT=NEEDS-ACTION;ROLE=REQ-PARTICIPANT;RSVP=TRUE;SCHEDULE-STATUS=2.0^M\n :mailto:xxxxx@yahoo.com^M\nATTENDEE;CN=Drew Lahat;CUTYPE=INDIVIDUAL;PARTSTAT=ACCEPTED:urn:uuid:4D3806^M\n 78-70D3-4C0D-AE54-F107C91B533E^M\nCREATED:20130808T174219Z^M\nDTSTAMP:20130808T174230Z^M\nORGANIZER;CN=Drew Lahat:urn:uuid:4D380678-70D3-4C0D-AE54-F107C91B533E^M\nSEQUENCE:3^M\nSUMMARY:yahoo^M\nTRANSP:OPAQUE^M\nEND:VEVENT^M\nEND:VCALENDAR^M\n]]></calendar-data>



Thanks,
Drew Lahat


_______________________________________________
calendarserver-users mailing list
calendarserver-users@lists.macosforge.org
https://lists.macosforge.org/mailman/listinfo/calendarserver-users