You could try configuring the SSLPassPhraseDialog key to an appropriate program on your system. The problem is I don't know if this will work if the program you specify needs to interact with a tty to prompt for the passphrase because the calendar server worker processes don't have a tty as far as I know.