Cal thinks about this.

"Not seen. Heard, maybe? I dunno, we were on the phone and I was pretty drunk."

He knows Sherlock was not happy during that conversation, though now that he thinks about it, he probably waited until after the initial anger had passed before he called Cal.

(There may be other occasions, but it's only natural for that particular instance to come readily to mind right now.)