Comment #⁨1⁩

It also triggers when ending the text with ")" before the colon. As in "This is my text (which is ending now):" - this is where I mostly hit it.

You ask to "disable" the quick access. I would suggest a toggle instead.

Another way to keep it almost as-is, is to make it a double colon (or other character).
If not sticking to colon as the character, semicolon is also good - as it sort of denotes a wink smiley. Easy to remember.