@jordyd without knowing your specific chipset, there might be something in pauvcontrol (or alsamixer if you’re oldschool) about an optical output that you could disable.
(incidentally the old airport express has the same thing happen, just... normally)