I think the fact that the TV recognizes my Cable box audio and video using the same HDMI port and cable suggests it must be an Apple TV problem. However I haven't seen this issue mentioned by anyone. So maybe it's just a compatibility conflict between these two particular devices.
I'll now have to spend another $50 (half the price of the Apple TV!) on an optical to RCA adapter to get it working (sigh!).