Yeah. MEgamer is right.
Open up your box and grab your motherboard manual. Check that all of the sound leads are correct and not backwards, etc.
If that does not work, you probably have either a dud cable or a busted jack. You will not be able to make it work in this case.