I think the apple earphones are badly (cheaply) designed, like most bundled headphones.
Although I expect better from apple, it isnt surprising. There is a tutorial
here explaining how to put other earphones on the apple cables, giving you good quality speakers with an inline mic and button!
Might be worth a try if you are getting no luck...?