Also, make sure you are only listening to the mike, not the second audio track which (probably) is the camera mike, picking up the room noise.
If you have two tracks of audio connected to the speaker, try turning one down and see if this helps. If it sounds worse, turn the other one down.
If it's 'stereo', unlink the stereo first.