drivers side

My driver side view mirror will not adjust left to right. It will adjust up and down. The passenger side adjusts all 4 ways so I know the switch is good. Any ideas?