I'm no expert, but that sounds backwards. When your switch is "1" you should be in "Heading Hold", which means your tail servo will not go back to center when you release the control stick. Does the gyro have any indication when in "Heading Hold", like a light or something?
When your switch is "0" you should be in "Rate", meaning your servo will go back to center.