I always thought of it as a sort of class difference. The women in the tower were privileged almost akin to royalty, and anything else was beneath them. So the women who learned to channel on their own were looked down upon simply because they didn't have the "privilege" of being in the white tower.