Because people try to kill and eliminate everything that they don't understand. And "witches" "sorcerers" and etc in their own time often were of course not magic users, but people, whom church saw as blasphemous.