The charge of magic is legendary and its based off of Christians in the 2nd century.

Justin Martyr, Tertullian, Athenegoras, Origen had to defend Jesus against the accusation of magic because in pagan circles, magic was a negative stereotype that wound up in Egypt (also in Exodus).