All of the gospels do indicate that Jesus did drive out the moneychangers, but it does not at all indicate that he harmed them. He was angry and did overturn inanimate objects, but we have zero indication that he used violence on another human being. In fact, in several of the passages the account ends by saying that the religious leaders were looking for a way to accuse Jesus of some wrongdoing, but could find nothing. It's hard for me to believe that if Jesus was whipping or assaulting people that there wouldn't be any grounds on which the religious leaders could accuse Jesus. It seems very clear that this is not a case of Christ using violence on other humans.