Yes, he had a sadistic streak about him. I had heard while I was living in the ashram all the way back then how he abused people for fun, it seemed Milky especially. (I need to point out that this is hearsay, since I heard it from someone who I am pretty sure was not a witness).
I don't really know much about pedophilia, but I always understood it to be a specific compulsion, so not directly associated with liar, fraud, con and bully. And with your own kids, it is just a special kind of sickness.
But maybe it does all fit together. Because his other meanness perhaps does reflect on abuse he himself had experienced and was passing it on. Who the hell knows, but we are all born babies and something makes us into what we become. And if you are sexually abused as a child, perhaps that tends to make you into one as well.