Basically, and I’m generalizing but still, all those diseases that Europeans brought over to the Americas came from domesticated European animals. On the other hand there weren’t really domesticated animals in the Americas (lamas but barely). So there weren’t really epidemic diseases in the Americas to infect Europeans.

This one fact basically explains the entirety of the history between these two hemispheres.