"I think I would love it so much more if there wasn't that overhanging cultural pressure," the actor told PEOPLE of potentially taking over the spy role ...