Matt Damon: Brad Pitt & Angelina Jolie 'Are Like Prisoners'

 

Matt Damon (left) and Angelina Jolie and Brad Pitt

For an Oscar-winning, top box-office star who has also been PEOPLE's Sexiest Man Alive, Matt Damon happily lives life low-key.

He can't say that for some of his high-profile pals.

"I have friends who are like prisoners. Brad Pitt and Angelina Jolie, for instance," Damon, 40, told German television TELE 5 over the weekend. "They can't just go someplace. If they go for a walk, it turns into an international incident."

In contrast, says Damon, "I'm really lucky, because I have the best of both worlds. I do the work that I love and need, but don't need paramilitary troops to protect me when I walk out my front door."

Besides, fame just isn't Damon's game.

"Ever since I found my wife [Luciana] and we had children, my whole life revolves around that. It gave my life a dramatic change in direction," he says.

Married in 2005, the couple have four daughters.

"I'm not as crazy as most of the other stars. I don't really know why, probably because I married a woman who isn't an actress. And we live in New York," he said. "As long as we don't show up in typical tourist spots, we can walk the streets without being noticed. New Yorkers are very cool, they don't flip out if they see me."