Scripts are a thing for a reason. If you got a bunch of high-profile actors together, threw them on a set, and screamed "Action!" at them, the result would be some sort of awkward chaos.
But then there are those times where going off script probably wasn't necessary, but absolutely made a scene into something more amazing than it was going to be. These are those scenes.