Those are the rules. To improvise in a movie with other people, when they're following a script, everybody has to know what's going on. I think a line or two we might change. Certainly, I do. But I wouldn't call it improvising. I'd call it fudging the lines.
