You lose nothing by being polite. The answer is 'No', but please say it politely and give the reasons. ... Explain to me why 'No'. Don't change 'No' to 'Yes'. Don't be a fool. If there was a good reason why it is 'No', it must remain 'No', but the man must be told politely.
