One of my trips was to meet with the Gulf Cooperation Council with all the Saudi foreign ministers, and when we started the meeting I said 'Perhaps you've noticed that I'm not dressed the same as my predecessors", but no-one had a problem and I was never treated with anything other than respect...So I did not have problems with that, interestingly enough.
