Here are 4 different application windows with different actions for closing the windows. Sometimes it says 'Close', sometimes 'OK'. All times there is a native OS close option.

Personally, I think less is more, and you can just get rid of them all together and just let the user use the native OS windowing [X] to close them. Reduce decision fatigue with fewer options to consider and a cleaner UI.