Sum frequency generation (SFG) spectroscopy was used to study CO adsorption on smooth and rough Ir(111) single crystal surfaces, the cleanliness, composition, order and morphology of which were comprehensively characterized by Auger electron spectroscopy (AES), low energy ion scattering (LEIS), low energy electron diffraction (LEED), and scanning tunneling microscopy (STM). For CO adsorbed on Ir(111), the resonant SFG signal intensity associated with the internal C-O stretch mode was about eight times stronger on a rough termination than on a smooth surface. Herein, we thoroughly discuss the origin of this phenomenon and consider several possible contributing factors, including coverage and lateral interactions, molecular hyperpolarizability (IR dipole moment and Raman polarizability), adsorption geometry (tilt angle), Fermi resonances, adsorbate hot vibrational bands, and surface plasmons and electronic structure. It is concluded that the sputter-induced local roughness of the Ir surface (grains evidenced by STM) facilitates the light-induced excitation of localized surface plasmon resonances (LSPR), accounting for the observed signal enhancement.