The FERMI Project aims to achieve very high-brightness photon beam pulses of minimum bandwidth. These goals can be marred by the presence of large wakefields along the undulator small-gap vacuum chamber. Estimations of the induced energy-spread caused by the resistive wall and surface roughness wakefields along the FERMI FEL undulator are presented. The energy spread and losses induced by resistive wall wakefield are determined for three possible transverse geometries of the vacuum chamber, namely circular, rectangular and elliptic cross-section, while the energy spread and losses induced by the surface roughness wakefields are obtained for the circular cross-section case. In this last case in-house surface profile measurements carried on a spare vacuum chamber of ELETTRA are used to provide realistic estimates.