We compute the one loop quadratic divergences to the effective potential of the matter scalars in N=1 supergravity. We discuss in some special instances (the Das-Freedman and the Deser-Zumino Lagrangians) the problem of supersymmetry gauge invariance. We comment on the relevance of the calculation to model building
