The lighting behind the negative also is critical - you cannot have both, usually: good ad balanced contrast or maximum reolution and sharpness. See for "condensor" and "diffusor" light heads of enlargers. Diffusors are less critical for small dust particles because they caus a certain softness. Condensors bringt out the last detail - of hairs, grain, scratches and dust.
And the smaller the film format, the more perfect your scanning/macrophoto process has to be.