If you need to only compile an extension module for a subset of a universal build’s architectures, you should be able to use the ARCHFLAGS env variable to tell setuptools or Distutils to do so. At least, that is supposed to work.
ARCHFLAGS="-arch x86_64”