I'm sure Adam or others will correct me if necessary, but I seem to recall the documentation saying you can do that by specifying <email address> as part of the SNMP contact value on the device, and whatever you put in config.php will cover those devices that don't have an email address specified in the device snmp contact value.

I could be wrong, it's been several weeks since I last read that part of the documentation.