Incident projects currently can't modify the issue configuration, to add additional fields or change the default ones.

(Tech note: this was actually caused by a bug we found just prior to launch, where our built-in fields didn't play nicely with additional custom fields, resulting in a broken configuration. For launch, we had to disable this functionality, and we'll restore it once the bug is fixed.)