Configuring automatic responses for alert categories