National Police Commissioner Riah Phiyega said on Tuesday that police officers with criminal records could not simply be fired.