You can chat to the Minetown Watch to pacify them if they’re angry, but it requires high Charisma and Luck to pull off (and is never guaranteed). There probably also needs to be some limiting factor so that you can’t retry this.