The prison sections of Goblin Town should contain some item in there that incentivizes the player to open up the prison, such as a small amount of food. Better yet would be to have the prisoners themselves give such a reward to the player upon being freed.