My PCs had an easy time with the swarm killing it in a single round. With the two rounds of warning while the swarm climbed the shaft they spread oil in two squares and then lit them with an alchemist fire that they had. The smell of charred acid beetles was pretty revolting though.