added a kill all spiders function so that we can start to terminate a run and then restart it at the same point
