fix: wait for workers exit at worket set stop