Stop resilver on flaky disk

I have a raidz2 on a bunch of old drives. I have changed one of the drives with a zpool replace, the resilver is in progress (awfully slow but whatever). However, a second disk started doing write errors which didn’t cause it to fail but rather to trigger a second resilver. I’d like to stop that, wait for the first resilver to complete and then replace that drive too.
How am I supposed to do that? I’ve put the drive offline, I can neither detach nor remove it.