Rolling restarts without Quiesce and "fail_key_busy" - Corelation or causation?

Well fail_key_busy is pushing back because of contention. If you have nodes out or have ongoing migration, the cluster is under increased stress. It does make some sense that there is an increase, as transactions will take longer. You can read more about tuning here Hot Key error code 14