To remove that set, you need to delete all items in that set and ensure they have been cleaned up on persistent storage. After that, a rolling restart of the cluster will remove the set id.
For enterprise users, you can simply truncate the set and then do a rolling restart since the truncation command is durable in enterprise meaning it prevents data from coming back on rest.
This problem has been discussed in more detail here: