I had a server fail, and it had a r/w replica. I tried to remove it in
ConsoleOne and it is 'dying' for 4 days now. I can't add a new server,
or otherwise change any other replicas.

What can I do with it?

When I run a report in DSREPAIR it shows -622 and -625 for that server.
It was End of Life and will not be repaired.