I've been all over iManager, and can't do this.. under "modify object", when it comes to an organizational role (not speaking of RBS iManager configuration here), I see see the users added, can add more, but there is no way to remove users who no longer need to have that access.