The “Remove Endpoint” does not remove the endpoint but it marks it as “pending to remove” and it actually removes it when you click the “Save” button. If you click on “Remove Endpoint” and right after that, try to add a new endpoint with the same URL, it throws an error.
In order to avoid it, click “save” after clicking "Remove Endpoint”.