To delete a highly-available router, simply use the openstack router delete command shown here:
openstack router delete ROUTER
When all HA routers in a project are removed, the HA network used for communication between routers stays behind. That network will be reused upon the creation of HA routers at a later time.