There is no ‘delete user’ functionality in the system.
The effect of ‘inactivate user’ is that, the user will no longer have access to that community (assuming the user is associated with only one unit – else the user needs to be inactivated from all units).
You can activate the user again, by going to ‘Inactive Members’ tab on the Directory->Members screen and clicking Re-activate User icon.