No. It is not deleted. The application just interprets the product as deleted.
This restraint is held at the DB level. Therfore, the db entry must be deleted.
Delete the product manually in your DB. You may find more restraints keeping you from doing that, like inventory and descriptors.