No, your tax number will not be deleted. Even if you move or close your business, it will remain in the system and will simply become inactive. You can inform the relevant tax office of any changes.