Can I deactivate an organization without deleting it?

Yes. Each organization has an Active flag. Deactivating it hides it from dropdowns and filters while preserving all historical data (projects, timesheets, etc.) linked to it.