If we can overcome resource and energy scarcity, I don't see why we couldn't support an arbitrarily large population comfortably. Unemployment is not a reason to downsize the population, it just means we're outgrowing or current economic system.