It's still not that bad. I found that with the construction bonuses I take at game setup, I can still build a minimal SY I base in 2 turns from a colony with any pop and a SYIII planet facility. Then I can retrofit to SYIII's in 1 turn.
It's not THAT big of an impact (except of course with your existing plans
).