This seems like a foolish question. I’m very early, I’ve reset s few times but never made it to metaphysics. Whenever I buy trade ships or new storage, I tend to cap the most basic buildings - things that only cost wood like libraries and mines. Is there a point where doing this is just a waste of time?
Essentially it’s to migrate workers from miner/woodcutter onto other jobs as you get further into the game.
As a general rule you would never want to stop building basic infrastructure.