This seems like a foolish question. I’m very early, I’ve reset s few times but never made it to metaphysics. Whenever I buy trade ships or new storage, I tend to cap the most basic buildings - things that only cost wood like libraries and mines. Is there a point where doing this is just a waste of time?
You will always want to build the basic things because there is a point where the cost creep makes the more advanced things less efficient than the basic things.
Essentially it’s to migrate workers from miner/woodcutter onto other jobs as you get further into the game.
As a general rule you would never want to stop building basic infrastructure.