There being fewer children does feather the effects a little though.

Neither children nor elderly work. Being that children cost more (require more labor input) than elderly, there is a surplus from having fewer children.