The MLOps movement and associated new tooling is starting to help tackle the very real technical debt problems associated with machine learning in production.
Using config files to specify infrastructure for training isn't widely practiced in the machine learning community, but it helps a lot with reproducibility.
Software engineering best practices have not been brought into the machine learning space, with the side-effect that there is a great deal of technical debt in these code bases.