Data Engineer, Data Engineering, Software Engineering, AI, Big Data.
100x since 2020. This is a good problem to have because it means our business is expanding, but it also poses some tricky technical challenges 📖┆Data Engineering Best Practices — #2. Metadata & Logging ✍ Joseph M. Dealing with breaking pipelines, debugging why they failed, and putting up a fix are