Data Engineering Experts on Decade-Long Industry Constants

5 things that still remain true for data engineers and teams even after a decade. 1. Dashboards And Queries Are Still Slow - This one really surprised me. I am still coming across companies with minute long queries and dashboards that they are servicing to the business. As one person told me, if it takes more than 45 seconds, people will assume it’s broken. 2. Data Modeling Remains Essential - Some companies have used new methods to manage and model their data  as Zach Wilson brought out with his recent article. But generally speaking, getting all your data in a central location for analytics in an organized fashion that a wider variety of end-users can understand and work with is needed. 3. Batch Processing Is Still The Backbone Of Most Data Platforms - The tools we have to ingest data in real-time are far easier to set-up today but batch still tends to be the one most data teams rely on. Most of the time, because it’s all they need. 4. Business Alignment Trumps Tools - Tools solve a lot of technical problems and they have made most of our lives so much easier. But if you're just adding tools to your data stack for the sake of it, you're going to have a bad time. 5. Data Quality and Validation - And of course, there is still a need to ensure your data makes sense. I don't think data teams can just throw their hands in the air and always blame the data. We need to have systems in place that help us better validate whether data is good or bad before it's pushed downstream. I am working on an article about what I have seen actually change. But I'd love to hear from you on both sides. What remains the same and what has changed?