brittany bennettit should not be be this difficult to learn data engineering. there are so many resources for learning SQL. and for leaning Python. and courses for becoming an analyst or analytics engineer. but i find there’s a dearth of resources for mastering the best practices for data engineering — common patterns, pagination, working with APIs. i can’t be the only one
Michael Wexler@thebbennett You are thinking that DE is part of DS. What you mention at the end is traditional "database" tech: think Kimball data arch; data access patterns for non-cached direct storage access, etc. It's not all that new, it's just new to DS and usually not part of DS training.
Look at some of the feature store platforms: what are they abstracting away? Look at how folks use caching, in trad CRUD projects across many Medium posts. You'll discover a whole new world...