Apr 5, 2022Creating a Data Engineer’s Self-Serve PlatformData Engineering Product In the last 12 months, we have built a lot of self-serve platforms so the users can serve their happiness without asking for help. One of those is to create data pipelines for the domain modelling. Now it is straightforward, you model the data and load that…Data Engineering6 min readData Engineering6 min read
Published inAnalytics Vidhya·Feb 21, 2021MakeFile: Make Rules and AutomateMore like Hacks and Tips I didn’t know MakeFile four months back, but as I got to know, I liked it so much that everything I do with Python, is automated now. Here are few use cases, for which I always go to the Make command: If you don’t want…Makefile8 min readMakefile8 min read
Published inGoogle Cloud - Community·Feb 12, 2021How to work with Arrays and Structs in Google BigQueryIf you ever get confused about how to select or how to create Arrays or Structs in BigQuery then you are at the right place. Arrays and Structs are confusing, and I won’t argue on that. But before I come to the confusing part, let me first tell you a…Struct6 min readStruct6 min read
