Sumit Mittal @bigdatasumit

5 Important New Databricks & Gen-AI post for Data engineers. These Linkedin post are in great depth & newly created. 1. How Databricks is steadily becoming the operating system for data engineering. lnkd.in/e9-Qik26 2. All you need to know about Deletion Vectors in…

Still think Databricks = Spark? You’re missing 80% of the story. Over the years Databricks has evolved as a End to End Data Platform. When we talk about Data Engineering, Databricks now offers - Lakeflow Connect (for data Ingestion) - Lakeflow Declarative Pipelines (for ETL,…

Microsoft - Rejected Amazon - Rejected Walmart - Rejected Morgan Stanley - Rejected Goldman Sachs - Rejected Cisco - Selected That was my history of on-campus placements at NIT Trichy. I went till final rounds of many of these companies and missed them by an inch. I felt…

6 Offers cracked from below companies, my brilliant student Mayank joined Epam Systems - Publicis Sapient - LTI Mindtree - Tech Mahindra - Epam Systems - EY - Yash Technologies Reading his message made me so happy that my Data Engineering course is bringing such impact on my…

In Gen AI, the winners aren’t the ones who wait. They’re the ones who start small and start now. Gen AI is not one skill. It’s a stack of opportunities: Level 0: Be an end user who knows how to use ChatGPT effectively Level 1–3: Build real-world solutions with APIs, RAG, and…

Databricks is one of the most in-demand technology in Data Engineering right now. Recently I launched an 8 weeks in-depth Databricks Expert Program Here is the high level curriculum What is Databricks & Why Databricks Databricks Free Edition vs Azure Databricks High Level…

If you complete these 10 videos, you will master SQL Window functions! session 1 - Group By Vs Window Functions | Partition By & Order By Clause lnkd.in/gV_pWiW4 session 2 - ROW NUMBER with Example Use-case lnkd.in/gDbPhv5F session 3 - RANK Vs DENSE_RANK Vs…

I keep interacting which my some of my students who opted for Gen AI for Data Engineers program. Many of them have now started to work on Gen AI poc's within their organization. There is a constant push from the management to develop something meaningful using Gen AI. The ones…

Extremely happy to Launch 2 in-depth Databricks programs When I interact with Leaders in Data Engineering, its clear that Databricks is the top choice. This is even confirmed in multiple polls that I have conducted. 75% of Data Engineers suggest Databricks. Here are the…

Here are 7 Top playlists for Data Engineers 1. Python for Data Engineers - lnkd.in/gwsTQRgR 2. SQL - lnkd.in/gdnhRk8b 3. SQL Advanced - lnkd.in/g8tyEKbU 4. SQL Leetcode - lnkd.in/gKeSMPmW 5. Git & Git Hub for Data Engineers -…

Databricks is no longer just Spark in the cloud. It’s steadily becoming the operating system for data engineering. In the past, building a reliable data platform meant stitching together: - One tool for ingestion - Another for transformation - A separate orchestrator -…

All you need to know about Deletion Vectors in Databricks Lets remember the time when there were no deletion vectors, lets say if we have a file1 with 1 million records, and we are just deleting 1 record from that file, what will databricks do in this case? It will create a…

Are you confused with following questions - I have over 10 years of experience in (support/mainframes/testing), how to transition to Data Engineering - How will I justify my previous experience, and get interview calls - What should be the learning roadmap - Will I be able to…

Are you confused with following questions - I have over 10 years of experience in (support/mainframes/testing), how to transition to Data Engineering - How will I justify my previous experience, and get interview calls - What should be the learning roadmap - Will I be able to…

Let’s connect Live Tomorrow, 23rd Aug. 2025 @ 11:30 AM To all IT Professionals working in any domain and looking to Transition into Data Engineering. I will be addressing all your individual queries in this session. You might have several doubts which would be holding your…

Follow this to become a Top Data Engineer Prerequisites --------------------- 1. Programming fundamentals 2. SQL Basics You should learn the below things -------------------------------------- 1. Distributed Computing Fundamentals 2. Data Lake Concepts 3. One data ingestion…

How does Gen AI impact Data Engineers? I keep getting this question, almost every time. Let me answer this to you all. But before that Let me tell a little bit about Gen AI. When I talk to working professionals I can sense, they know Gen AI is really Important. But, what they…

78% of Nvidia staff are millionaires. OpenAI is reportedly granting retention bonuses to one-third of its workforce. Staffers of OpenAI to sell $6 billion in stock to SoftBank, other investors. We all have 2 choices 1. Keep reading these news and fact check whether they are…

100% hike on fixed as Lead Data Engineer Receiving a message from my brilliant student Pradeep, made my day. Cracking 7 Offers from below companies, he decided to join Impetus. - IBM - Genpact - MRI Software - HCL - Impetus - Insight - Marlabs - Altimetric When he says - Your…

Announcing my new YouTube playlist on Data Engineer Interview Preparation starting from 21st August. In this I will come with DE interview questions and solutions asked in top companies. I keep getting lot of DMs, asking for help on Data Engineering Interview prep. This will…