Kishan @kishan_py

🛠️ India Joined June 2020

Tweets

235
Followers

67
Following

612
Likes

1K

Zach Wilson @EcZachly

10 months ago

Event data is the largest volume data you'll tackle as a data engineer! In this free four hour course, I'll go over everything I learned at Meta to tackle large volume event data! Enjoy! Please repost to spread the knowledge! youtube.com/watch?v=DQefW9…

4 61 367 17K 268

Raul Junco @RaulJuncoV

a year ago

Most people focus on optimizing the SELECT, but performance starts at CREATE. 5 simple tips for designing a better database. 1. Normalize Your Data • First Normal Form (1NF): Each column should contain atomic (indivisible) values, and each column should contain values of a…

16 186 891 64K 1K

Download Image

Alexey Grigorev @Al_Grigor

a year ago

We launched a Kaggle competition as a part of the LLM Zoomcamp! Participate and solve high school mathematical problems with LLMs. 🔸 Learn on our free Zoomcamp 🔸 Apply your knowledge at this competition 🔸 Get extra points for the course Join now: kaggle.com/competitions/l…

1 14 54 2K 22

Download Image

Deeksha @deekshas24

a year ago

Scenario where you can use Delete and Truncate command: 1. “Cleaning Up Data for Specific Rows” - Suppose you are managing a customer database and want to remove records of customers who have unsubscribed from your mailing list. Use the ‘DELETE’ statement to remove specific…

0 9 70 2K 16

Saurabh Dashora @ProgressiveCod2

a year ago

Latency is the new downtime in distributed systems. But these 8 must-know strategies can help reduce latency. 🧵

7 91 475 41K 497

Download Image

Zach Wilson @EcZachly

a year ago

My favorite stack to build a data analytics product - Apache Spark (for processing) - Amazon S3 (for storage) - Apache Iceberg (for metadata) - Apache Airflow (for scheduling) - Apache Superset (for visualization) - Great Expectations (for data quality) #dataengineering

15 120 930 67K 1K

Raul Junco @RaulJuncoV

a year ago

Good SQL brings more Orders. A common mistake that turns LEFT JOIN into an INNER JOIN. In a LEFT JOIN, all records from the left table and the matching records from the right table are included. So far, so good, but there is a catch. If you add a condition in the WHERE clause…

18 157 967 106K 919

Download Image

Alexey Grigorev @Al_Grigor

a year ago

The first cohort of the LLM Zoomcamp has just started! 🎉 Join Module 1 as we explore RAG and Elastic Search with OpenAI. Homework: you'll need to calculate the price for your prompts. Access materials for Module 1 here: github.com/DataTalksClub/… 1/2

1 10 67 3K 28

Download Image

Kishan @kishan_py

a year ago

Dashboard Data Pipeline

0 0 3 38 0

Download Image

Zach Wilson @EcZachly

a year ago

If I had to start learning #dataengineering all over again, I’d follow this plan, mostly in order: - Learn SQL — Aggregations with GROUP BY — Joins (INNER, LEFT, FULL OUTER) — Window functions — Common table expressions - Learn about data modeling — read about data…

15 327 2K 426K 4K

Alexey Grigorev @Al_Grigor

a year ago

Module 1 of LLM Zoomcamp is ready! In this module, you'll set up a RAG flow for searching in a knowledge base and retrieving important contexts for LLM. Watch it here: youtube.com/watch?v=Q75JgL… Code and notes: github.com/DataTalksClub/… See you on Monday when the course starts!

3 33 160 6K 87

Download Image

Prerit Munjal @prerit_munjal

a year ago

The best place to learn k8s in Hindi 🤓 • Kubernetes Architecture ✅ • Cluster, Pods, Containers ✅ • Side Cars, initContainers, Kyverno, Trivy ✅ • Deployments ✅ • Services, Live application deployment using Custom Domain ✅ • Cert-Manager, Gateway API, & Namespaces ✅

13 59 550 56K 705

Download Image

Alex Xu @alexxubyte

a year ago

How does Docker work? The diagram below shows the architecture of Docker and how it works when we run “docker build”, “docker pull” and “docker run”. There are 3 components in Docker architecture: 🔹 Docker client The docker client talks to the Docker daemon. 🔹…

9 241 1K 56K 651

Download Gif

Anthony GG @anthdm

a year ago

This Golang project will get you hired, TRUST. 10 hours of distributed dopamine. youtube.com/watch?v=bymQak…

10 82 705 57K 940

Vikas Rajput @vikasrajputin

a year ago

SQL Indexing in a Nutshell:

10 96 529 32K 299

Download Gif

Zach Wilson @EcZachly

a year ago

Data engineers often become bored of data engineering! After a while of SQL + Python + airflow, you start thinking all pipelines are the same and it’s copy and paste work. Some strategies to help with this: - become more end-to-end Maybe that means building a dashboard. Maybe…

13 72 560 68K 451

Nick Singh | The Data Science Guy 📕 @NickSinghTech

2 years ago

Advanced SQL Interviews LOVE to test you on Window Functions. Here's 4 real SQL interview questions from Uber, Google, Spotify & Wayfair to practice SQL window functions like: • LEAD() • LAG() • RANK() • DENSE_RANK() • ROW_NUMBER() • NTH_VALUE() 🧵👇

3 127 428 69K 487

Download Image

Zach Wilson @EcZachly

2 years ago

Data engineering SQL interviews always have a silly RANK question. Should you use RANK, DENSE RANK, or ROW NUMBER? Here’s a refresher! For more free data engineering interview, subscribe to my blog: blog.dataengineer.io #dataengineering

2 59 375 25K 344

Download Video

Mitchell van Rijkom @MitchellvRijkom

2 years ago

A data engineer who is unfamiliar with SQL queries and optimization will have significant difficulties Since SparkSQL has increased the popularity of SQL, having a solid understanding of querying datasets will be useful to you for a very long time #Spark #DataEngineering #SQL

0 1 5 280 0

Darshil | Data Engineer👨🏻‍🔧 @parmardarshil07

2 years ago

Types of projects that I worked as Freelance Data Engineer 👇🏻 This is a common question I get about the type of work you get as a freelance data engineer and it varies a lot 📍Web Scraping: When I started my journey as a freelancer I didn't get projects related to core Data…