Data Engineering lab @data_eng_lab

Google Certified Data Engineer | Plumbing Data pipelines | Python | Cloud | BigData dataengineeringlab.com Joined December 2021

Tweets

35
Followers

8
Following

263
Likes

15

RAVI KUMAR SAHU @RAVIKUMARSAHU78

5 months ago

Do You Need Canva Pro! lifetime Subscription 🚨 If You Need Canva Pro Free Then ; 1. Like 2. Comment "Canva" 3. Repost ( follow me to get it)

821 498 897 99K 121

Pratham @Prathkum

3 years ago

Learn for free: HTML → w3schools.com CSS → CSS-tricks.com JavaScript → LearnJavaScript.online Git and GitHub → LearnGitBranching.js.org React → React-tutorial.app API → @Rapid_API SQL → SQLbolt.com Blockchain → cryptozombies.io

728 16K 51K 0 34K

Sahil Bloom @SahilBloom

3 years ago

If you’re struggling to prioritize your to-do list, try this:

174 2K 9K 0 5K

Data Engineering lab @data_eng_lab

3 years ago

What is partitioning in hadoop MR? No of partitions are equal to no of reducers. Mappers ll store the data in partitions and its selection logic is based on hash func. Same key ll always go to same partition. Each reducer ll process respective partition #BigData #learnHadoop

0 0 0 0 0

Data Engineering lab @data_eng_lab

3 years ago

What is shuffling in hadoop? In distributed system, calculation will hpn in mapper process and aggregation will happen in reducer process. Once the calculations are done in mappers, data ll be transferred to reducers, this transfer is called shuffling. #learnHadoop #BigData

0 0 0 0 0

Data Engineering lab @data_eng_lab

3 years ago

How many mappers will be created for 500mb file in hadoop distributed computing? 1 mapper for 1 block, 500mb file will split into 4 blocks in HDFS (default block size is 128mb), so 4 mapper process can be created and each process one block. #hadoop #BigData

0 0 0 0 0

PentesterLab @PentesterLab

4 years ago

Giveaway time! We are going to send a t-shirt and few goodies to one person who follows @PentesterLab and likes this tweet !! And we are going to give a 1-year voucher to someone who RT this tweet!

141 1K 2K 0 12

Data Engineering lab @data_eng_lab

4 years ago

Quick way of count the number of column in the csv file line = open("test.csv").readline() print(line.split(",")) # comma seperated What is your way of doing it? #Pythonprogramming #DailyOneTip #Python

0 1 4 0 0

Data Engineering lab @data_eng_lab

4 years ago

Whom Should I follow to get latest data engineering, python and cloud relevant content? Any suggestions guys? @saviomartin7 @oliverjumpertz @DailyDevTips1 @VittoStack @sunilc_ @BigData_Fr @VittoStack @heyOnuoha #dataengineering #Python #GoogleCloud

0 0 1 0 0

Richard Seroter @rseroter

4 years ago

You hear folks talk about BigQuery, but what actually makes it so unique and powerful? This @GoogleCloudTech post from @pvergadia is the best summary I've seen. Here's why BQ makes other data warehouses look incomplete or inefficient by comparison. cloud.google.com/blog/topics/de…