Data Eng Weekly @DataEngWeekly
Data Eng Weekly covers the week's top news in data engineering-related open source and cloud products. Curated by @joecrobak dataengweekly.com Joined August 2015-
Tweets121
-
Followers993
-
Following29
-
Likes20
To all my dear #BigData colleagues! Feel invited to submit an abstract to #BigDataTechWarsaw 2020, so that we can meet in Warsaw, talk about data and have a beer 🍺 This is the conference that I co-organise :) The CfP is open until Sep 30th. medium.com/getindata-blog…
A couple of good links, both from @DataEngWeekly: 1. Review of idempotence complete with elevator analogy: lispcast.com/what-is-idempo… 2. How to learn to build distributed systems: brooker.co.za/blog/2019/04/0…
What changed in the Big data landscape from 2013 to 2019 blog.marouni.fr/bidata-trends-… - interesting analysis from @AbbassMarouni based on articles in @DataEngWeekly
My @apachekafka @kafkastreams challenges github repo has been announced in the last @DataEngWeekly issue: dataengweekly.com/Data-Eng-Weekl… Thank you guys!
List of new features in Amazon Redshift so far in 2018 - queries on nested data recently announced! blog.openbridge.com/whats-new-with…
Aaand another chapter is done! 🎉 The Early Release of "Stream Processing with @ApacheFlink" was updated with a new chapter about connectors and end-to-end consistency. Only two chapters ("Setup & Configuration", "Operations") are left. I should start looking for another hobby 🤔
Data Eng Weekly 279 ▪︎ Benchmarking Hive on MR3 ▪︎ Event Sourcing ▪︎ Efficiently writing to a db ▪︎ Jepsen for Dgraph ▪︎ PulsarIO ▪︎ Scheduling of notebooks at Netflix ... and more! dataengweekly.com/Data-Eng-Weekl…
Apache Airflow 1.10.0 is out ❤️🎉 !! Highlights: - New RBAC web interface in beta - First class kubernetes operator - Experimental kubernetes executor - Timezone support - Performance optimizations for large DAGs - Many GCP and S3 integration improvements - Tons of Bug Fixes
We've just released Apache Arrow 0.10.0, the biggest release yet with 4 months of work and nearly 500 issues closed. We've added 3 new languages to the project: Go, Ruby, and Rust. Read more arrow.apache.org/blog/2018/08/0…
Fortnite: 12 AWS regions, 5000 shards of Kinesis Streams, 4000 instances of EMR, and adding 2PB of data per month. datanami.com/2018/07/31/ins…
Catch up on the latest issue of Data Eng Weekly before the next one this Sunday! dataengweekly.com/Data-Eng-Weekl…
The @ApacheFlink community reached 10,000 issues in JIRA. Thanks to everyone who participated! Let's file another 10,000 feature requests/bug reports and keep the community alive! issues.apache.org/jira/browse/FL…
Big growth in flash storage: 55% year-over-year in Q1 2018. datanami.com/2018/07/26/the…
Apache Accumulo 1.9.2 was released with fixes for a few serious bugs. accumulo.apache.org/release/accumu…
Data Eng Weekly Issue #274 Lots of stream processing coverage this week—Apache Kafka, Wallaroo, Apache Samza, WSO2, and Amazon SQS + a couple of posts on Kubernetes, db monitoring + 2 new books + a proposed data ethics checklist. dataengweekly.com/Data-Eng-Weekl…
ERA5 atmospheric data is now available on S3 as a public data set. Currently available from 2008 on-wards, all 9 petabytes dating back to 1950 will be released incrementally. medium.com/planet-os/era5…
Speeding up ETL in PySpark by parallelizing db access. medium.com/@joaopedro.pin…
HDP 3.0 delivers new capabilities for the enterprise to enable agile application deployment, new #machinelearning /deep learning workloads, real-time database, & security and governance. Learn more about the enhancements, here: bit.ly/2JZms8t #BigData
Data Eng Weekly #273 is out. It was a tough one—so much great content to choose from. Coverage includes Scio, make at Propublica, Paypal's NameNode analytics, MySQL on Kubernetes, Kinesis+Lambda, data replication at Hotels.com, & much more. dataengweekly.com/Data-Eng-Weekl…
"How to scale a distributed system" from 2017's Velocity Conf. conferences.oreilly.com/velocity/vl-ca…
Gwen (Chen) Shapira @gwenshap
28K Followers 10K Following Co-founder of @niledatabase. Making SaaS global, elastic and chill. Find me at: https://t.co/uyuHg400cp
Rahul Jain @rahulj51
3K Followers 2K Following Principal Software Engineer at @justbobsledit. Formerly led Data and Engineering at @thebeatapp , @omioglobal , @thoughtworks .
Tanel Poder 🇺🇦 @TanelPoder
12K Followers 1K Following Creator of https://t.co/w1Pz4s2EhV and a long time computer performance nerd. Performance & Troubleshooting Training: https://t.co/lRKHSCFE6M
Ananth Packkildurai @ananthdurai
3K Followers 2K Following Data @Zendesk, @SlackHQ | Author https://t.co/rvlBOXX0cy | Creator of https://t.co/XdMVrxUay6 | Angel Investor | Advisor for early stage data startups
Srinivas Peddi @speddi22
0 Followers 59 Following
Amin.S @Ex_oria
6 Followers 49 Following Bringing the art of text to you through media. To Enjoy Sometime on Board Game. https://t.co/AOAVymT6WP
Crodemor @claudemirfranco
17 Followers 178 Following
RAVI RAI @ravirai_99
9 Followers 72 Following
ERT @xvix999999999
4 Followers 2K Following
Chetan Choudhary @TheChetanDev
0 Followers 11 Following BCS student on a journey to become a Data Engineer. Learning Python, SQL, and cloud technologies. Sharing my projects and progress. #DataEngineering
Mallinath @Connect2mpatil
518 Followers 2K Following Data Engineer |ETL, Cloud & Big Data | Ex-EY| Seeking Global Opportunities #DataEngineering or #TechJobs.
Tammam ALASHA @AlashaTammam
21 Followers 179 Following
tolaniakinola.bsky.so... @tolaniakinola_
954 Followers 2K Following Lifelong learner, polymath. No one is above Jesus no one. Act with a sense of duty
Dhanush @Dhanush_1520
2 Followers 185 Following
ShannuR @ShannuR3
8 Followers 141 Following
Krsna @KrsnaTeja
18 Followers 291 Following
Mitul @mitulsinghh7896
0 Followers 34 Following
Piyush Jain @pia_jain05
208 Followers 456 Following
Bala Subramanian @Bala2462000
63 Followers 1K Following
anakantweeti @kn9wdsway3
6 Followers 77 Following
@decode @i_mranjan
3 Followers 145 Following journaling the backend of things // pipes, logs, latency. all of it. tgt: 2025
Sri Nivas @Srini7210
16 Followers 75 Following
Venu.jsx⚛️Venu.py... @VenuPelluru
123 Followers 2K Following JS is My Superpower. Aspiring MLOps Engineer.
Boris Takou @boris_takou
54 Followers 851 Following Exploring the power of AI to transform ideas into innovation. Passionate about tech, creativity, and the future of intelligent systems.
Usha ushh..! @ushaiitkgp
4 Followers 160 Following
Diptesh Rane @rane_diptesh
18 Followers 204 Following
Dhara ni @Dharani1202
0 Followers 7 Following
saurabh vora @saurabhvora4
47 Followers 329 Following
Kalyan Msn @KalyanMsn14767
0 Followers 15 Following
saranyashrinivasan @saranya_genga
5 Followers 67 Following
Rinil Kunhiraman @rinilkunhiraman
5 Followers 351 Following Exploring the future where humans and AI collide. 🤖✨ Inspired by bots, but not one. Curiosity driven by algorithms.
Ricardo A Muñoz M @ricardoandres33
59 Followers 72 Following La belleza se encuentra en la simplicidad de las cosas.
havu doit @havudoit
3 Followers 111 Following
𝙴-𝙼𝚊𝚗𝚐... @bugsymangesh
115 Followers 237 Following ⚙️||Tech || 🧑💻Code ||🛠️ Development || Data 七転び八起き
Suresh Nandamuri @nvssbabu
24 Followers 290 Following Data Analytics Support | SAP SLT, Kafka, Hadoop | Aspiring Data Engineer | Learning Python & Cloud.
Federico Antonio Noto @fnoto14
2 Followers 25 Following Data Engineer 💻 | Ing. Electrónico (UNLaM) 📡 | Tech, datos y un poco de caos ✨
Okpara Nathaniel @Mr_NathOkpara
21 Followers 102 Following doctoral researcher, Center of Free Electron Laser, DESY. Hamburg, Germany. #Lecturer, Delta State University, Abraka
David @b_david_59
1 Followers 24 Following
Anish Kumar Singh @anishkumarx
3 Followers 177 Following Just random thought and situation, nothing permanent. #OpenToLearn
Pundrik Sharma @pundriks3103
1 Followers 63 Following
vikas chinchansur @vikas_k_c
63 Followers 231 Following Studying Master of Computing at The Australian National University.
Ramana @_ramana_22
32 Followers 203 Following
Chrisintojava @chrisintojava
2 Followers 27 Following
Gaurang @gaurang7goel
30 Followers 417 Following A beginner to code , but a keen enthusiast. Want to work but not too much!!!!.
nima59 @nima59
744 Followers 735 Following Data Engineer, Freelancer, Developer, Teacher, #INFJ, Empathetic, EX-Vegan ، EX-Volunteer of IAPSRS
Eric Sammer @esammer
12K Followers 686 Following ceo at @decodableco! prev: @splunk, @rocanainc (acq'd), @cloudera. open source / dist systems / data. o'reilly author. [email protected]
Apache Airflow @ApacheAirflow
12K Followers 0 Following Airflow is a workflow scheduler. Now on https://t.co/r5iMFW0E2h
Julien Le Dem @J_
4K Followers 2K Following Architect, Founder, Angel, Advisor, OSS: @OpenLineage @MarquezProject, ASF: Parquet Arrow Iceberg 🐖. 🦋 https://t.co/4VQUXaZ5vu . he/him
Streamlio @streamlio
1K Followers 3K Following Streamlio, an enterprise-grade solution unifying messaging, compute, and stream storage, was acquired by @Splunk in October 2019.
DynamoDB @dynamodb
21K Followers 4K Following Amazon DynamoDB is a serverless database for applications that need high performance at any scale. Follow us! And join the team: https://t.co/VtAvkTc8rA
Apache Hive @ApacheHive
3K Followers 9 Following Apache Hive - An Apache Software Foundation Project (Official Account: Managed by Apache Hive PMC)
ARCHITECHT @architechtpub
1K Followers 1 Following Powered by @derrickharris . Newsletter at https://t.co/FX5c36BcJL . Podcast home: https://t.co/OIOxLI6KqN .
Joe Crobak @joecrobak
2K Followers 2K Following distributed systems, healthcare, and government. Previously @confluentinc @USDS healthcare team, @Foursquare & @DataEngWeekly
Etsy Engineering @codeascraft
12K Followers 117 Following The engineers who make Etsy make our living with a craft we love: software.
Engineering at Meta @fb_engineering
283K Followers 198 Following Engineering at Meta is a technical news resource for engineers interested in how we solve large-scale technical challenges at Meta.
Airbnb Engineering @AirbnbEng
53K Followers 216 Following Creative engineers building a world where you can belong anywhere.
O'Reilly Strata Data ... @strataconf
35K Followers 4K Following Data, ML & AI news + resources from @OReillyMedia.
Cloudera Community @cldrcommunity
109K Followers 361 Following At Cloudera, we believe that data can make what is impossible today, possible tomorrow.
Cloudera @cloudera
108K Followers 3K Following At Cloudera, we believe that data can make what is impossible today, possible tomorrow. https://t.co/J2XwwpJmQN.
Data Engineering @InsightDataEng
1K Followers 82 Following Insight Data Engineering Fellows Program: Your bridge to a career in big data
Apache Accumulo (arch... @ApacheAccumulo
1K Followers 19 Following Secure, robust, scalable, high performance data storage and retrieval
Apache NiFi @apachenifi
5K Followers 1 Following Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data.
Apache Flink @ApacheFlink
19K Followers 26 Following Official Apache Flink Twitter account managed by the Flink PMC
Apache Calcite @ApacheCalcite
5K Followers 25 Following Dynamic data management framework. The foundation for your next high-performance database.
Apache Samza @samzastream
2K Followers 0 Following Apache Samza is a distributed stream processing framework. Follow for news and updates.
Apache Kudu @ApacheKudu
4K Followers 69 Following An open-source native columnar storage engine that enables fast analytics on fast data. https://t.co/ke9kwqPmqn
Apache Kafka @apachekafka
68K Followers 236 Following A distributed streaming platform. Account managed by the Kafka PMC.
LinkedIn Engineering @LinkedInEng
46K Followers 390 Following Powered by the world’s most trusted and largest professional platform, our vision is to create economic opportunity for every member of the global workforce.Trends for United States
You might like
