Optimizing queries suddenly has me thinking about relational algebra! E.g. exceptions to reordering joins. Query optimizers do this all the time, but it seems a human touch can sometimes help.
The progression of learning a new technology:
1. I don't know how to do it.
2. I know one way to do it, and I use it all the time.
3. I know many ways to do it, but can't choose the best.
4. I choose the best way to do it in each situation.
5. I create a better way to do it.
Recovering from bad (i.e. unexpected) data is like descending to the underworld:
Platform -> Job -> Error -> Dataset -> File -> Record -> Bytes
and then
Cleansed data -> New file -> Test load -> Test error handling -> Rerun job -> Document
I can’t help thinking that being a data analyst without a business context is a strange name for a job. It’s really hard to be a generic data analyst.
Think about it:
586 Followers 4K FollowingSparrow is the first corporate communications platform designed for communicators. Check us out at https://t.co/UbzRzgAhba
#InternalCommunications #EmployeeEngagement
44K Followers 1K FollowingCTO at @Databricks and CS prof at @UCBerkeley. Working on data+AI, including @ApacheSpark, @DeltaLakeOSS, @MLflow, https://t.co/94gROE5Xa0. https://t.co/nmRYAKG0LZ
1K Followers 1K FollowingHybrid IT automation and orchestration platform to centrally control IT processes - both on-prem and in the cloud. For #ITOps #PlatformOps #DevOps and #DataOps
295 Followers 879 FollowingFreelance Data Developer | Founder at Atad-Bayanat || Past: Astrophysicist at @uva_api & @IRAP_France || I ❤️ creating awesome data products for my clients
586 Followers 3K FollowingOpenCV veterans, passionate about innovations in computer vision and focused on object detection, facial recognition and automated video content analysis
592 Followers 3K FollowingKubernetes Ops, Linux/FOSS, Cloud Infra enthusiast. Personally, researcher of my own mind listening from everyone & anything. Advaita focus. Tweets=note2myself.
112K Followers 25K FollowingBringing together the global data science community to help foster the exchange of innovative ideas and encourage the growth of open source software.
382 Followers 526 FollowingBuilt around growing DataOps in the US, UK and Europe and understanding how it can work at its best. Run by and for Data Enthusiasts. The difference is DataOps.
4K Followers 2K FollowingTamr, the leader in data products, enables customers to consolidate messy source data into clean, curated, analytics-ready datasets.
1K Followers 682 FollowingAuthor, virus PhD, pharma Med Director, LTJG USPHS CC Reserve. Tweets represent ONLY me. Pop writing as John Skylar, peer-reviewed work as LJ Feinman. They/he.
15K Followers 1K FollowingA leading connectivity company providing superior services to our 31M+ customers. Your Privacy Rights at https://t.co/Y65R9En2pE
18K Followers 1K FollowingCEO of the System Initiative, Co-Founder of Chef. Sustainable free and open source software communities. Music. He/Him. bluesky: @adamhjk.me
3K Followers 966 FollowingWhen you're a kid at VBS you can just walk into the kitchen and drink the entire pitcher of Kool aid, all of it. There's nothing they can do.
206K Followers 197 FollowingBy @AdamRRowe.
Check out my art book WORLDS BEYOND TIME: 400+ illustrations, 100+ artists, lots of jokes and facts. https://t.co/KfekD0cbzf
38K Followers 26 FollowingUnderground Synth Instrumental Record Label based in LA, inspired by 80s nostalgia. Check out the latest releases: https://t.co/PlJ638mmrM
44K Followers 1K FollowingCTO at @Databricks and CS prof at @UCBerkeley. Working on data+AI, including @ApacheSpark, @DeltaLakeOSS, @MLflow, https://t.co/94gROE5Xa0. https://t.co/nmRYAKG0LZ
732 Followers 373 FollowingA nerd heaven in the DC Metro w/ something for the geek in all of us: boardgames, retro videogames, Pokémon, MtG n’ D&D. Home to Team DCG & D.C. Derelors 93/94.
9K Followers 4K FollowingGetting people through red tape with technology. Now: AI and SNAP. Before https://t.co/6YGx9KRpHZ. “Are you that fax machine guy from Recoding America?"
13K Followers 2K FollowingI was on the bird site for 16 years and now I'm on the butterfly site and IG (both @justupthepike) so you can follow me there
12K Followers 730 FollowingEconomist, @UNCG PhD, "serial millennial myth debunker," labor, housing and time use researcher, @AU_SPA adjunct prof. Views are my own and not any employer's.
380 Followers 56 FollowingRegional American BBQ from @allsetDTSS team 🐷 Serving Montgomery + Prince George's Counties (DC + VA coming soon!) Place pick-up & delivery orders 👇🏼
2K Followers 977 Followingcurrently @datavantHQ. previously @usds @cmsgov. healthcare, tech & government things. you might have read about my dog bite in politico. opinions my own.
26K Followers 261 FollowingNextgov/FCW's mission is to lead the national discussion about how technology transforms government. Reach us at [email protected].
16K Followers 3K FollowingFree legal help & info for student journalists. First Amendment champion. Not @SPLCenter. Consider supporting student press freedom: https://t.co/ZLbfp6vWw7
1K Followers 485 FollowingI help companies extract value from data - https://t.co/i9aT6lR3kw. Data factory engineer. Now at Mastodon @social.linux.pizza@lalle & Bluesky @larsalbertsson.se