When using automatic mixed-precision training to accelerate model training, there are two common options: float16 and bfloat16 (16-bit "brain" floating points). What's the difference?
Compared to float16, bfloat16 has the same dynamic range as float32 but lower precision.
In my…
@marktenenholtz "To make this tutorial as real as possible, we created a chatbot simulating Bob. Bob is working in the fictional IT department and you will spend the first few weeks of the tutorial convincing Bob to finally give you access to the database"
In the RTX 40 post, I introduce a GPU recommendation chart and discuss the new Tensor Memory Accelerator (TMA) and FP8 computation. Overall, RTX 40s are faster for inference and shine through their FP8 performance but are inefficient for 16-bit training. timdettmers.com/2023/01/16/whi…
Potentially nitpicky but competitive advantage in AI goes not so much to those with data but those with a data engine: iterated data aquisition, re-training, evaluation, deployment, telemetry. And whoever can spin it fastest. Slide from Tesla to ~illustrate but concept is general
the decision maker didn’t even know the project was happening, and they are asking for a lot of changes!
By this time, both the ML and domain expert feel pretty jaded — ML must not work for their organization, right?
This is a symptom of a missing coordination expert:
<6/13>
Yes, ChatGPT is amazing and impressive. No, @OpenAI has not come close to addressing the problem of bias. Filters appear to be bypassed with simple tricks, and superficially masked.
And what is lurking inside is egregious.
@Abebab@sama
tw racism, sexism.
There's a confusing amount of plots for visualizing SHAP.
I put together a cheat sheet with the most important SHAP plots (+interpretation) for explaining machine learning models.
Get it here: christophmolnar.gumroad.com/l/shap-plots-f…
It's free!
NEW: income inequality in US & UK is so wide that while the richest are very well off, the poorest have a worse standard of living than the poorest in countries like Slovenia ft.com/content/ef2654…
Essentially, US & UK are poor societies with some very rich people.
A thread:
“You should always (always) have a Naive model. It’s the simplest, cleanest, most intuitive way to explain whether your system is at least treading water. And if it is (that’s a big IF), how much better than Naive is it.” statmodeling.stat.columbia.edu/2022/09/08/you…
17K Followers 2K FollowingMachine Learning at @Nvidia, 6x Kaggle Grandmaster CPMP. ENS Ulm alumni. ML PhD. Ex ILOG CPLEX, IBM. Views are my own. Blocking ad hominem attacks.
14K Followers 6K FollowingAI/ML engineer. Previously at Google: Product Manager for Keras and TensorFlow and developer advocate on TPUs. Passionate about democratizing Machine Learning.
8 Followers 475 FollowingMEXC focuses on financial management, stocks, cryptocurrencies, digital assets and investments. Currently, new users can get free dollars when they sign up.
102 Followers 5K FollowingAdventurer. Explorer. Seeker of ancient mysteries and hidden treasures. Join me on thrilling expeditions as we uncover the secrets of the world.
5K Followers 2K FollowingCommunity of practitioners working to promote and encourage the adoption of successful ML projects. Organizers of TMLS in June, and @MLOpsWorld Oct, Austin TX.
1.4M Followers 1K FollowingBuilding @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
12K Followers 497 FollowingSenior Principal Data Scientist @h2oai | PhD in CS
Top ranked Kaggle Grandmaster (Highest #1)
All views are my own.
https://t.co/NHdaca1Nns
355K Followers 1K FollowingML/AI researcher & former stats professor turned LLM research engineer. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW).
17K Followers 2K FollowingMachine Learning at @Nvidia, 6x Kaggle Grandmaster CPMP. ENS Ulm alumni. ML PhD. Ex ILOG CPLEX, IBM. Views are my own. Blocking ad hominem attacks.
14K Followers 6K FollowingAI/ML engineer. Previously at Google: Product Manager for Keras and TensorFlow and developer advocate on TPUs. Passionate about democratizing Machine Learning.
451K Followers 77 FollowingTensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
64K Followers 1K FollowingCo-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique
28K Followers 593 FollowingLLMs and retrieval by day and other genres of AI when I get the chance
🧪 Senior AI Eng @NVIDIAAI
🏫 @fastdotai trained DL Eng
📝 https://t.co/By87iXx5Pu
1.3M Followers 1K FollowingCo-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
92K Followers 207 FollowingLMArena: Open Platform for Community-driven AI Benchmarking. Graduated from UC Berkeley / @lmsysorg. We’re hiring: https://t.co/1OkfLq2n0I
565K Followers 513 FollowingFounder of the world’s most read daily AI newsletter @therundownai. Sharing the latest developments in the world of artificial intelligence.
2K Followers 317 Following👨💻 Software Engineer tweeting about Python and good Software
🐍 Tweets about Python with #pyrun
✍️📚 Currently writing Python like a Pro
637K Followers 35 FollowingWe're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant @claudeai on https://t.co/FhDI3KQh0n.
11K Followers 759 Following🌲🌲 applied ai, data science, ops | wife of @wingyewlum, mom of 2 | cofounder and cto building https://t.co/TBEWa1IYzH | quote: oliver wendell holmes 🕊️
75K Followers 704 FollowingA community for developers and users of open source scientific tools with 200K+ people 🧑🔬 🧑💻, by @NumFOCUS. Join our Discord: https://t.co/rmBFaQvdMM
35K Followers 814 FollowingCreator of SciPy, NumPy, and Numba; founder of Anaconda, Inc and NumFOCUS. CEO of Quansight, OpenTeams, and OpenTeams Global, Head of Product at Zyphra
6K Followers 1K Following💥@Kaggle 13x Grandmaster. Former #1 in Competitions.
😍 DataScience and MachineLearning.
❤️Father, Movies, shows and games. https://t.co/sGLUQwS93v
1K Followers 1 FollowingAn archive of @themarkup’s independent check on top Facebook content that ran from November 2021 through July 2022. See what the team is up to at https://t.co/VRTMJVjc4F.
633 Followers 209 FollowingAccelerating climate adaptation. Early wildfire detection for fire, forestry, utilities and more. Safeguarding communities and critical infrastructure. 🌲🔥🚒💛
38K Followers 49 FollowingStreamlit is an open-source Python framework for data scientists and AI/ML engineers to deliver dynamic data apps -- in only a few lines of code.
46K Followers 90 FollowingThe AI development platform - From idea to AI, Lightning fast ⚡️. Creators of AI Studio, PyTorch Lightning... Get help: https://t.co/a69wnEARV9
No recent Favorites. New Favorites will appear here.