Workshop on Virtualization in High-Performance Cloud Computing. News and views on #HPC #virtualization #VHPC #VMs #containers #cloud #aivhpc.org https://vhpc.orgJoined August 2023
VHPC '25 Program is now live: vhpc.org
Featured Keynote Tutorial:
"Writing a hypervisor from scratch"
Join Seiya Nuta from Vercel Inc. for an hands-on tutorial covering fundamental concepts and practical implementation techniques.
VHPC 2025 : 20th Workshop on Virtualization in High-Performance Cloud Computing, Dresden, Germany
Deadline Extension to May 25, 2025
The Euro-Par Dresden VHPC workshop will emphasize containers/virtualization for LLM training/inference workloads vhpc.org
NVIDIA vGPU is going non-proprietary nouveau/nvkm which is significant. vGPU still needs more transistors so to speak on the memory-management side though.
lore.kernel.org/kvm/2024092416…
HARMONY OF RESILIENCE: Recorded in space and sent to Earth via @SpaceX’s @Starlink constellation, Polaris Dawn crewmember and violinist @Gillis_SarahE invites you to enjoy this music moment in support of @StJude & @ElSistemaUSA → polarisprogram.com/music
VHPC '24 Keynote
Towards Using Partitioned GPU Virtual Functions for Mixture of Experts
Vignesh Chander, Member of Technical Staff, AMD
This talk provides an in-depth overview of the ROCm software ecosystem on MI300X platforms, with a focus on large-scale training and…
DeepSeek-Coder-V2: First Open Source Model Beats GPT4-Turbo in Coding and Math
> Excels in coding and math, beating GPT4-Turbo, Claude3-Opus, Gemini-1.5Pro, Codestral.
> Supports 338 programming languages and 128K context length.
> Fully open-sourced with two sizes: 230B (also…
arxiv.org/abs/2405.14906
Teacher-model type stage bootstrapped by a foundation model followed by an autonomous stage. AIEV-INSTRUCT (Instruction Tuning with Agent-Interaction and Execution-Verified) describes it and shows that you don’t have to be Facebook for large scale…
VHPC workshop submission deadline extended to May 20, updated text CfP below.
vhpc.org
====================================================================
CALL FOR PAPERS
19th Workshop on Virtualization in High-Performance Cloud Computing
(VHPC '24) held in…
Highly amusing update, ~18 hours later:
llm.c is now down to 26.2ms/iteration, exactly matching PyTorch (tf32 forward pass). We discovered a bug where we incorrectly called cuBLAS in fp32 mathmode 🤦♂️. And ademeure contributed a more optimized softmax kernel for very long rows…
Highly amusing update, ~18 hours later:
llm.c is now down to 26.2ms/iteration, exactly matching PyTorch (tf32 forward pass). We discovered a bug where we incorrectly called cuBLAS in fp32 mathmode 🤦♂️. And ademeure contributed a more optimized softmax kernel for very long rows… https://t.co/Orz0KUznrP
a Driver modification to re-enable P2P for 4090s over PCIe (large BAR), which is one step to PCIe n x 4090 vs. $$ DGX H100 or H100 SXM5.
github.com/tinygrad/open-…
Note IOMMU off which is a virtualization turn-off.
Next question is if PyTorch nccl toch.distributed collective…
104 Followers 45 FollowingCTO and Co-Founder @UnikraftCloud, Creator and Lead Maintainer @UnikraftSDK, passionate for open source, virtualization, and unikernels for the masses 🚀
2K Followers 1K Followingtech policy geek, interested in the bigger questions of AGI - focused on Responsible AI Governance - mom of 3 adolescents - trying to be zen
963 Followers 5K FollowingEs may B my bae chord. Synthetic Cypherpunk Space Che Human. Decentralize it. Open Source Absolutist of Ontological Anarchy. transparent/invisible. Be.
689 Followers 609 Following75% cyberpunk, 25% goth | prometheus turned and found a space within himself filled with more than abject horror; a garden of his own design
424 Followers 2K FollowingPolar trekking geek into ham radio. Interests are #HPC and #Lustre file system. No connection to JPMorgan Chase & Co. Tweets are my own. RT not endorsement.
757 Followers 933 FollowingFederated research infrastructure of leading European HPC centres: Data, Scalable & Interactive Computing Services. 🇪🇺-funded in ICEI project under HBP FPA
239 Followers 412 FollowingReady-to-use #Kubernetes platform that runs everywhere, from bare metal and VMs to private and public clouds. #OpenSource, created by @flant_com.
1K Followers 889 FollowingProfessor, frmr Dean of the School of ECE@NTUA, affiliated@ICCS. Working with large scale computer systems. Founder of the Synnefo project (https://t.co/bZiRDrkTRq).
135 Followers 143 FollowingAssistant Professor in Computer Architecture. Researcher focused on GPU-accelerator virtualization in both HPC and Cloud/Edge computing. @ETSEUV
91K Followers 761 FollowingPresident of @RFKHumanRights, lawyer and activist. Bestselling author, progressive Catholic, and lifelong feminist. Proud mom of three mighty women.
416 Followers 522 FollowingDirector of Marketing. DC Native. Lover of Tech. Passion for Travel, Live Music and Dance. Wine Connoisseur. Runner. FOOD. Dog-mom.
316K Followers 1K FollowingAI Educator. 𝕏 about AI, solutions and interesting things. Showing how to leverage AI in practical ways for you and your business. Opinions are my own.
1K Followers 59 FollowingMunich Quantum Valley – founded by BAdW, DLR, FhG, FAU, LMU, MPG, and TUM – has the goal to develop and operate quantum computers in Bavaria.
3K Followers 945 FollowingQuantum Algorithm Design Software.
Revolutionizing #quantumcomputing with a quick & efficient way to build complex #quantum circuits.
488K Followers 146 FollowingNobel Laureate. Co-Founder & CEO @GoogleDeepMind - working on AGI. Solving disease @IsomorphicLabs. Trying to understand the fundamental nature of reality.
605K Followers 608 FollowingInternet Rocket Scientist, Gamer, Astronomer, Dad, Scotsman, Pilot. Makes videos about space and science https://t.co/mLfUsogKq5
983 Followers 300 FollowingTesla Model Y owner, and fan of Tesla and SpaceX ⚡️🌌 #Tesla $TSLA ⚡️ Use my Referral Code to get a discount or benefit when purchasing your new Tesla.
689 Followers 609 Following75% cyberpunk, 25% goth | prometheus turned and found a space within himself filled with more than abject horror; a garden of his own design
325K Followers 3K FollowingNVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.
3K Followers 1K FollowingSoftware Engineer at NTT Corp. Interested in distributed systems and containers. Tweets are my own.
My twitter ID is "_AkihiroSuda_", not "AkihiroSuda".
499 Followers 475 FollowingCrazy for system (kernels & hypervisors) software Development and Open Source. 💻 SW ENG - Virt Specialis at @SUSE 🦎 Husband 🥰Father ❤️ Tweets my own🐤 He/Him
4K Followers 312 FollowingMad C++ developer, proud grandfather of KVM. CTO @ScyllaDB, an open source superfast NoSQL database (compatible with Cassandra, DynamoDB). Hiring (remotes too).
1K Followers 631 FollowingMy thoughts on work, open source and occasional rants about world affairs. When in doubt, turn it inside out. Also on Mastodon: @[email protected]
14K Followers 519 FollowingAsst. Prof. of CS at Stanford, Google DeepMind. Prev: Anthropic, Google Brain. Co-Creator of MoEs, AlphaChip, Test Time Scaling Laws.
342 Followers 25 Following@TheSIAMNews SIAM Activity Group on Supercomputing. Follow us for activities, meetings, events and more. https://t.co/O66fvfthv9 #SIAMPP24 #HPC4ALL
163K Followers 0 FollowingInvented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day.
No recent Favorites. New Favorites will appear here.