MatX @MatXComputing

MatX designs hardware tailored for the world’s best AI models: We dedicate every transistor to maximizing performance for large models. Join us: https://t.co/E3XexKHUSM matx.com Mountain View, California Joined July 2023

Tweets

33
Followers

1K
Following

31
Likes

30

James Hill-Khurana @jtvhk

6 months ago

Join us in Waterloo to chat systems at Whoopsie Daisy Drinks: lu.ma/matx-waterloo

1 2 16 2K 3

James Hill-Khurana @jtvhk

6 months ago

I'll be in Toronto and Waterloo over the next week, I'd love to chat and tell you a bit more about what we're doing at MatX (and say hi); please feel free to reach out!

4 5 65 5K 2

James Hill-Khurana @jtvhk

6 months ago

Excited to say I joined @MatXComputing late last year! The team is exceptionally thoughtful and the problems are both difficult and fun: from µarch, compilers, and models, to the systems we are building.

26 5 159 7K 16

Download Image

Reiner Pope @reinerpope

6 months ago

MatX hardware will maximize intelligence per dollar for the world’s largest models. We are a team of 50+ and growing quickly. If you are passionate about building the best chips for LLMs, consider joining us. matx.com/jobs

0 2 21 4K 4

Reiner Pope @reinerpope

6 months ago

MatX is designing chips and systems to 10x the computing power for the world’s largest AI workloads. Today, we are pleased to announce the closing of a >$100M Series A funding round led by @sparkcapital, with participation from @JaneStreetGroup, @danielgross and @natfriedman,…

16 18 172 30K 44

Reiner Pope @reinerpope

7 months ago

1. Breakdown of DeepSeek V3 efficiency vs Llama 3: - Better: 11x fewer FLOPs per token, thanks to MoE [37B vs 405B activated params] - Better: 2x faster numerics [fp8 vs bf16 training] - Worse: 0.5x flops utilization [16% vs 33% end-to-end MFU*] - Neutral: similar hardware…

7 41 389 67K 266

Joe Weisenthal @TheStalwart

a year ago

NEW ODD LOTS: Two Veteran Chip Designers Have A Plan To Take On Nvidia @tracyalloway and I talked to @reinerpope and @MikeGunter_, both formerly of Alphabet, about their new company MatX that's aiming to build the ultimate semiconductor just for LLMs bloomberg.com/news/articles/…

6 15 87 85K 30

Mike Gunter @MikeGunter_

a year ago

I really enjoyed talking about the process and business of semiconductor design with @tracyalloway and @TheStalwart on the Odd Lots podcast. Joe and Tracy were wonderful hosts: They put me at ease and guided the conversation with the lightest of touch. We talked about what doing…

Joe Weisenthal @TheStalwart

a year ago

6 15 87 85K 30

1 6 30 26K 1

Reiner Pope @reinerpope

a year ago

MatX will be at MLSys. Come join us at our After Hours in Santa Clara to talk about chips, compilers, partitioning, and optimizing ML models for future hardware. Many of us will be there, including me and @MikeGunter_. Tuesday May 14th at 4pm, see matx.com/meetmatx.

0 3 21 3K 2

Reiner Pope @reinerpope

a year ago

We’re releasing seqax, a research-focused LLM codebase that is simple, explicit, and performs well on up to ~100 GPUs/TPUs. Everything you need to edit, from the math, to parallelism, to memory footprint, is all there in 500 lines of JAX code. 🧵 github.com/MatX-inc/seqax

9 51 275 43K 208

Soren Larson @hypersoren

a year ago

@danielgross very interesting observation re: aggregation / disaggregation dynamics for startups: "Inside of Google, there were lots of people who wanted changes to the chips for all sorts of things, and it was difficult to focus just on LLMs"

0 1 7 2K 2

Daniel Gross @danielgross

a year ago

Pleased to be investing in MatX, building AI chips with breakthrough capability: bloomberg.com/news/articles/…

5 8 178 60K 82

Daniel Gross @danielgross

a year ago

Given exponential increase in training costs, compute multipliers might become the most coveted secrets on earth. Some of those will be in torch.nn; many will be in silicon.

Daniel Gross @danielgross

a year ago

Given exponential increase in training costs, compute multipliers might become the most coveted secrets on earth. Some of those will be in torch.nn; many will be in silicon. https://t.co/UUp93Ahhws