-
Tweets4K
-
Followers935
-
Following537
-
Likes3K
George Ang retweeted
💥 Introducing MiniCPM-o 2.6: An 8B size, GPT-4o level Omni Model runs on device ✨ Highlights: ~Match GPT-4o-202405 in vision, audio and multimodal live streaming ~End-to-end real-time bilingual audio conversation ~Voice cloning & emotion control ~Advanced OCR & video…
29
163
703
97K
515
Download Video
讲一个听来的段子。一个团队搞模型量化结果不太理想，模型只会生成重复的 YES！在大家在讨论什么较准集，SQNR，重复惩罚时，一个哥们盯着书架上的《梦的解析》若有所思。第二天这哥们就和一个搞 TTS 的光速离职了。据说俩人都跳槽到了做成人保健品的公司。
George Ang retweeted
Here is the PR / tech blog: github.com/ggerganov/llam… I've tried to describe most of the interesting implementation details. I believe the performance is quite good and it should run nicely even on low-mid range hardware. Enjoy your local copilot in the terminal!
YOCO 的性能提升大头来自作者去年的 RetNet. 但工业界显然更愿意采用简单的结构，然后靠 Scaling Law 来提升模型效果。有种你训我推荐，我训我不用的画面感。
并行采样时受预测分布的影响，推出雷同的序列的概率蛮高的，尤其是输出的前缀。今天在内部引擎复现了 Paged Attention 论文里提到的 Copy-on-Write 机制，只在推出不同结果时才做页拆分。比较好奇 vllm 的实现里也有 COW 的机制，但看起来从 prompts 最后一个页就开始复制了。
George Ang retweeted
老黄这条言论，也有很多反对声音，见评论区。 这条评论我比较认同。
George Ang retweeted
Here's my take on the Sora technical report, with a good dose of speculation that could be totally off. First of all, really appreciate the team for sharing helpful insights and design decisions – Sora is incredible and is set to transform the video generation community. What we…
开发投机采样时在一个 bug 上卡了好久：第二步开始两个模型的概率分差大得诡异。因为特殊的 kvcache 实现有个压缩机制比较繁琐，一直在查 cache 的问题。后来画图才发现大模型全接受后单独采样一次的 token ，忘记喂给了小模型。看来难于维护的实现即使自己没出问题，也会带来意外的成本。
投机采样比较难理解的就是小模型的采样被拒绝后的补采，为什么要基于两个模型的分布相减。其实它本质上是大模型的拒绝采样，大模型随机一个点看看是否落在两个模型重叠的部分，落了就直接用小模型的输出。如果没落入就按相差的概率重新算一个点。
2023 年年初开始搞 AI Infra.上半年搞训练 FlashAttention 定制，RLHF 加速和推理张量并行。下半年搞 vllm 定制，评测任务对齐和 INT4 量化。没有 2022 年在 Youtube 上刷了遍 Gilbert 老爷子的课程真 hold 不住。向老爷子和 Y 站致敬。
Pytorch 提供的 CUDAExtention 编译单个算子扩展还行。大型项目依赖 Pytorch 还是得用 cmake. 可以靠 torch 接口拿到 cmake_prefix_path. 就可以用 find_package 集成啦。需要注意如果还要编译成 python 扩展，还得链接 libtorch_python.so
George Ang retweeted
In honor of Taylor Swift's 34th birthday, here are 34 Taylor series.
折腾个因为前向声明导致的跨库找不到符号的问题。靠 nm 和 readelf 才定位到问题。C++ 不愧为反调包语言。。
图拉鼎 @tualatrix
106K Followers 1K Following 生活在杭州良渚的开发者。专注 Apple 生态和效率工具多年。目前正打造新的出海公司与产品。最近在做 @PopTranslate。
forecho📈 @caizhenghai
34K Followers 4K Following 8 年美股投资者，13 年程序开发。 - 联系我：https://t.co/TpEhIUOWf4 - 美股社区 https://t.co/4O2QdkEkMf
FENG DONG @middlefeng
7K Followers 730 Following Author of Nuo Model Viewer. Programming C++, Lua, DirectX, Windows, iOS, macOS, Metal. Linux kernel fan (once). Atheism leads to singularity and God save us.
Tlahjo @Tlahjo5758
37 Followers 1K Following
jpssff @jpssff
5 Followers 207 Following
xerwanderer @xerwanderer
632 Followers 2K Following He who desires but acts not, breeds pestilence. | INFP
Happy3 @yangls06
22 Followers 566 Following
twinsant.eth @twinsant
815 Followers 2K Following 每天思考工作学习15小时：群众，毛粉，共产主义战士，自发大文宣 07好看簿联创/10云彩手机直播联创/Bitcoin信徒/06-15Web2.0创业者/Web3 Builder/元宇宙游民/AI小学生 Product Engineer： Reading， Writing/Thinking， Coding.
Liam @liamchzh
1K Followers 613 Following 分享值得记录的个人阅读和想法，包括科技新闻、工具、投资、职业发展和移民资讯等。欢迎订阅 👉 Newsletter:https://t.co/nVWIEm3IQE | ✈️ Telegram:https://t.co/mp92cZmwID
zhang rongw @Ero2032rf2
7 Followers 70 Following
Susie Tsow ⬜️ @Susie_Tsow
156 Followers 415 Following
RoseDorothy @OYGdjf87PxmLOd
74 Followers 2K Following
Ginger @Ginger796434049
310 Followers 3K Following
Beverly @b_beverly61
244 Followers 3K Following
Neuron @pseudocodes
86 Followers 622 Following
nobody @mumblememo
16 Followers 352 Following
Max @ZhuoRoger
43 Followers 3K Following
吴么了 @welshu91
3 Followers 131 Following
mar @mc67365
137 Followers 2K Following
zemz6844jhqf @zemz6844jh28920
3 Followers 165 Following
Ding @Ding0x777
31 Followers 1K Following
怡怡 @eNRX7FMwWp5672
92 Followers 2K Following 私信前叫主人报年龄位置 如若本人看到私信只给予表情回复概说明已被限制私信，想继续聊者联系推特小号@shtng5482124266
benhen @NHH886
0 Followers 2K Following
蓝衣侯-投资笔�... @qjkfnDGSbiequan
54 Followers 3K Following #Shib #以太坊 现在加客服，提升认知，免费获取2天超过30条全球币圈顶级付费内容，币圈顶流众筹社群。成员以极低的价格就能获总价值12万rmb/年的付费社群信息，实时更新各大付费群信息。未来10年是Crypto的时代已是共识，我们抱团紧跟顶流社群，一起暴富 #BTC #NFT
emanon @emanon00666
1 Followers 32 Following
uniquexiaoyao @unique614237
8 Followers 344 Following
zoe @zzywzoe
5 Followers 191 Following
劣 @o26NeBrk4ngqTxK
54 Followers 2K Following
xukele_cn @CnXukele
9 Followers 515 Following
fisheuler @fisheuler
28 Followers 1K Following
foobar @nullogger
84 Followers 1K Following
Kevin🐮 @lookaround66
108 Followers 2K Following
BigMonkey @ZongzhiHou
6 Followers 289 Following
Hao Chen @haoel
127K Followers 1K Following MegaEase Inc. Founder | Computer Science | Cloud Native | Software Architect | Blogger | Consultant | Lifelong Learner | Critical Thinking｜芝兰生于深谷，不以无人而不芳
ruanyf @ruanyf
191K Followers 374 Following Stay Focused, Keep Shipping. Build Early, Build Always. Improve yourself, Write solid/simple/stupid code.
云风 @cloudwu
50K Followers 72 Following Freelancer, Blogger, Gamer, Father of 2 kids, Rock climber. Chinese gaming industry from 2000, Indie game dev now.
Tinyfool @tinyfool
185K Followers 862 Following Youtuber 20年老程序员，业已退休，不以写代码为主业。 不是英语老师，但开发了"英语轻松读"，做了广受好评的学习英语的视频。 心在日本，人目前在天津 Youtube： 英语学习之路 https://t.co/fY05anVN8r 胡说八道 https://t.co/FQLaNWFD5j
图拉鼎 @tualatrix
106K Followers 1K Following 生活在杭州良渚的开发者。专注 Apple 生态和效率工具多年。目前正打造新的出海公司与产品。最近在做 @PopTranslate。
陈少举 （🦣 @ch... @chenshaoju
62K Followers 1K Following 构成：30%生活，20%ACG，20%技术，15%查证，10%股市，5%政治。 PGP：https://t.co/tE5FodMBh0， Bitcoin：1DvdCDjUJ4bnqDgyzTAQ2xabw6ChRnQ9Sy， BitMsg：BM-GuKfKkQoZEX7Cmmg5ifTwnyhdihc9DnR。
LinuxTOY 🐧 @linuxtoy
40K Followers 249 Following 于 2006 年创建，包括但不限于 Linux 新闻、应用及提示分享。自架服务：https://t.co/xyslSaC7TI / YouTube 频道：https://t.co/ZiD1IT3IG7
尤雨溪 @yuxiyou
110K Followers 248 Following @youyuxi 的中文小号。@voidzerodev 创始人，开源软件开发者，Vue / Vite 作者。此号只聊技术无关的闲话（偶尔破戒警告
LIN WEI @skywind3000
24K Followers 301 Following 老程序员，92年（小学）开始写代码，快速可靠传输协议 KCP 作者，知乎25万关注技术答主（id 韦易笑），游戏开发话题，编程话题优秀答主，娱乐化编程，Vim 用户+插件作者，怀旧游戏玩家。
骨头 @senob_
4K Followers 460 Following 爱折腾的懒人是个矛盾体 | 大数据从业者 | 人到中年 | 新加坡漂 | 马拉松弱鸡 | 喜欢到处玩 以防万一： @[email protected]
刘江/LIU Jiang @turingbook
53K Followers 3K Following Exploring AGI. Co-Founder of Turing Company. ex Meituan, BAAI, CSDN. 图灵联合创始人。曾任：北京智源人工智能研究院副院长，CSDN&《程序员》杂志总编，美团技术学院院长。
倪爽 @nishuang
101K Followers 805 Following 倪爽，设计顾问。 超过 20 年经验资深设计师，在美国运营 Honest Dot Design / 倪爽设计工作室，为中国及北美企业提供品牌营销设计、UX 设计两类设计咨询服务
Cat Chen, @catchen@ma... @CatChen
19K Followers 312 Following Career coach, programmer, author, speaker. Former engineer & manager @ Chime, Robinhood, Facebook, Wandou Labs, Yahoo, Baidu. Career coaching available.
DeepSeek @deepseek_ai
973K Followers 0 Following Unravel the mystery of AGI with curiosity. Answer the essential question with long-termism.
OpenBMB @OpenBMB
4K Followers 134 Following OpenBMB (Open Lab for Big Model Base) aims to build foundation models and systems towards AGI.
Kokuhui @yuuhuia
618K Followers 247 Following 🇨🇳写真模特、Coser 感谢你的喜欢💗 二号机：@yuuhuiaa 🛒会员制订阅：https://t.co/6oj1JmnpR0 🛒海外写真购买：https://t.co/DkUcHC8VJf 微店：https://t.co/vg7qcXW5Nh
Susie Tsow ⬜️ @Susie_Tsow
156 Followers 415 Following
-Zho- @ZHO_ZHO_ZHO
26K Followers 155 Following Architect | Artist | Ai explorer | Founder of @comfy_community & @comfy_park | [email protected]
Star Protocol 🚀 AN... @StarProtocol_HQ
549K Followers 289 Following Building omnichain DID protocol & ANS, powered by LayerZero. ⭐Consensys Scale Program ⭐BNB Hackathon ⭐Polygon Grant https://t.co/aHy5N0vNHE
Xuanwo @OnlyXuanwo
11K Followers 930 Following ASF Member. @ApacheOpenDAL PMC Chair. VISION: Data Freedom. Working on #RBIR with @LanceDB
奶罩::Bra(Sam) @samwu
6K Followers 361 Following Stop wasting time setting up your web development environment! Rock Your Code in Just 3 Minutes with https://t.co/eXH6D95iev
Jeff Dean @JeffDean
365K Followers 6K Following Chief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
scr.c @silsrc
8K Followers 489 Following 开源爱好，万能工程师（存疑），现代魔法老中登，Linux Kernel Developer，假装是计算机科学家，黑深残。
Tim Brooks @_tim_brooks
37K Followers 102 Following
Massimo @Rainmaker1973
3.1M Followers 150 Following Engineer. Selecting and curating pictures and videos trying to awaken your sense of wonder. Science, tech, art, weather, space, the unusual around us.
LM Studio @lmstudio
38K Followers 121 Following Download and run local LLMs on your computer 👾 https://t.co/e2E0DLMFJ5
Work Chronicles @_workchronicles
126K Followers 176 Following Get your daily comic. Join the newsletter: https://t.co/GdmoIxjVH4
宝玉 @dotey
132K Followers 1K Following Prompt Engineer, dedicated to learning and disseminating knowledge about AI, software engineering, and engineering management.
Physics In History @PhysInHistory
958K Followers 0 Following Photos from the history of physics | © with mentioned Archives. Shared for educational purposes. Einstein portrait © Ullsteinbild. Subscribe for curated papers.
Charles Liu @gofurliu
807 Followers 234 Following One2X Cofounder & COO https://t.co/czGPYx8EfA https://t.co/ERNyt4W4Sz @Medeo_AI Ex-product Lead at @DoraTool & https://t.co/68ll81KpK9(acquired by Bytedance)
Neuron @pseudocodes
86 Followers 622 Following
indigo @indigo11
43K Followers 1K Following Co-founder of https://t.co/WosXbyLukR / Partner of Brilliant Phoenix / ex-Weibo. Investor, Writer, Coder, Gamer & Amateur Cook. e/acc, 𝕏 is my notebook …
Zipeng Fu @zipengfu
13K Followers 1K Following Stanford AI & Robotics PhD @StanfordAILab | Creator of Mobile ALOHA, HumanPlus, Robot Parkour | Past: Google DeepMind, CMU, UCLA
Delip Rao e/σ @deliprao
61K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
FoloToy @folotoy
20K Followers 7 Following We are creating personalized companion AI toys for children. 🌵🌻 🧸🐼 FoloToy Store(Global free shipping): https://t.co/hspooM12X6
Adam Carrigan @AdamMCarrigan
19K Followers 3K Following Founder of AI startup @MindsDB 🚀 @Forbes Most Promising AI Companies, @Ycombinator (W20), @Cambridge_Uni Alum 🎓
Georgi Gerganov @ggerganov
52K Followers 289 Following 24th at the Electrica puzzle challenge | https://t.co/baTQS2bdia
Guillaume Lample @ Ne... @GuillaumeLample
41K Followers 655 Following Cofounder & Chief Scientist https://t.co/hLfvKLldwL (@MistralAI). Working on LLMs. Ex @MetaAI | PhD @Sorbonne_Univ_ | MSc @CarnegieMellon | X11 @Polytechnique
Andrej Karpathy @karpathy
1.4M Followers 1K Following Building @EurekaLabsAI. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets.
BlinkDL @BlinkDL_AI
9K Followers 150 Following RWKV = 100% RNN with GPT-level performance. https://t.co/TkdxOJSFWX and https://t.co/86DzS6arA0
Yann LeCun @ylecun
949K Followers 764 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
SpaceX @SpaceX
40.0M Followers 120 Following SpaceX designs, manufactures and launches the world’s most advanced rockets and spacecraft
Barret李靖 @Barret_China
76K Followers 378 Following Software Engineer | Lifelong Learner | Dad of 2 | AI Explorer | Cloud Native | Sharing insights and experiences | 📩 DM opened | 小胡子哥，一个有趣的灵魂
Google DeepMind @GoogleDeepMind
1.2M Followers 279 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Trends for United States
48,8 B posts
11,8 B posts
3.846 posts
5.914 posts
2.336 posts
22,8 B posts
12,7 B posts
4.454 posts
2,14 Mn posts
72,3 B posts
3.923 posts
49,9 B posts
2.841 posts
3.413 posts
3.658 posts
1.201 posts
188 B posts
29,2 B posts
1.223 posts
2.112 posts
You might like
Jason Lee
@huacnlee
9K Followers
Shek
@SShek
669 Followers
𝓧𝓲𝓷 𝓛𝓲
@delphij
9K Followers
chenwei
@chenwei8066
69 Followers
Fuzhou Chen, "the Sri...
@fuzhouch
229 Followers
Liút
@liut
1K Followers
smallfish
@smallfishxy
4K Followers
fatelei
@lei74557606
173 Followers