Eval Sys @EvalSysOrg
EVAL SYS is a continuously evolving, open-source community! We are on a mission to track and advance model agentic capabilities. mcpmark.ai Joined August 2025-
Tweets16
-
Followers71
-
Following9
-
Likes31
š MCPMark website updated! ā mcpmark.ai On MCPMark, you can now dive into each taskās description, verification, and model performance. Weāve also added model trajectories to each task leaderboard, so you can clearly see how models execute step by step. Manyā¦
We believe MCP servers are shaping the future of software. Thatās why we built MCP Mark: a live benchmark for model mastery in real-world MCP use. Amazing experience collaborating with great friends & building communityāEvalSys will keep driving meaningful work for the community!
We believe MCP servers are shaping the future of software. Thatās why we built MCP Mark: a live benchmark for model mastery in real-world MCP use. Amazing experience collaborating with great friends & building communityāEvalSys will keep driving meaningful work for the community!
Excellent eval, and open weight models holding ground š
Excellent eval, and open weight models holding ground š
1/8) Excited to launch MCPMark (mcpmark.ai) today with NUS TRAIL and @EvalSysOrg! š„³ Itās a highāquality, programāverifiable benchmark for MCP (Model Context Protocol) ā designed to measure model's agentic capability & stability in MCP Use. Not another ālabāā¦
1/8) Excited to launch MCPMark (mcpmark.ai) today with NUS TRAIL and @EvalSysOrg! š„³ Itās a highāquality, programāverifiable benchmark for MCP (Model Context Protocol) ā designed to measure model's agentic capability & stability in MCP Use. Not another ālabāā¦
š šJust launched MCPMark, a challenging MCP benchmark I participated in. Its filesystem section include ops on files, structure exploration, reasoning, and multi-skill tasks. Most models show clear room for improvement, while GPT series excel in precise text manipulation
š šJust launched MCPMark, a challenging MCP benchmark I participated in. Its filesystem section include ops on files, structure exploration, reasoning, and multi-skill tasks. Most models show clear room for improvement, while GPT series excel in precise text manipulation
Excited to be part of @EvalSysOrg and contribute to our debut milestone, MCPMark! Follow us for updates, and come join the teamāweāre just getting started! Githubļ¼ github.com/eval-sys/mcpmaā¦ Websiteļ¼ mcpmark.ai Huggingface trajectory logļ¼ huggingface.co/datasets/Jakumā¦
Excited to be part of @EvalSysOrg and contribute to our debut milestone, MCPMark! Follow us for updates, and come join the teamāweāre just getting started! Githubļ¼ github.com/eval-sys/mcpmaā¦ Websiteļ¼ mcpmark.ai Huggingface trajectory logļ¼ huggingface.co/datasets/Jakumā¦
Sharing some of my thoughts when developing, hope they can help š 1/ Choosing the initial state defines task diversity, difficulty, and usefulness. 2/ State tracking and management is the trickiest stage. Each MCP needs its own isolation strategy. Worth it though: sandboxingā¦
Sharing some of my thoughts when developing, hope they can help š 1/ Choosing the initial state defines task diversity, difficulty, and usefulness. 2/ State tracking and management is the trickiest stage. Each MCP needs its own isolation strategy. Worth it though: sandboxingā¦
Thrilled to see MCPMark officially live! š @AnthropicAI's vision for MCP ā a universal, open standard for AI integrations ā is summed up perfectly by the āUSBāC port for AIā analogy: a single, reliable connector that lets LLMs access tools and data seamlessly. ļæ¼ Withā¦
Thrilled to see MCPMark officially live! š @AnthropicAI's vision for MCP ā a universal, open standard for AI integrations ā is summed up perfectly by the āUSBāC port for AIā analogy: a single, reliable connector that lets LLMs access tools and data seamlessly. ļæ¼ Withā¦
xinyuan @xinyuan820
86 Followers 339 Following
HumanistAtypik @HumanistAtypik
447 Followers 4K Following Humaniste donc Ʃcosocialiste. Radical mais rƩformiste. Neuroatypique : #hpi #tdah #dysgraphique. Iconoclaste anticonformiste mais pas anti-tout ! ;-) #ric
Bill Xue @allgenie_billxy
52 Followers 768 Following
Uprorvui @Uprorvui91443
29 Followers 495 Following
Zachary Schlosser @Zach_Schloss
396 Followers 3K Following Cultivating individual and collective wisdom. Global development | regional sovereignty | existential risk/hope. Header: Xavi Bou
Folyd @withfolyd
8K Followers 832 Following Founder of https://t.co/gyqbuSsS1F, prev co-founder of https://t.co/lLbH1ACK2o, creator of https://t.co/jyFtu8hcFQ, https://t.co/5dUgxzkPpI, https://t.co/FJyrd1TdNq, https://t.co/PmSGJqmoLX, and https://t.co/1XJ4CEQVzc
SwimmingLiu @SwimmingLiudev
27 Followers 345 Following š§š»āš» | 24yo. | AI / JavaBoy | CN / EN | Master in ZSTU | š¹
!.! @xypyth
46 Followers 4K Following
choupiyang-x @choupiyang4x
19 Followers 704 Following
lomohuang @huangfuyafei
263 Followers 444 Following 11 幓äŗ§åē»ēļ¼åŗęµ· 6 幓ļ¼ē®åå AI ēøå ³äŗ§åćäøęä¹čÆ“čÆļ¼ę éæå°¬čć
cjh @cuiyaohuawx
27 Followers 1K Following
YorkZ @YorkZhu2
915 Followers 1K Following Investor @genventurecap | CS @PKU1898 | Proud investor of @taikoxyz @Pi_Squared_Pi2 @DelphinusLab @megaeth_labs @HerodotusDev @InfraredFinance @KakarotZkEvm
Justin Lee @lis186
1K Followers 4K Following INTJ iOS éē¼č å°ē£ē«č»éå¤å©ę LINE ę©åØäŗŗ https://t.co/iwH8ex0T3k
Shik @ShikChen
202 Followers 5K Following
Yiqi Wang @YiqiWang119050
0 Followers 137 Following
girish sastry @girishsastry
2K Followers 4K Following AI & other things. I used to work at OpenAI on Policy Research.
Davis @huaopportunity
193 Followers 2K Following
shwinnabego Ashwinn @Shwinnabeg0811
8 Followers 170 Following
MF @ywvcaqsa
0 Followers 3K Following
Epsilon Guanlin Lee @Epsilon_Lee
256 Followers 3K Following PhD, MLer, CLer (NLPer), ML Engineer at https://t.co/gX6Lem59Co, have belief in interpretability research of AI/ML/NNs
BB @hgdduhgdr
101 Followers 3K Following
äŗå¾® @yunwei37
1K Followers 2K Following Stupid, but try to keep Learning, curiosity and Courage | Creator https://t.co/UWe3rFdsqC | eBPF & AI | Bring new orders and chaos! | šå„½å
Fan Zhou @FaZhou_998
1K Followers 833 Following PhD Student at SJTU, Qwen Coding @Alibaba_Qwen. Prev: Core member @XLangNLP, Intern @MSFTResearch.
LEO LI @Real_LCX
634 Followers 2K Following IM GPD-SM (Geopolitical Dynamics - System Model)äøäøŖęē„ęØę¼å¼ę (Strategic Deduction Engine)ćä»»å”ļ¼éčæåøę¶é«åŗ¦å¤ęēćå¤é¢åēč¾å „äæ”ęÆļ¼ęē»ę ”åå ¶åƹäøēęåčæč”č§å¾ēå éØęØ”åļ¼åŗäŗęØ”åļ¼åƹęŖę„ååŗåÆęę“åÆåēćé»č¾äø„č°ØēęØę¼ć
ē©ŗč°· Arvin Xu @arvin17x
7K Followers 463 Following Design Engineer / Founder of @LobeHub / core member of @AntDesignUI / ex AntGroup
TC @TheChaos_
128 Followers 150 Following šØ Product / UX / Visual / 3D Designer | š Frontend Development Enthusiast | š Working to create engaging digital experiences
jay @seekerum
111 Followers 1K Following
Adam Li @Adamli2000Li
4 Followers 34 Following
Zeyu Qin @ZeyuQin_alan
356 Followers 1K Following Ph.D. student of CSE at HKUST @hkust @hkustnlp. Scalable Oversight, AI Safety, Machine Learning
hoshiki @realChemark
126 Followers 2K Following å客ļ¼https://t.co/ddfYkONXuq ļ½å ¬ä¼å·ļ¼čµ¤čå°å
Jiawei Gu @Kuvvius
70 Followers 158 Following
dalexs @daleccsx
0 Followers 329 Following
Michael Johnson @onemoremichael
612 Followers 7K Following Dad, Co-Founder, Context Architect, Buchholz High School, Best Ideas Award winner (3rd grade, Norton Elementary)
Honsam Yip @yipzlf
15 Followers 173 Following A passionate believer in Intelligence. Grounded in Science.
Jiawei Wang @JarvisMSUstc
54 Followers 224 Following Joint PhD Candidate @USTC and @MSFTResearch. Intern @MSFTResearch @deepseek_ai @BytedanceTalk
Zijian Wu @Jaku_metsu
33 Followers 99 Following CS PhD Student at National University of Singaporešøš¬
Xiangyan Liu @dobogiyy
31 Followers 111 Following šøš¬ PhD Student @ NUS | Multimodal & Agentic Foundation Models
Michael Qizhe Shieh @michaelqshieh
1K Followers 315 Following Bringing good stuff to the world. CMU MLD phd. cooked with TPUs at Google Brain. Leading Tree and Rock AI Lab (TRAIL) at NUS (Singapore)
Arvin Xu @arvinxu95
33 Followers 115 Following Design Engineer / Founder and CEO of @lobehub / core member of @AntDesignUI / ex AntGroup
Allison Zhan @AllisonXinyuan
67 Followers 354 Following Investing in early stage AI. First partner to @lobehub , @klavis_ai , @LeptonAI (acq NVIDIA) etc. | co-founder of @EvalSysOrg | Views are my own
LobeHub @lobehub
3K Followers 36 Following Empowering your AI dreams with LobeHubš¤Æ LobeChat Cloud are Public Testing: https://t.co/jPxgXOr17uTrends for United States
You might like
