Published signals
Signals
Browse the published AI technology signals and decide which to read first.
Titles and summaries are in English where the source is; the editors' notes and signals from Chinese sources are in Chinese.
Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs
Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs
For 训练或继续预训练 MoE 模型的研究团队、负责大规模训练集群效率的基础设施工程师
BenchMIRT: What are LLM benchmarks actually measuring?
A new method for auditing LLM benchmarks at the level of individual prompts, using multidimensional item response theory.
For 要为自己的系统挑选或裁剪评测集的评估负责人、在读厂商公布的安全类分数并判断其含义的技术决策者
TutorMoments: Do AI tutors know when to help and when to hold back?
A replay-based evaluation built off real one-on-one math tutoring sessions, measuring whether LLMs can balance when to step in and when to hold back.
For 在设计智能体评测的团队：回放式评测是一个可直接复用的方法样本、做需要克制的产品的团队——该问的时候别替用户决定、该停下的时候别继续
What building Shippy taught us about building agents
Ai2's Skylight team shares engineering lessons from Shippy, a maritime-domain-awareness agent serving analysts in 70+ countries, and open-sources the OpenClaw agent framework, the Harbor evaluation framework and the Mothership hosting platform.
For 把智能体推向生产环境的工程团队、智能体平台与基础设施建设者