The one constant that I have observed in my professional life is that people underestimate the need to move fast. Of course, doing good work takes time. I once spent six months writing a URL parser. But the fact that it took so long is not a feature, it is…

An empirical study analyzing over 100 trillion tokens of real-world LLM interactions across tasks, geographies, and time.

“We see something that works, and then we understand it.” (Thomas Dullien) It is a deeper insight than it seems. Young people spend years in school learning the reverse: understanding happens before progress. That is the linear theory of innovation. So Isaac…

It is absolutely clear to me that large language models represent the most significant scientific breakthrough of the past fifty years. The nature of that breakthrough has far reaching implications for what is happening in science today. And I believe that…

Nix is a tool that takes a unique approach to package management and system configuration. Learn how to make reproducible, declarative and reliable systems.

Base64 is a binary-to-text encoding scheme that converts arbitrary binary data (like images, files, or any sequence of bytes) into a safe, printable ASCII string using a 64-character alphabet (A–Z, a–z, 0–9, +, /). Browsers use it in JavaScript to embedding…

Whenever I say I dislike debugging and organize my programming habits around avoiding it, there is always pushback: “You must not use a good debugger.” To summarize my view: I want my software to be antifragile (credit to Nassim Taleb for the concept). The…

The organizers of the 4th Data Prefetching Championship (DPC4) invite you to participate in the data prefetching competition and the subsequent workshop, which will be hosted in conjunction with HPCA 2026 at Sydney, Australia.
Summary
The goal of the competition…

背景 最近打算尝试微调 LLM 做一些科研有关的工作，但毕竟我之前不是做 AI 相关方向的因此自己并没有合适的 GPU 。目前多数开箱即用的模型训练都工作在 FP16 这样的精度（虽然有很多很多低精度训练的研究了），而不是推理常见的 INT4，因此仅仅 7B 参数完整载入就需要 14G 的 VRAM，再加上微调模型中所需的数据又需要额外的 VRAM，手里实在没有 VRAM 能超过 16G 的显卡。 于是，我就想起了手里 AMD Strix Halo，恰好最近（2025年11月） ROCm 7.1 刚刚发布，首次官方支持了…

NUMA, or Non-Uniform Memory Access, lets hardware expose affinity between cores and memory controllers to software. NUMA nodes traditionally aligned with socket boundaries, but modern server chips can subdivide a socket into multiple NUMA nodes. It’s a reflection…

众所周知，在镜像站界，PyPI 是个难伺候的主：大量的硬盘占用、巨大的流量、频繁的更新，还有不靠谱的同步工具 bandersnatch。你说为什么不靠谱？听说过其他 没有能力 删除上游删掉了的文件的同步工具吗？ 好在，伟大的 taoky 在去年写出了一个科学的同步工具 shadowmire，其中一大重要功能，就是能移除上游已经消失的版本和相关文件，为广大教育网镜像站节省了不少硬盘空间，也缓解了供应链攻击的风险。 然而，提供用户可用的 PyPI 镜像依旧没有那么简单。任何 HTTP 站点要被视作有效的 Python…

I maintain a few widely used libraries that have optimized code paths based on the specific processor being used. We started supporting Loongson processors in recent years, but I did not have access to a Loongson processor until now. To my knowledge, they…

Hello you fine Internet folks, Here at Supercomputing the Gordon Bell Prize is announced every year. The Gordon Bell Prize is awarded every year to recognize outstanding achievement in high-performance computing applications. One of this year’s finalist is…

Hello you fine Internet folks, Last week I was in San Diego at Qualcomm’s Headquarters where Qualcomm disclosed more information about their upcoming Snapdragon X2 Elite SOC. Snapdragon X2 Elite is Qualcomm’s newest SOC for the Windows on ARM ecosystem that…

在高性能计算场景中，能有效地测量和控制 CPU 功耗对于优化性能和能效至关重要。硬件厂商（如 Intel、AMD）提供了一些接口和工具，允许用户在不依赖外部硬件的情况下，进行带内（inband）的 CPU 功耗测量与限制。本文将简述常用的方法和工具。 基本概念 现代 CPU 的 TDP（热设计功耗）动辄上百瓦，服务器 CPU 更是达到了几百瓦的量级（如：AMD EPYC™ 9965 和 Intel® Xeon® 6962P Processor 的 TDP 都高达 500W）。再加上 turbo boost（睿频）等技术的加持，实际的…

Roughly speaking, our processors come in two types, the ARM processors found in your phone and the x64 processors made by Intel and AMD. The best server processors used to be made by Intel. Increasingly, Intel is struggling to keep up. Recently, Amazon has…

Today marks the fifth anniversary of the Apple silicon chip that replaced Intel chips in Apple's Mac lineup. The first Apple silicon chip, the M1, was unveiled on November 10, 2020. The M1 debuted in the MacBook Air, Mac mini, and 13-inch MacBook Pro.