Field Notes · Closing

LLMs: Intelligence vs. Cost

This article discusses the tradeoff between the intelligence capabilities and computational cost of large language models.

The efficient frontier of LLM inference

This item discusses optimization strategies for reducing computational costs and latency in large language model inference.

WebLLM: high-performance in-browser LLM inference engine

WebLLM is an inference engine that runs large language models directly in web browsers.