writing
Thoughts on engineering leadership, distributed systems, architecture, and the craft of building software.
192 essays and counting
2023: The Year LLMs Ate the World
Looking back on a year that transformed AI from a research curiosity into a force reshaping every industry
Mixtral 8x7B and the Rise of Mixture of Experts
Mistral AI's Mixtral model demonstrates that mixture of experts architectures can deliver frontier-class performance efficiently
Google Gemini: DeepMind's Multimodal Answer to GPT-4
Google launches Gemini, its most capable AI model, built from the ground up for multimodal reasoning
re:Invent 2023: Amazon Bedrock and the Enterprise GenAI Stack
AWS re:Invent 2023 puts generative AI at the center of Amazon's cloud strategy with Bedrock and new services
The OpenAI Board Crisis: Five Days That Shook AI
Sam Altman's firing and rehiring at OpenAI exposes the tensions at the heart of AI development
OpenAI DevDay: GPTs, Assistants API, and the Platform Play
OpenAI's first developer conference reveals its vision for an AI application platform
My First Steps in AI Research
Documenting my journey from infrastructure engineer to hands-on AI researcher and builder
Tool Use, Function Calling, and the Future of AI Integration
The emergence of structured tool use and function calling in LLMs points toward a protocol-driven future for AI integration
Meta's Llama 2 and the Rise of Open Source LLMs
Llama 2's open release changes the dynamics of AI development and gives enterprises new deployment options
LangChain, LlamaIndex, and the AI Tooling Explosion
The AI framework ecosystem is exploding with tools for building LLM-powered applications
Anthropic and Claude: The Safety-First Approach to AI
Anthropic's Claude model and Constitutional AI represent a fundamentally different philosophy in the AI race
Pivoting My Career Toward AI
After years in cloud infrastructure, I am making a deliberate shift toward AI and large language models
AutoGPT and the Dawn of Autonomous AI Agents
AutoGPT introduces the concept of autonomous AI agents that can decompose tasks and execute multi-step plans
GPT-4 Is Multimodal and It Changes Everything
GPT-4 launches with multimodal capabilities, passing professional exams and setting a new benchmark for AI
Google Bard and the LLM Race Heats Up
Google announces Bard in response to ChatGPT, and the large language model race officially begins
Microsoft's Billion-Dollar Bet on OpenAI and the AI Arms Race
Microsoft's massive investment in OpenAI signals a new era of AI competition among the tech giants