LM Market Cap: LLM Pricing and Performance Data
Link: https://lmmarketcap.com/
What Is This?
LM Market Cap is a data-tracking website that provides real-time stats on Large Language Models (LLMs). It monitors the performance, pricing, and technical limits of both proprietary models (like GPT-4) and open-source models (like Llama). It serves as a central hub for comparing model value and efficiency.
Content and Scope
The site tracks specific metrics including cost per million tokens, context window size, output speed, and latency. It also features leaderboards that rank models based on their ability to write code or follow complex instructions, using data from real-world testing environments.
Relevance to Your Work
Because model pricing and capabilities change almost weekly, this site is essential for managing the costs of an AI project. It allows you to see when a cheaper model becomes available that matches the performance of a more expensive one. If you’re building a cost-sensitive application or need to choose between models, this is the authoritative source for current data.
Tips for Effective Use
- Check the “Price per 1M Tokens” column regularly to optimize your API spend. Switching to a more efficient model can significantly lower your project costs.
- Look at the “Coding” specific rankings if your project involves software development, as these models are tested on their ability to handle syntax and logic.
- Use the comparison tool to view two models side-by-side to see a full comparison of the capabilities and costs of the two models