Meta · Llama
Meta's open-weight LLM family — the only frontier-tier model line shipped by a hyperscaler advertising company, with no native API business and the largest disclosed GPU fleet in the industry.
1. Core Product / Service
- Llama model family — Llama 1 (2023-02, leaked then partially open), Llama 2 (2023-07, open weights with community license), Llama 3 (2024-04, then 3.1 / 3.2 / 3.3), Llama 4 (2025) generation, with reports of a Llama 5 / next-gen line in development as of 2026. Mixture-of-Experts at the top end; Llama 4 introduced "Behemoth" / "Maverick" / "Scout" tiered SKUs spanning small-on-device to frontier-class parameter counts.
- License: Llama Community License Agreement — open weights with Acceptable Use Policy + a 700M monthly-active-user threshold above which Meta requires a separate commercial license. Permissive enough for ~99% of the developer ecosystem, restrictive enough that AWS / Google / Microsoft / TikTok-class platforms cannot freely commercialize Llama as their primary commercial model without a Meta agreement.
- Meta AI — the consumer-facing assistant integrated into Facebook, Instagram, WhatsApp, Messenger, and the standalone Meta AI app. Powered by Llama. This is the distribution moat — billions of users reachable without any new app.
- Ray-Ban Meta + Quest — embodied AI surfaces using Llama-derived multimodal models.
- No 1P API business — Meta does not sell Llama tokens commercially. There is no "Llama API" endpoint at meta.com. Llama is monetized entirely indirectly: ad targeting + engagement on Meta's own platforms, plus third-party hosting via together-ai, DeepInfra, Groq, Fireworks, AWS Bedrock, Azure AI, openrouter — none of which Meta takes a cut of.
2. Target Users & Pain Points
- Open-weight ecosystem — anyone running self-hosted inference (vLLM / SGLang / TGI via ai-inference-engines) for cost / privacy / customization reasons. Llama is the default open-weight choice in the Western ecosystem (Mistral and DeepSeek/Qwen split the rest).
- 3P inference providers — together-ai, DeepInfra, Groq, Fireworks, etc. monetize Llama-the-product without paying Meta licensing for sub-700M-MAU usage. Llama is the commodity supply that the L3b layer competes on.
- Meta itself — billions of consumer users via Meta AI in Facebook / Instagram / WhatsApp.
Pain solved (for the ecosystem): a credible open-weight frontier alternative to closed labs without the Chinese-origin geopolitical concerns of DeepSeek / Kimi / Qwen.
3. Competitive Landscape
| Lab | Origin | Open weights? | Frontier API? |
|---|---|---|---|
| Meta · Llama | US | Yes (community license) | No 1P API; 3P-distributed only |
| openai | US | Mostly no | Yes |
| anthropic | US | No | Yes |
| google-deepmind | US/UK | Hybrid (Gemma open) | Yes |
| mistral | France | Hybrid | Yes |
| deepseek | China | Yes (MIT + license) | Yes |
| kimi | China | Partial | Yes |
| qwen | Alibaba / China | Yes (Apache 2.0) | Yes via Alibaba Cloud |
Meta's positioning is uniquely structural: it is the only frontier-tier lab whose business model does not require Llama to generate token revenue. Meta's $150B+ annual revenue comes from advertising; Llama exists to (a) improve Meta's own products, (b) commoditize closed-AI competitors' moats, (c) attract talent / dev mindshare.
4. Unique Observations
Frontier training cost (Llama 4 / 5-class): Meta has been the most transparent of the closed-camp on capex. Mark Zuckerberg disclosed in 2024 that Meta would deploy roughly 350,000 H100-equivalent GPUs by end of 2024 and grow to ~600,000 H100-equivalents in the broader AI compute fleet. By 2025–2026 the fleet has crossed the 1M+ AI accelerator mark including B200 / Trainium-class additions. At those numbers, single-run frontier Llama 4-class training is plausibly multi-hundred-million to ~$1B compute-amortized, scaling further for Llama 5. This is frontier-bracket spend even though Meta does not publish the per-model number.
2026 capex escalation: In Q1 2026 earnings (April 29), Meta raised its full-year capex guidance to $125B–$145B, up from prior $120–$135B range — a roughly doubling of the 2025 capex ($60–$65B). Morningstar assigned a High Uncertainty Rating on the AI return on invested capital, reflecting Wall Street skepticism about whether the spending will deliver proportionate revenue growth. Meta announced it would cut 8,000 jobs to help fund the AI infrastructure expansion [CryptoBriefing, 2026-07-17; Yahoo Finance, 2026-07-12].
Hyperion AI supercluster: Meta's flagship AI training facility in Louisiana has been expanded to a planned 5GW capacity, with Louisiana investment now past $50 billion, plus over $1 billion in local infrastructure improvements. This makes Hyperion one of the largest single-site AI compute deployments globally [Tom's Hardware, 2026-07-13].
API pricing — top SKU: N/A — there is no Meta Llama API. The closest thing to a "list price" is the cost to run Llama on third-party inference providers. Reference prices (2026-05): Llama 3.3 70B / Llama 4 large MoE on together-ai / DeepInfra / Fireworks land in the $0.20–$0.90/M input · $0.30–$0.90/M output range — the cheapest open-weight frontier option in the Western stack. Meta captures zero of that revenue directly.
Pricing vs estimated unit cost — gross margin signal: this is the most distorted entry in the batch because Meta does not price Llama as a token product. The ~$0.50/M output 3P market price is set by competitive pressure between Together / DeepInfra / Fireworks / Groq — none of whom paid the training cost. Meta's effective "margin" on Llama is best measured as (ad revenue lift from Meta AI in FB/IG/WA) + (commoditization damage inflicted on OpenAI / Anthropic margins) − (training + inference capex). The first two terms are large and growing; the third is in the tens of billions per year. Whether the trade-off pencils out is a strategic, not unit-economics, question.
Open vs closed strategy + rationale: fully open weights (community license). Stated rationale, repeated by Zuckerberg in shareholder letters and the open-source AI manifesto (2024): (a) commoditize the model layer to prevent any single closed competitor from controlling the AI substrate Meta's products depend on; (b) attract developer + research mindshare to keep Meta's ML talent pipeline strong; (c) leverage external scrutiny + community contributions on safety / capability. The strategic logic is the inverse of OpenAI / Anthropic — those labs need closed weights to monetize tokens; Meta needs open weights so that no one ELSE controls a closed token monopoly that Meta would have to pay for.
No API biz — commercial implications: this is the cleanest test in the industry of whether distribution beats monetization in foundation models. Meta has spent more on Llama infrastructure than any Western lab except possibly OpenAI / Stargate, and earns no direct token revenue. The bet pays off if (a) Meta AI inside FB/IG/WA materially lifts ad revenue, and (b) a commoditized open-weight ecosystem prevents any single closed competitor from extracting Microsoft-style platform rents. Both are early-stage claims as of 2026.
Vertical integration — own DCs, NVIDIA-anchored, Trainium experiments: Meta operates its own hyperscale data center fleet (one of the four largest in the world along with AWS / Azure / GCP), purpose-built for the Llama training + recommendation-system workload. Hardware: NVIDIA H100 / H200 / B200 anchor (the ~350k+ H100 buildout disclosed 2024), supplemented by Meta's own MTIA (Meta Training and Inference Accelerator) custom silicon for inference-heavy recommendation workloads (deployed at growing scale). This is the deepest L3 → L1 vertical of any frontier lab outside Google — Meta owns the building, the network, the power, deploys NVIDIA + custom silicon, runs the largest training jobs in the industry on its own DCs. Compare: OpenAI Stargate (in build), xAI Colossus (built fast, single site), Anthropic (no DC), DeepSeek (no DC, rents High-Flyer-bought H800s), Google (full TPU + DC + fab partner, the closest peer).
Advertising vs research justification: Meta's full-year capex was ~$37B in 2024, then ~$60–$65B+ in 2025, and now guided to $125B–$145B in 2026. The majority of each increase is AI infrastructure — both for Llama training + Meta AI inference, and for the recommendation systems that drive Reels / FB / IG ad revenue. Q1 2026 revenue was $56.31B (up 33% YoY), showing the flywheel still works — ads pay for compute, compute trains Llama + recommendation models, those models lift ads. No other frontier lab has this loop [StartupHub.ai, 2026-07-18]. However, Wall Street is increasingly questioning whether the ROI on AI capex justifies the spending scale, as reflected in Morningstar's High Uncertainty Rating [CryptoBriefing, 2026-07-17].
5. Financials / Funding
- Parent / structure: Meta Platforms Inc. (NASDAQ: META). Llama is not separately funded — fully internal R&D under FAIR (Meta AI Research) plus the GenAI product team.
- 2024 revenue: ~$164B (full year). 2025 continued the growth trajectory.
- Q1 2026 revenue: $56.31B (up 33% YoY) [StartupHub.ai, 2026-07-18]
- 2025 capex: ~$60–$65B+, AI-weighted
- 2026 capex guidance: $125B–$145B (raised from $120–$135B in April 2026). Morningstar: High Uncertainty Rating on AI ROI. 8,000 job cuts announced to fund AI infrastructure [CryptoBriefing, 2026-07-17; Yahoo Finance, 2026-07-12]
- Hyperion supercluster: Louisiana, expanded to 5GW plan, >$50B investment [Tom's Hardware, 2026-07-13]
- GPU fleet disclosures: 350k H100-equivalents by end of 2024, growing to 600k+ by 2025, 1M+ AI accelerators by 2025–2026 including B200 / Trainium / MTIA
- Llama-specific revenue: $0 (no API). Indirect revenue (ad lift attributable to Meta AI) is not separately disclosed.
6. People & Relationships
- CEO: Mark Zuckerberg.
- Chief AI Scientist (FAIR): Yann LeCun — long-standing public advocate of open-source AI.
- GenAI product leadership: Ahmad Al-Dahle (VP GenAI), Joelle Pineau (head of FAIR Labs, prior).
- Notable alumni who left for AI labs: Guillaume Lample + Timothée Lacroix (founded mistral), many ex-FAIR researchers across the industry.
- Hardware partners: NVIDIA (H100 / H200 / B200 anchor), AMD (MI300X selected workloads), TSMC (MTIA fab partner), Broadcom (network).
- Distribution (3P, no Meta cut): together-ai, DeepInfra, Fireworks, Groq, AWS Bedrock, Azure AI, openrouter, Hugging Face.
- Competitors (closed): openai, anthropic, google-deepmind, xai.
- Competitors (open-weight): deepseek, kimi, qwen, mistral — the open-weight ecosystem Llama anchors but does not exclusively own.
Meta
Llama 3 披露最完整的闭口径 lab;Scale 49% 股东,LibGen 诉讼缠身
- 数据类型
- 自有平台与爬取;人标加合成后训练;交互数据换折扣
- 规模口径
- Llama 3 约 15T token(旗舰 15.6T);Llama 4 Scout 约 40T / Maverick 约 22T(官方模型卡)
数据路线一句话
L1 靠自有平台与爬取(含涉盗版书),L3 靠 Scale 加合成;Llama 3 是闭口径里披露最完整的 lab。
六层明细
- L1 语料 token:Llama 3 论文称在“约 15T 多语言 token”上预训练(旗舰 15.6T 文本 token,知识截至 2023 年底);数据混合约 50% 通用知识 / 25% 数学与推理 / 17% 代码 / 8% 多语言,已与论文原文核对 [1]。Llama 4 官方模型卡:Scout 约 40T、Maverick 约 22T token,预训练覆盖 200 种语言(官方支持 12 种),来源为“公开数据、授权数据与 Meta 产品及服务的信息”,含公开的 Facebook / Instagram 帖子及与 Meta AI 的交互,知识截至 2024-08 [4];发布稿“30T+”口径与模型卡并存。
- L2 授权交易:Reuters(2024-10)为 Meta AI 的实时内容,是否含训练权利不明;2025-12 起与 CNN、Fox News、USA Today、Le Monde 等签实时内容协议,主要用于 Meta AI 回答而非训练,财务条款未披露(2025-12-05 公布)[3];另有二手报道称 2026-03 与 News Corp 的协议据 WSJ 最高约 $5,000 万/年(未核)⚠️。
- L3 人工与供应商:scale-ai 49% 股东($143 亿($14.3B)换 49% 无投票权股份,Scale 估值 $290 亿,2025-06;Scale 确认估值,金额为媒体口径);Llama 3 后训练以 SFT + 拒绝采样 + DPO;论文称“大部分训练数据由模型生成”(如代码 SFT 合成样本超 270 万条);供应商名单未披露。
- L4 RL 环境:未披露。
- L5 合成蒸馏:Llama 3 后训练合成占大头(论文称大部分后训练数据为模型生成,代码合成样本 >270 万条;原稿“千万级”无据,已删);Llama 4 用 Behemoth 共蒸馏 [4]。
- L6 回流政策:Muse 贡献者档 $0.10 / $0.20 对标准档 $1.25 / $4.25(每百万 token输入/输出),换取允许 Meta 用提示与回复训练(多个二手来源一致,Meta 官方页未能直接读取;贡献者档速率上限也更低);详见 agent-trajectory-flywheel。
自建与供应商
混合;外采集中于 Scale。
反向供给与诉讼暴露
不发布训练集。Kadrey v. Meta 解封文书(经原告律师转述)称 Zuckerberg 批准使用 LibGen,员工称其为“已知盗版的数据集”,Meta 承认 torrent,并有脚本自动删除版权声明 [2];Chhabria 法官 2025-06-25 的 fair use 判决对 Meta 有利,但明确仅限于 13 名原告的本案记录、不构成普遍先例;torrent 分发相关主张仍未了结,原告的中间上诉申请已于 2026-07-08 被驳回。详见 kadrey-v-meta。
- https://arxiv.org/abs/2407.21783 (2026-10-15)
- https://techcrunch.com/2025/01/09/mark-zuckerberg-gave-metas-llama-team-the-ok-to-train-on-copyrighted-works-filing-claims (2026-10-15)
- https://rightstech.com/2025/12/meta-signs-raft-of-ai-content-licensing-deals/ (2026-10-15)
- https://charonhub.deeplearning.ai/meta-releases-llama-4-models-claims-edge-over-ai-competitors/ (2026-10-15)