AI 基础设施工具

分类导读

该分类收录模型 API、推理平台、向量与数据层、代理运行和可观测工具。评估重点是可验证的性能成本、故障边界、数据路径以及对单一供应商的依赖程度。

选择维度

• 支持的模型、区域、部署形态和数据路径
• 延迟、吞吐、额度、隐藏成本和容量上限
• 日志、评测、追踪、告警和故障降级能力
• 认证授权、密钥管理、数据保留与供应商迁移

使用提醒

应使用代表性负载做容量、质量和成本测试，并预先设计限流、降级、回滚和密钥轮换。宣传中的基准不能替代自身数据与工作流验证。

• Anthropic Freemium ★4.93
  AI safety company building Claude and pioneering Constitutional AI — $61B valuation.
• Browser Use Freemium ★4.93
  Most popular open-source framework for AI browser agents — 89% on WebVoyager benchmark, the OSS that backs many production browser-using AI products.
• Cerebras Paid ★4.93
  Platform for AI training with unique wafer-scale technology.
• Dataiku Paid ★4.93
  Dataiku is the world’s leading platform for Everyday AI, systemizing data use for exceptional business results
• fal.ai Freemium ★4.93
  Fastest generative AI platform for developers — 1,000+ image, video, audio, and 3D models with optimized real-time inference. Default home for FLUX, SAM, MuseTalk.
• FluidStack Paid ★4.93
  FluidStack: On-demand GPU servers for ML, rendering, and general compute tasks.
• FLUX by Black Forest Labs Freemium ★4.93
  Frontier image generation and editing models from Black Forest Labs, the FLUX family.
• NVIDIA AI Paid ★4.93
  NVIDIA AI is the world's most advanced platform for enterprise AI solutions.
• Ollama Free ★4.93
  Ollama is a local LLM runtime that downloads, runs, and serves open models on your own hardware via a CLI and an OpenAI-compatible API.
• Ray Paid ★4.93
  Ray is an open-source unified compute framework designed to scale AI and Python workloads seamlessly.
• Scale AI Paid ★4.93
  Scale AI delivers high-quality training data for AI applications, powering generative AI, automotive AI, and government AI.
• Temporal Freemium ★4.93
  Temporal is a durable execution platform that runs long-running microservice and AI agent workflows reliably, surviving crashes and restarts without losing
• Thinking Machines Lab Freemium ★4.93
  Frontier AI lab founded by ex-OpenAI CTO Mira Murati. $2B seed at $12B valuation, in talks for $50-60B. Building useful and safe AI.
• Vercel AI SDK Free ★4.93
  Universal TypeScript SDK from Vercel for building AI apps and agents with multi-model support.
• Altair Freemium ★4.92
  AI, simulation, and HPC platform from Altair (now part of Siemens). RapidMiner data science plus structural, fluid, and electromagnetic simulation in one s
• Browserbase Freemium ★4.92
  Cloud headless browsers for AI agents — production-grade infrastructure for web automation, scraping, and agent workflows.
• CrewAI Freemium ★4.92
  Multi-agent platform for enterprises to operate teams of AI agents on complex, autonomous tasks.
• Cyera Freemium ★4.92
  AI-native data security platform for discovery, classification, and protection. Sequoia/Accel-backed unicorn; Forbes AI 50 2026.
• Factory Droid Paid ★4.92
  Agent-native software development platform with autonomous Droids that handle the full SDLC — coding, incidents, docs, missions over multi-day horizons.
• Hightouch Freemium ★4.92
  Composable CDP + AI Decisioning — sit on any data warehouse, deploy AI agents that personalize at scale. $80M Series C from Sapphire, ICONIQ, others.
• Lambda Labs Paid ★4.92
  Commercial-grade GPU solutions for deep learning and AI.
• Palantir AIP Paid ★4.92
  Palantir AIP offers secure AI deployment on private networks, ensuring enterprise-level control, compliance, and collaboration.
• Redis Freemium ★4.92
  Redis is an in-memory data store used as a vector database, semantic cache and memory layer for AI and agent applications.
• Surge AI Freemium ★4.92
  Premium AI data labeling for frontier labs. Used by Anthropic, OpenAI, and major foundation labs for high-quality RLHF training data.
• turbopuffer Paid ★4.92
  Serverless vector and full-text search built on object storage — powers Cursor, Notion AI, Linear, Superhuman. 95% cost reduction vs traditional vector DBs.
• IBM Watsonx Paid ★4.91
  IBM Watsonx provides a comprehensive suite for AI deployment, data management, and governance, tailored for business needs.
• Kore.ai Paid ★4.91
  Enterprise agentic AI platform — Kore.ai Agent Platform delivers AI for Work, Service, and Process across customer service, HR, and IT. Gartner MQ Leader.
• LiveKit Freemium ★4.91
  Build voice, video, and physical AI agents on real-time infrastructure — open-source LiveKit Agents framework + LiveKit Cloud managed deployment. Series C-funded.
• Neo4j Freemium ★4.91
  Neo4j is a graph database that powers knowledge graphs and GraphRAG so AI apps can ground answers in connected, verifiable relationships.
• RunPod Paid ★4.91
  Globally distributed GPU cloud for AI tasks.
• Weaviate Freemium ★4.91
  Open-source vector database for storing data objects and vector embeddings
• WorkOS Freemium ★4.91
  WorkOS is an enterprise-readiness platform that adds SSO, SCIM and audit logs to apps so teams, including AI companies, can sell to enterprises.
• Cloudflare Freemium ★4.89
  Global edge network for deploying, securing, and speeding up apps — CDN, Workers, R2, and Workers AI — with an official MCP server for AI agents.
• Elastic Freemium ★4.87
  Search AI platform pairing Elasticsearch retrieval with vector search for RAG, observability, and security.
• Groq Paid ★4.87
  Enterprise-scale AI solutions for ultra-fast language processing and inference.
• Z.ai Freemium ★4.87
  Z.ai is an AI model lab offering the GLM frontier model family via a free chatbot, coding plans, and an API.
• Amazon SageMaker Freemium ★4.86
  Fully managed service for building, training, and deploying ML models.
• Datarobot Paid ★4.86
  Open platform driving generative and predictive AI solutions.
• LangSmith Freemium ★4.86
  AI agent observability platform — tracing, monitoring, and evals for any agent stack.
• LlamaIndex Freemium ★4.86
  Document OCR for the agentic stack — LlamaParse turns complex docs into model-ready data.
• Apache Spark Paid ★4.85
  Unified engine for large-scale data analytics and machine learning.
• Coder Freemium ★4.85
  Self-hosted cloud development environments where developers and AI coding agents work on your infrastructure.
• Cohere Freemium ★4.85
  Unlock powerful semantic search, content generation, and intent recognition with Cohere's advanced models.
• Context7 Freemium ★4.85
  Context7 is an MCP server by Upstash that feeds AI code editors current, version-specific library docs and examples to cut hallucinated APIs.
• MongoDB Atlas Vector Search Freemium ★4.85
  MongoDB Atlas Vector Search adds semantic vector search to your database for RAG and AI agents.
• Prime Intellect Freemium ★4.85
  Prime Intellect is a decentralized AI training platform with a GPU marketplace and open RL environments hub.
• Qdrant Freemium ★4.85
  Open-source vector database and search engine.
• SerpApi Freemium ★4.85
  Search engine results APIs turning Google and 60+ engines into structured JSON for devs and AI apps.
• Telnyx Free Trial ★4.85
  Voice AI agents built on Telnyx-owned telephony and GPU inference for sub-second conversational calls.
• UnifyApps Paid ★4.85
  Enterprise AI operating system: agents, 950+ connectors, and a unified knowledge graph with governance.
• AgentOps Freemium ★4.84
  Agent observability platform for OpenAI, CrewAI, Autogen, and 400+ LLMs. Visually track LLM calls, tools, multi-agent flows. Rewind and replay runs.
• Arcee AI Freemium ★4.84
  Arcee AI is a small language model platform that trains and deploys open-weight models for enterprises.
• Cognee Freemium ★4.84
  Open-source memory engine that turns your data into knowledge graphs AI agents recall across sessions.
• Cognite Paid ★4.84
  AI-powered Industrial DataOps platform enhancing industrial workflow efficiency.
• Emissary Paid ★4.84
  Enterprise platform for training, distilling, and evaluating custom AI models that replace frontier calls.
• Foam Paid ★4.84
  AI-native observability that auto-instruments your codebase and root-causes production breakages.
• Granica Paid ★4.84
  AI-native data platform cutting data lake costs and giving long-running agents persistent state.
• InsightFinder Free Trial ★4.84
  AIOps platform that predicts incidents up to 6 hours ahead and monitors AI model drift in production.
• LanceDB Freemium ★4.84
  AI-native multimodal lakehouse and serverless vector DB — embedded retrieval for production-scale generative AI, open source, YC-backed.
• Langfuse Freemium ★4.84
  Open-source LLM engineering platform — tracing, evals, prompt management, and metrics.
• Mixedbread Freemium ★4.84
  Multimodal search API with open-source embedding and reranking models for RAG and retrieval.
• Morph Freemium ★4.84
  Morph is a code-editing model API that merges AI-generated edits into files at 10,000+ tokens per second.
• Netlify Freemium ★4.84
  Web platform for modern frontend teams. Edge-deployed hosting, serverless functions, and AI-assisted development. 5M+ developers; $200M+ raised.
• Network Optix Paid ★4.84
  Enterprise video OS managing 4M+ devices in 190 countries, with edge AI model deployment for camera fleets.
• Nimble Free Trial ★4.84
  Web search agents that turn live public web data into structured, real-time datasets for AI and analytics.
• Not Diamond Paid ★4.84
  Not Diamond is a model routing layer that selects the right LLM for each query to raise quality and cut costs.
• OpenRouter Freemium ★4.84
  Unified API and marketplace for the best LLMs at the best prices for any prompt.
• Oumi Free ★4.84
  Oumi is an unconditionally open-source AI lab building foundation models with the full pipeline open. Founded by ex-Apple, ex-Meta, ex-Google leaders.
• Pinecone Paid ★4.84
  Pinecone: Transforming Vector Search for Enhanced Data Retrieval
• Poolside Paid ★4.84
  Poolside builds frontier AI foundation models specialized for code generation. $626M Series B at $3B valuation; founded by ex-GitHub CTO Jason Warner.