# Portkey Docs

> Comprehensive documentation for Portkey's AI Gateway, Guardrails, Observability, Prompts, and Governance features.

## Docs

- [What is Portkey?](https://portkey-docs-migration-03-llm-providers.mintlify.site/introduction/what-is-portkey.md): Portkey AI is a comprehensive platform designed to streamline and enhance AI integration for developers and organizations. It serves as a unified interface for interacting with over 250 AI models, offering advanced tools for control, visibility, and security in your Generative AI apps.
- [Make Your First Request](https://portkey-docs-migration-03-llm-providers.mintlify.site/introduction/make-your-first-request.md): Integrate Portkey and analyze your first LLM call in 2 minutes!
- [Portkey Features](https://portkey-docs-migration-03-llm-providers.mintlify.site/introduction/feature-overview.md): Explore the powerful features of Portkey
- [Observability (OpenTelemetry)](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability.md): Gain real-time insights, track key metrics, and streamline debugging with our comprehensive observability suite.
- [OpenTelemetry for LLM Observability](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/opentelemetry.md): Leverage OpenTelemetry with Portkey for comprehensive LLM application observability, combining gateway insights with full-stack telemetry.
- [Supported OTel Libraries](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/opentelemetry/list-of-supported-otel-instrumenters.md): Portkey works with any OpenTelemetry-compatible instrumentation. Here are some popular options.
- [Logs](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/logs.md): The Logs section presents a chronological list of all the requests processed through Portkey.
- [Tracing](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/traces.md): The **Tracing** capabilities in Portkey empowers you to monitor the lifecycle of your LLM requests in a unified, chronological view.
- [Analytics](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/analytics.md)
- [Feedback](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/feedback.md): Portkey's Feedback APIs provide a simple way to get weighted feedback from customers on any request you served, at any stage in your app.
- [Metadata](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/metadata.md): Add custom context to your AI requests for better observability and analytics
- [Filters](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/filters.md)
- [Logs Export](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/logs-export.md): Easily access your Portkey logs data for further analysis and reporting
- [Model Pricing and Cost Management](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/cost-management.md): Learn how Portkey handles pricing data, cost calculations, and pricing updates across different deployment modes.
- [Budget Limits](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/budget-limits.md)
- [Auto-Instrumentation [BETA]](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/observability/auto-instrumentation.md): Portkey's auto-instrumentation allows you to instrument tracing and logging for multiple LLM/Agent frameworks and view the logs, traces, and metrics in a single place.
- [AI Gateway](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway.md): The world's fastest AI Gateway with advanced routing & integrated Guardrails.
- [Universal API](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/universal-api.md): Portkey's Universal API provides a consistent interface to integrate a wide range of modalities (text, vision, audio) and LLMs (hosted OR local) into your apps.
- [Configs](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/configs.md): This feature is available on all Portkey plans.
- [Remote MCP](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/remote-mcp.md): Portkey's AI gateway has MCP server support that many foundational model providers offer.
- [Conditional Routing](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/conditional-routing.md)
- [Multimodal Capabilities](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/multimodal-capabilities.md)
- [Image Generation](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/multimodal-capabilities/image-generation.md): Portkey's AI gateway supports image generation capabilities that many foundational model providers offer.
- [Function Calling](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/multimodal-capabilities/function-calling.md): Portkey's AI Gateway supports function calling capabilities that many foundational model providers offer. In the API call you can describe functions and the model can choose to output text or this function name with parameters.
- [Vision](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/multimodal-capabilities/vision.md): Portkey's AI gateway supports vision models like GPT-4V by OpenAI, Gemini by Google and more.
- [Text-to-Speech](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/multimodal-capabilities/text-to-speech.md): Portkey's AI gateway currently supports text-to-speech models on `OpenAI` and `Azure OpenAI`.
- [Speech-to-Text](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/multimodal-capabilities/speech-to-text.md): Portkey's AI gateway supports STT models like Whisper by OpenAI.
- [Thinking Mode](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/multimodal-capabilities/thinking-mode.md)
- [Cache (Simple & Semantic)](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/cache-simple-and-semantic.md)
- [Fallbacks](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/fallbacks.md)
- [Automatic Retries](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/automatic-retries.md): LLM APIs often have inexplicable failures. With Portkey, you can rescue a substantial number of your requests with our in-built automatic retries feature.
- [Circuit Breaker](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/circuit-breaker.md): Configure per-strategy circuit protection and failure handling
- [Realtime API](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/realtime-api.md): Use OpenAI's Realtime API with logs, cost tracking, and more!
- [Load Balancing](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/load-balancing.md): Load Balancing feature efficiently distributes network traffic across multiple LLMs.
- [Canary Testing](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/canary-testing.md): You can use Portkey's AI gateway to also canary test new models or prompts in different environments.
- [Strict OpenAI Compliance](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/strict-open-ai-compliance.md)
- [Virtual Keys](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/virtual-keys.md): Portkey's virtual key system allows you to securely store your LLM API keys in our vault, utilizing a unique virtual identifier to streamline API key management.
- [Budget Limits](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/virtual-keys/budget-limits.md): Budget Limits lets you set cost limits on providers/integrations
- [Rate Limits](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/virtual-keys/rate-limits.md): Set Rate Limts to your Integrations/Providers
- [Connect Bedrock with Amazon Assumed Role](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/virtual-keys/bedrock-amazon-assumed-role.md): How to create a new integration for Bedrock using Amazon Assumed Role Authentication
- [Request Timeouts](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/request-timeouts.md): Manage unpredictable LLM latencies effectively with Portkey's **Request Timeouts**.
- [Files](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/files.md): Upload files to Portkey and reuse the content in your requests
- [Unified Batch Inference](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/batches.md): Run large‑scale inference jobs through one consistent endpoint
- [Fine-tuning](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/ai-gateway/fine-tuning.md): Run your fine-tuning jobs with Portkey Gateway
- [Model Catalog](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/model-catalog.md): A single pane to view and manage every AI provider and model in your organization. It provides centralized governance, discovery, and usage controls for all your AI resources.
- [Integrations](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/model-catalog/integrations.md): Securely store and manage AI provider credentials across your organization with centralized governance controls
- [Budget Limits](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/model-catalog/budget-limits.md)
- [Rate Limits](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/model-catalog/rate-limits.md)
- [Workspace Provisioning](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/model-catalog/workspace-provisioning.md)
- [AI Model Provisioning](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/model-catalog/model-provisioning.md)
- [Adding Custom Models](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/model-catalog/custom-models.md): Learn how to add custom and fine-tuned models to your Portkey Model Catalog for seamless integration.
- [Overriding Model Details](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/model-catalog/model-overrides.md): Learn how to set custom pricing for any base model in your Portkey Model Catalog to reflect your specific costs.
- [Connect Bedrock with Amazon Assumed Role](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/model-catalog/connect-bedrock-with-amazon-assumed-role.md): How to create an integrate Bedrock using Amazon Assumed Role Authentication on Portkey
- [MCP Gateway](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/mcp-gateway.md): The universal adapter for Model Context Protocol—connect once, access every MCP tool .
- [Quickstart](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/mcp-gateway/quickstart.md)
- [Architecture](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/mcp-gateway/architecture.md)
- [Deployment](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/mcp-gateway/deployment.md)
- [MCP Hub](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/mcp-gateway/mcp-hub.md): Portkey's MCP Hub to connect 1600+ LLMs with any Remote MCP Server
- [MCP Clients](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/mcp-gateway/mcp-clients.md)
- [Prompt Engineering Studio](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/prompt-engineering-studio.md)
- [Prompt Playground](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/prompt-engineering-studio/prompt-playground.md)
- [Prompt Library](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/prompt-engineering-studio/prompt-library.md)
- [Prompt Versioning & Labels](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/prompt-engineering-studio/prompt-versioning.md)
- [Prompt Observability](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/prompt-engineering-studio/prompt-observability.md)
- [Prompt Partials](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/prompt-engineering-studio/prompt-partial.md): With Prompt Partials, you can save your commonly used templates (which could be your instruction set, data structure explanation, examples etc.) separately from your prompts and flexibly incorporate them wherever required.
- [Prompt API](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/prompt-engineering-studio/prompt-api.md): Learn how to integrate Portkey's prompt templates directly into your applications using the Prompt API
- [Tool Library](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/prompt-engineering-studio/tool-library.md)
- [Integrations](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/prompt-engineering-studio/prompt-integration.md)
- [Guides](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/prompt-engineering-studio/prompt-guides.md): Learn how to get the most out of Portkey Prompts with these practical guides
- [Guardrails](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/guardrails.md): Ship to production confidently with Portkey Guardrails on your requests & responses
- [List of Guardrail Checks](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/guardrails/list-of-guardrail-checks.md)
- [Guardrails for Embedding Requests](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/guardrails/embedding-guardrails.md): Apply security and data validation measures to vector embedding requests to protect sensitive information and ensure data quality.
- [Creating Raw Guardrails (in JSON)](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/guardrails/creating-raw-guardrails-in-json.md): With the raw Guardrails mode, we let you define your Guardrail checks & actions however you want, directly in code.
- [PII Redaction](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/guardrails/pii-redaction.md): Replace any sensitive data in requests with standard identifiers
- [MCP](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/mcp.md)
- [Enforcing Request Metadata](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/enforcing-request-metadata.md)
- [Enforcing Org Level Guardrails](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/enforce-orgnization-level-guardrails.md)
- [Enforcing Workspace Level Guardrails](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/enforce-workspace-level-guardials.md)
- [Configure Request Logging](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/configuring-request-logging.md): Control what data is stored for all LLM requests in your organization
- [Enforcing Default Configs on API Keys](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/enforce-default-config.md): Learn how to attach default configs to API keys for enforcing governance controls across your organization
- [Enforce Budget Limits and Rate Limits for Your API Keys](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/enforce-budget-and-rate-limit.md): Configure budget and rate limits on API keys to effectively manage AI spending and usage across your organization
- [Enforce Workspace Budget and Rate Limits](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/enforce-workspace-budget-limts-and-rate-limits.md): Configure budget and rate limits at the workspace level to effectively manage AI spending and resource allocation
- [Configure Logs Access Permissions for Workspace](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/configure-logs-access-permissions-in-workspace.md)
- [Configure Virtual Key Access Permission for Workspaces](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/configure-virtual-key-access-permissions.md)
- [Configure API Key Access Permissions for Workspaces](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/configure-api-key-access-permissions.md)
- [Configure Workspace Provisioning for Your AI Integrations](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/configure-workspace-provisioning-for-your-ai-integrations.md)
- [Configure Model Access Permissioning for AI Integrations](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/configure-model-access-permissioning-for-ai-integratinon.md)
- [Enforce Rate Limits on Your AI Provider](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/enforce-rate-limits-on-your-ai-provider.md)
- [Enforce Budget Limits on Your AI Provider](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/administration/enforce-budget-limits-on-your-ai-provider.md)
- [Enterprise Offering](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering.md)
- [Org Management](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management.md): A high-level introduction to Portkey's organization management structure and key concepts.
- [Organizations](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management/organizations.md): Understand the role and features of Organizations, the highest level of abstraction in Portkey's structure.
- [Workspaces](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management/workspaces.md): Explore Workspaces, the sub-organizational units that enable granular project and team management.
- [User Roles & Permissions](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management/user-roles-and-permissions.md): Learn about Portkey's comprehensive role-based access control system across Organizations and Workspaces.
- [API Keys (AuthN and AuthZ)](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management/api-keys-authn-and-authz.md): Discover how Admin and Workspace API Keys are used to manage access and operations in Portkey.
- [JWT Authentication](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management/jwt.md): Configure JWT-based authentication for your organization in Portkey
- [Overview](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management/scim/scim.md): SCIM integration with Portkey.
- [SCIM Group Management](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management/scim/group-management.md): Map SCIM groups to Portkey workspaces and roles without naming restrictions.
- [Azure Entra](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management/scim/azure-ad.md): Setup Azure Entra for SCIM provisioning with Portkey.
- [Okta](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management/scim/okta.md): Set up Okta for SCIM provisioning with Portkey.
- [SSO](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/org-management/sso.md): SSO support for enterprises
- [Access Control Management](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/access-control-management.md): With customizable user roles, API key management, and comprehensive audit logs, Portkey provides the flexibility and control needed to ensure secure collaboration & maintain a strong security posture
- [Budget Limits](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/budget-limits.md)
- [Security @ Portkey](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/security-portkey.md): Portkey AI provides a secure, reliable AI gateway for the seamless integration and management of large language models (LLMs).
- [OTel Integration (Analytics Data)](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/analytics-logs-export.md)
- [Logs Export](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/logs-export.md)
- [Audit Logs](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/audit-logs.md): Track and monitor all administrative activities across your Portkey organization with comprehensive audit logging.
- [Budget Policies](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/budget-policies.md): Manage usage limits and rate limits policies for your organisation
- [Enterprise Components](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/components.md)
- [KMS Integration](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/enterprise-offering/kms.md): Customers can bring their own encryption keys to Portkey AI to encrypt data at storage.
- [Open Source](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/open-source.md)
- [Feature Comparison](https://portkey-docs-migration-03-llm-providers.mintlify.site/product/product-feature-comparison.md): Comparing Portkey's Open-source version and Dev, Pro, Enterprise plans.
- [Enterprise Architecture](https://portkey-docs-migration-03-llm-providers.mintlify.site/self-hosting/hybrid-deployments/architecture.md): Comprehensive guide to Portkey's hybrid deployment architecture for enterprises
- [EKS](https://portkey-docs-migration-03-llm-providers.mintlify.site/self-hosting/hybrid-deployments/aws/eks.md): This enterprise-focused document provides comprehensive instructions for deploying the Portkey software in a hybrid mode on Amazon EKS clusters, designed to meet the needs of large-scale, mission-critical applications. It includes specific recommendations for component sizing, high availability, and…
- [AWS Marketplace](https://portkey-docs-migration-03-llm-providers.mintlify.site/self-hosting/hybrid-deployments/aws/marketplace.md): This enterprise-focused document provides comprehensive instructions for deploying the Portkey software using AWS Marketplace.
- [GCP](https://portkey-docs-migration-03-llm-providers.mintlify.site/self-hosting/hybrid-deployments/gcp.md): This enterprise-focused document provides comprehensive instructions for deploying the Portkey software on Google Cloud Platform (GCP), tailored to meet the needs of large-scale, mission-critical applications.
- [Azure](https://portkey-docs-migration-03-llm-providers.mintlify.site/self-hosting/hybrid-deployments/azure.md): This enterprise-focused document provides comprehensive instructions for deploying the Portkey software on Azure Kubernetes Service (AKS), tailored to meet the needs of large-scale, mission-critical applications. It includes specific recommendations for component sizing, high availability, and integ…
- [Prometheus Metrics](https://portkey-docs-migration-03-llm-providers.mintlify.site/self-hosting/prometheus-metrics.md): Comprehensive monitoring and observability for Portkey Enterprise Gateway through Prometheus metrics
- [Upgrade to Model Catalog](https://portkey-docs-migration-03-llm-providers.mintlify.site/support/upgrade-to-model-catalog.md): Learn how to upgrade to Model Catalog to replace Virtual Keys
- [Contact Us](https://portkey-docs-migration-03-llm-providers.mintlify.site/support/contact-us.md)
- [Developer Forum](https://portkey-docs-migration-03-llm-providers.mintlify.site/support/developer-forum.md): Are you navigating the challenging journey of transitioning LLMs from prototype stages to full-scale production? You're not alone. As this frontier of technology continues to expand, the roadmap isn't always clear. Best practices, guidelines, and efficient methodologies are still on the horizon.
- [Common Errors & Resolutions](https://portkey-docs-migration-03-llm-providers.mintlify.site/support/common-errors-and-resolutions.md): Since Portkey functions as a gateway - you may encounter Portkey-related, as well as non-Portkey related errors while using our services.
- [December '23 Migration](https://portkey-docs-migration-03-llm-providers.mintlify.site/support/portkeys-december-migration.md)
- [Submit an Integration](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/partner.md)
- [Files](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/llms/vertex-ai/files.md): Upload files to Google Cloud Storage for Vertex AI fine-tuning and batch inference
- [Batches](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/llms/vertex-ai/batches.md): Perform batch inference with Vertex AI
- [Fine-tune](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/llms/vertex-ai/fine-tuning.md): Fine-tune your models with Vertex AI
- [Controlled Generations](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/llms/vertex-ai/controlled-generations.md): Controlled Generations ensure that the model always follows your supplied [JSON schema](https://json-schema.org/overview/what-is-jsonschema). Portkey supports Vertex AI's Controlled Generations feature out of the box with our SDKs & APIs.
- [Embeddings](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/llms/vertex-ai/embeddings.md): Get embeddings from Vertex AI
- [vLLM](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/llms/vllm.md): Integrate vLLM-hosted custom models with Portkey and take them to production
- [Voyage AI](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/llms/voyage-ai.md): Portkey provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including Voyage AI's embedding and Re-rank endpoints.
- [Workers AI](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/llms/workers-ai.md)
- [xAI (Grok)](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/llms/x-ai.md): Portkey supports xAI's chat completions, completions, and embeddings APIs.
- [ZhipuAI / ChatGLM / BigModel](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/llms/zhipu.md)
- [Exa Online Search](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/plugins/exa.md): Transform offline LLMs into online models with real-time internet search capabilities.
- [Milvus](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/vector-databases/milvus.md)
- [Qdrant](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/vector-databases/qdrant.md)
- [Arize Phoenix](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/arize.md): Extend Portkey’s powerful AI Gateway with Arize Phoenix for unified LLM observability, tracing, and analytics across your ML stack.
- [Pydantic Logfire](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/logfire.md): Modern Python observability with automatic OpenAI instrumentation and intelligent gateway routing
- [FutureAGI](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/future-agi.md): Integrate FutureAGI with Portkey for automated LLM evaluation and comprehensive observability
- [Langfuse](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/langfuse.md): Integrate Langfuse observability with Portkey's AI gateway for comprehensive LLM monitoring and advanced routing capabilities
- [Langsmith](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/langsmith.md): Integrate LangSmith observability with Portkey's AI gateway for comprehensive LLM monitoring and advanced routing capabilities
- [Phoenix(Arize) Open-Telemetry](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/phoenix.md): AI observability and debugging platform with OpenInference instrumentation and intelligent gateway routing
- [MLflow Tracing](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/ml-flow.md): Enhance LLM observability with automatic tracing and intelligent gateway routing
- [OpenLIT](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/openlit.md): Simplify AI development with OpenTelemetry-native observability and intelligent gateway routing
- [OpenTelemetry Python SDK](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/opentelemetry-python-sdk.md): Direct OpenTelemetry instrumentation with full control over traces and intelligent gateway routing
- [HoneyHive](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/honeyhive.md): Integrate HoneyHive observability with Portkey's AI gateway for comprehensive LLM monitoring and advanced routing capabilities
- [Traceloop (OpenLLMetry)](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/tracing-providers/traceloop.md)
- [Claude Desktop](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-clients/claude.md): Connect your MCP servers to Claude Desktop through Portkey's secure MCP gateway
- [Cursor](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-clients/cursor.md): Connect your MCP servers to Cursor IDE through Portkey's secure MCP gateway
- [LibreChat](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-clients/librechat.md): Connect your MCP servers to LibreChat through Portkey's secure MCP gateway
- [VS Code](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-clients/vs-code.md): Connect your MCP servers to Visual Studio Code through Portkey's secure MCP gateway
- [Claude Code](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-clients/claude-code.md): Connect your MCP servers to Claude Code CLI through Portkey's secure MCP gateway
- [Postman MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/postman-mcp-server.md): The Postman MCP Server connects Postman to AI tools, enabling assistants and agents to securely access and interact with Postman workspaces, collections, environments, and APIs through natural language. It bridges Postman's API platform with AI-driven automation, allowing developers to query, evalua…
- [Atlassian Remote MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/atlassian-mcp-server.md): The Atlassian Remote MCP Server is a cloud-based bridge between your Atlassian Cloud site and MCP-compatible clients, enabling secure interaction with Jira, Confluence, and Compass in real time.
- [Datadog MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/datadog-mcp-server.md): The Datadog MCP server enables AI agents to interact with Datadog monitoring, dashboards, metrics, logs, and alerts through MCP. Built for conversational and automated observability workflows.
- [Figma MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/figma-mcp-server.md): The Figma MCP server connects Figma's design environment to MCP clients, enabling agents to translate designs into code, extract variables, and align output with your design system.
- [Firebase MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/firebase-mcp-server.md): The Firebase MCP server gives AI agents programmatic access to Firebase projects, including Auth user management, Firestore data access, Storage rules, and GraphQL features via the Firebase CLI.
- [Firecrawl MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/firecrawl-mcp-server.md): The Firecrawl MCP server enables AI agents to perform web scraping, crawling, search, extraction, and research through MCP. Built for content discovery and information retrieval workflows.
- [GitHub MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/github-mcp-server.md): The GitHub MCP server enables AI agents to safely interact with repositories, issues, pull requests, commits, and code search through MCP. Built for conversational and automated engineering workflows.
- [Gitlab MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/gitlab-mcp-server.md): The GitLab MCP server enables AI agents to interact with GitLab—the DevOps platform for software development, security, and operations.
- [Cerebras Code MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/cerebras-code-mcp-server.md): The **Cerebras Code MCP Server (v1.3.3)** integrates high-speed code generation and editing capabilities into AI-assisted IDEs such as Claude Code, Cline, and Cursor. It allows you to use your preferred AI (Claude, Qwen, etc.) for planning and strategy, and delegate the actual code-writing and modif…
- [Grafana MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/grafana-mcp-server.md): The Grafana MCP server enables AI agents to interact with Grafana dashboards, metrics, logs, incidents, alerts, and monitoring tools through MCP. Built for observability and monitoring workflows.
- [Kubernetes MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/kubernetes-mcp-server.md): The Kubernetes MCP server provides a flexible Model Context Protocol (MCP) interface for managing and interacting with Kubernetes and OpenShift clusters.
- [Linear MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/linear-mcp-server.md): The Linear MCP server provides a standardized interface for AI models and agents to securely access and manage data from your Linear workspace.
- [Notion MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/notion-mcp-server.md): The Notion MCP server enables AI agents to interact with Notion, a versatile workspace that combines note-taking, project management, knowledge bases, and relational databases. Through MCP, assistants can programmatically retrieve, search, and update pages, blocks, and databases—turning Notion into…
- [Open Library MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/open-library-mcp-server.md): The Open Library MCP server provides AI agents with access to Open Library's book and author catalog through a simple read-only API with no authentication required.
- [Playwright MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/playwright-mcp-server.md): The Playwright MCP server provides browser automation capabilities using Playwright through the Model Context Protocol (MCP), enabling deterministic web interaction via accessibility trees rather than screenshots.
- [Qdrant MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/qdrant-mcp-server.md): The Qdrant MCP server enables AI agents to store and retrieve semantic information using vector search through MCP. Built for persistent memory, contextual knowledge, and efficient semantic retrieval workflows.
- [Stripe MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/stripe-mcp-server.md): The Stripe MCP server exposes Stripe's payments and billing operations to AI agents through the Model Context Protocol, providing secure access to customers, products, pricing, invoices, and more.
- [Vectara MCP server](https://portkey-docs-migration-03-llm-providers.mintlify.site/integrations/mcp-servers/vectara-mcp-server.md): The Vectara MCP server provides AI agents with access to Vectara's semantic search and retrieval-augmented generation (RAG) APIs.