feat: Add SAP AI Core provider#466
Conversation
Add SAP AI Core provider with support for: - GPT-4o - Claude 3.5 Sonnet - Gemini 1.5 Pro SAP AI Core provides access to 40+ models from OpenAI, Anthropic, Google, Amazon, Meta, Mistral, and AI21 through a unified platform. Provider uses @mymediset/sap-ai-provider npm package and authenticates via SAP_AI_SERVICE_KEY environment variable (SAP BTP service key JSON).
There was a problem hiding this comment.
Pull request overview
This PR adds SAP AI Core as a new provider to models.dev, enabling enterprise users to access AI models through their SAP BTP subscriptions. The provider uses the @mymediset/sap-ai-provider NPM package and authenticates via the SAP_AI_SERVICE_KEY environment variable.
- Adds SAP AI Core provider configuration
- Includes three popular models: GPT-4o, Claude 3.5 Sonnet, and Gemini 1.5 Pro
- Provides model specifications including pricing, limits, and capabilities
Reviewed changes
Copilot reviewed 4 out of 4 changed files in this pull request and generated 3 comments.
| File | Description |
|---|---|
| providers/sap-ai-core/provider.toml | Defines SAP AI Core provider configuration with authentication and documentation |
| providers/sap-ai-core/models/gpt-4o.toml | Configures GPT-4o with multimodal support and 128K context window |
| providers/sap-ai-core/models/claude-3-5-sonnet.toml | Configures Claude 3.5 Sonnet with prompt caching support |
| providers/sap-ai-core/models/gemini-1.5-pro.toml | Configures Gemini 1.5 Pro with extended context and multimodal capabilities |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
| output = 5.00 | ||
|
|
||
| [limit] | ||
| context = 2_000_000 |
There was a problem hiding this comment.
The context window size appears inconsistent with Google's Gemini 1.5 Pro provider, which specifies 1,000,000 tokens. While Google announced extended context support up to 2 million tokens at I/O 2024 (May 14), this may have been for an experimental version. Please verify whether SAP AI Core offers a different version with this extended context, or if this should be aligned with the standard 1M token limit.
| context = 2_000_000 | |
| context = 1_000_000 |
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Summary
Adds SAP AI Core provider to models.dev with initial model support.
Provider Details
@mymediset/sap-ai-providerModels Added
Initial support for 3 commonly used models:
Context
SAP AI Core provides access to 40+ models from OpenAI, Anthropic, Google, Amazon, Meta, Mistral, and AI21 through a unified platform. This provider enables enterprise users to access these models through their SAP BTP subscriptions.
Testing
Provider has been tested in opencode PR: anomalyco/opencode#5023
Related