> ## Documentation Index
> Fetch the complete documentation index at: https://ona.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# AWS Bedrock Mantle

> Set up AWS Bedrock Mantle for OpenAI model routing on an AWS EC2 runner

> [!NOTE]
>
> Available for Enterprise organizations where OpenAI model routing is enabled. [Contact sales](https://ona.com/contact/sales) to learn more.

> [!NOTE]
>
> This feature is only supported in **AWS EC2 Runners**.

Use AWS Bedrock Mantle when your AWS EC2 runner should route OpenAI model requests through a Bedrock Mantle endpoint.

This page covers the OpenAI setup exposed in Ona.

To track spend on your BYOK model usage, see the [AI cost usage API](https://ona.com/docs/ona/billing/cost-usage-api.md).

## Prerequisites

* Your organization has OpenAI model routing enabled.
* You have an AWS EC2 runner configured in Ona.
* You have a Bedrock Mantle endpoint and token.
* The runner can reach the Bedrock Mantle endpoint over HTTPS.
* For GPT-6.1 Sol, GPT-6 Sol, and Luna, your AWS account and region support the selected model and the environment has an updated Codex Agent with Bedrock routing for these models.

## Configure the endpoint

Use the Bedrock Mantle endpoint for your AWS region:

```bash theme={null}
https://bedrock-mantle.<region>.api.aws/openai/v1/responses
```

The Ona UI defaults to:

```bash theme={null}
https://bedrock-mantle.us-east-1.api.aws/openai/v1/responses
```

For GPT-6.1 Sol, GPT-6 Sol, and Luna, no model mapping is required. Ona sends `openai.gpt-6.1-sol`, `openai.gpt-6-sol`, or `openai.gpt-6-luna` when you select the corresponding model. These models support Standard speed on Bedrock. Fast speed and Ultra reasoning are unavailable. See [Model access](https://ona.com/docs/ona/agents/llm-providers/overview.md#gpt-61-sol) for the reasoning options available in the dashboard.

## Add the integration with the UI

1. Go to the [Runners settings page](https://app.ona.com/settings/runners).
2. Select the AWS EC2 runner where you want to configure Bedrock Mantle.
3. Scroll to **LLM Providers**.
4. Click **Configure**.
5. Select **AWS Bedrock Mantle**.
6. Enter your Bedrock Mantle endpoint.
7. Paste the Bedrock Mantle token into **API Key**.
8. Click **Create Integration**.

![AWS Bedrock Mantle LLM integration form showing endpoint URL and API key fields](https://mintcdn.com/gitpod-13c83c2b/sggGGFHiP6Luo90h/images/bedrock-mantle.png?fit=max\&auto=format\&n=sggGGFHiP6Luo90h\&q=85\&s=b381262a258b23a155edfcc06ead1e94)

## Add the integration with the CLI

```bash theme={null}
gitpod runner config llm-integration create <runner-id> SUPPORTED_MODEL_OPENAI_AUTO https://bedrock-mantle.<region>.api.aws/openai/v1/responses <bedrock-mantle-token>
```

To verify the integration:

```bash theme={null}
gitpod runner config llm-integration list
```

## Verify the integration

1. Create a new environment with the configured AWS EC2 runner.
2. Start Codex Agent and select a supported model, such as GPT-6.1 Sol.
3. Confirm that the agent can answer a simple code question.

## Use web search

Codex Agent can use native web search with supported Mantle models and regions. The IAM identity behind your token needs `bedrock-websearch:InvokeSearch` and `bedrock-websearch:InvokeFetch` permissions. Codex uses the Bedrock web index and cache with external web access disabled. See [AWS web search documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/web-search.html) for model and regional availability.

Server-side web search is unavailable through the [Bedrock Runtime OpenAI endpoint](https://ona.com/docs/ona/agents/llm-providers/bedrock-openai.md).

## Troubleshooting

> [accordion] AWS Bedrock Mantle is not shown
>
> AWS Bedrock Mantle is available only on AWS EC2 runners when OpenAI model routing is enabled for your organization. It is not shown on GCP runners.

> [accordion] Endpoint validation fails
>
> Use an endpoint on the `bedrock-mantle.<region>.api.aws` domain. For OpenAI model routing, include the `/openai/v1/responses` path.

> [accordion] Token authentication fails
>
> Confirm that the value in **API Key** is a Bedrock Mantle token. Mantle requires a Mantle token; a Bedrock API key or IAM credentials cannot be used here.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.