#general

Sep 4September 5, 2026
SS
Sactio Swastioyono10:42 AMOpen in Slack
hello, currently experimenting archestra for our organization as centralized gateway for agent, mcp and llm proxies.
We are using Vertex AI and wondering how to make archestra to list Sonnet 5 in model choice?
because using our mounted Vertex SA, archestra only shows all Gemini model.
Using the same SA and testing it locally using curl, it does respond correctly so i believe it should not be the settings from model garden or access issue.
  --impersonate-service-account="$SA")

curl -i -X POST \
  "<https://aiplatform.googleapis.com/v1/projects/company/locations/global/publishers/anthropic/models/claude-sonnet-5:rawPredict>" \
  -H "Authorization: Bearer $TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "anthropic_version": "vertex-2023-10-16",
    "max_tokens": 32,
    "messages": [
      {
        "role": "user",
        "content": "Reply only with OK"
      }
    ]
  }'

WARNING: This command is using service account impersonation. All API calls will be executed as [platform-eng-vertex-ai-service@company.iam.gserviceaccount.com].
HTTP/2 200
.
.
.

{"model":"claude-sonnet-5","id":"msg_vrtx_011Cek8kRJKHbBqjfLRmyT9H","type":"message","role":"assistant","content":[{"type":"text","text":"OK"}],"stop_reason":"end_turn","stop_sequence":null,"stop_details":null,"usage":{"input_tokens":13,"cache_creation_input_tokens":0,"cache_read_input_tokens":0,"cache_creation":{"ephemeral_5m_input_tokens":0,"ephemeral_1h_input_tokens":0},"output_tokens":4,"output_tokens_details":{"thinking_tokens":0}}}%```
👀1

Read-only live mirror of Archestra.AI Slack

👋Join the discussion withAI enthusiasts!