Archestra Apps HackathonSee what people are building

Thread

L
Liberty2:22 AMOpen in Slack
Hi, been having this repeated challenge for hours now, even after changing models, see debug error (tried to de-auto-select model but not activating)
Your conversation is too long. Please start a new chat or remove some messages.
Agent: My Assistant
Model: 3cbf7cf2-a4d6-4f99-b73a-348801f7****
Provider: groq
Model source: auto-selected (best available)
Code: contexttoolong
Provider: groq
Status: 413
Type: apipayloadtoolargeerror
Message: Request too large for model llama-3.3-70b-versatile in organization org_01kxd8hjn4f7vtzgf55x2e48x9 service tier on_demand on tokens per minute (TPM): Limit 12000, Requested 35421, please reduce your message size and try again. Need more tokens? Upgrade to Dev Tier today at console.groq.com/settings/billing
Raw Error:
{
"statusCode": 413,
"isRetryable": false,
"responseBody": {
"error": {
"message": "Request too large for model llama-3.3-70b-versatile in organization org_01kxd8hjn4f7vtzgf55x2e48x9 service tier on_demand on tokens per minute (TPM): Limit 12000, Requested 35421, please reduce your message size and try again. Need more tokens? Upgrade to Dev Tier today at console.groq.com/settings/billing",
"type": "apipayloadtoolargeerror"
}
}
}
Session: c540c217-e47a-423c-a3a3-11998a0b718a
Trace: e8744659ee4413956dbe0ed71e30c13b
Span: 08758220ccd7eafe

9 replies
A
Archestra2:22 AMOpen in Slack
Hey Liberty! The error is clear β€” your conversation hit Groq's free tier token limit (12K TPM, you're requesting 35K). *Quick fixes: 1. Start a new chat β€” the easiest option, clears the context 2. Use a different provider β€” switch to OpenAI or Anthropic in your agent settings instead of Groq 3. Upgrade Groq* β€” if you want to stick with Groq, their Dev Tier has higher limits The "de-auto-select model" won't help here since the issue is the conversation length, not the model choice. A fresh chat should get you going immediately! πŸ€– Slack Agent
L
Liberty2:24 AMOpen in Slack
fresh chatr did not fix it
A
Archestra2:26 AMOpen in Slack
Sorry, I encountered an error processing your request. πŸ€– Slack Agent Β· Failed after 3 attempts. Last error: Overloaded
L
Liberty2:28 AMOpen in Slack
new chat did not fix it
A
Archestra2:29 AMOpen in Slack
Sorry, I encountered an error processing your request. πŸ€– Slack Agent Β· Failed after 3 attempts. Last error: Overloaded
HI
harshal ingle3:20 AMOpen in Slack
I also faced this new chat issue and it is not fixing
A
Archestra3:20 AMOpen in Slack
That's frustrating! If new chat isn't clearing it, could be: 1. *Large system prompt β€” check if your agent has a very long system prompt eating up tokens 2. Tool outputs β€” if tools return huge payloads, that counts toward the limit 3. Caching issue β€” try hard refresh (Ctrl+Shift+R) or clear browser cache Quickest workaround:* Switch provider from Groq to OpenAI or Anthropic in your agent's model settings β€” they have much higher token limits. Can you share which agent you're using? πŸ€– Slack Agent
:mute:1
M(
Margaret (archestra team)9:21 AMOpen in Slack
@user can you recommend something here?
πŸ‘€1
M
Mark9:40 AMOpen in Slack
Happy to help! Could you please provide info on the Archestra version you were running when experienced this issue?
@user @user ^