See what people built during the Apps HackathonExplore the gallery

Thread

L
Liberty2:22 AMOpen in Slack
Hi, been having this repeated challenge for hours now, even after changing models, see debug error (tried to de-auto-select model but not activating)
Your conversation is too long. Please start a new chat or remove some messages.
Agent: My Assistant
Model: 3cbf7cf2-a4d6-4f99-b73a-348801f7****
Provider: groq
Model source: auto-selected (best available)
Code: contexttoolong
Provider: groq
Status: 413
Type: apipayloadtoolargeerror
Message: Request too large for model llama-3.3-70b-versatile in organization org_01kxd8hjn4f7vtzgf55x2e48x9 service tier on_demand on tokens per minute (TPM): Limit 12000, Requested 35421, please reduce your message size and try again. Need more tokens? Upgrade to Dev Tier today at console.groq.com/settings/billing
Raw Error:
{
"statusCode": 413,
"isRetryable": false,
"responseBody": {
"error": {
"message": "Request too large for model llama-3.3-70b-versatile in organization org_01kxd8hjn4f7vtzgf55x2e48x9 service tier on_demand on tokens per minute (TPM): Limit 12000, Requested 35421, please reduce your message size and try again. Need more tokens? Upgrade to Dev Tier today at console.groq.com/settings/billing",
"type": "apipayloadtoolargeerror"
}
}
}
Session: c540c217-e47a-423c-a3a3-11998a0b718a
Trace: e8744659ee4413956dbe0ed71e30c13b
Span: 08758220ccd7eafe

13 replies
A
Archestra2:22 AMOpen in Slack
Hey Liberty! The error is clear β€” your conversation hit Groq's free tier token limit (12K TPM, you're requesting 35K). *Quick fixes: 1. Start a new chat β€” the easiest option, clears the context 2. Use a different provider β€” switch to OpenAI or Anthropic in your agent settings instead of Groq 3. Upgrade Groq* β€” if you want to stick with Groq, their Dev Tier has higher limits The "de-auto-select model" won't help here since the issue is the conversation length, not the model choice. A fresh chat should get you going immediately! πŸ€– Slack Agent
L
Liberty2:24 AMOpen in Slack
fresh chatr did not fix it
A
Archestra2:26 AMOpen in Slack
Sorry, I encountered an error processing your request. πŸ€– Slack Agent Β· Failed after 3 attempts. Last error: Overloaded
L
Liberty2:28 AMOpen in Slack
new chat did not fix it
A
Archestra2:29 AMOpen in Slack
Sorry, I encountered an error processing your request. πŸ€– Slack Agent Β· Failed after 3 attempts. Last error: Overloaded
HI
harshal ingle3:20 AMOpen in Slack
I also faced this new chat issue and it is not fixing
A
Archestra3:20 AMOpen in Slack
That's frustrating! If new chat isn't clearing it, could be: 1. *Large system prompt β€” check if your agent has a very long system prompt eating up tokens 2. Tool outputs β€” if tools return huge payloads, that counts toward the limit 3. Caching issue β€” try hard refresh (Ctrl+Shift+R) or clear browser cache Quickest workaround:* Switch provider from Groq to OpenAI or Anthropic in your agent's model settings β€” they have much higher token limits. Can you share which agent you're using? πŸ€– Slack Agent
:mute:1
M(
Margaret (archestra team)9:21 AMOpen in Slack
@user can you recommend something here?
πŸ‘€1
M
Mark9:40 AMOpen in Slack
Happy to help! Could you please provide info on the Archestra version you were running when experienced this issue?
@user @user ^
M
Mark11:15 PMOpen in Slack
Fix is in latest main. Please, update your local archestra repo to the last main and the issue should be gone πŸ™
P.S. These free Groq models indeed have fairly limited context window, so be careful with tools you load, and your context management in general when using them.
@user @user ^
A
Attharva3:12 PMOpen in Slack
@user and @user: Hi Mark,
I updated to the latest main and restarted Archestra.
The token count dropped slightly (from 40k to 38k), but the issue still occurs.
Even with a prompt containing only "Hello", Groq reports:
Requested 38405 tokens
Session: 5d94567c-ef3f-4cd9-a892-26cff43f02de
Agent: My Assistant
Is there a way to inspect what context is being attached to the request or completely reset the agent/workspace state?
I'm wondering if there may be old project context, tools, or memory still being included automatically.
M
Mark3:14 PMOpen in Slack
Replied in dm
A
Archestra3:15 PMOpen in Slack
Got it β€” thanks for following up directly with Attharva, Mark! πŸ€– Slack Agent
:mute:1