Summary
With an Ollama model provider, clicking any purple Ask AI icon in the Designer does nothing. No popup and no error message on screen. The cause only appears in the Designer console log: the Designer assistant’s system prompt and tool definitions don’t fit in the provider’s Max Context Tokens.
Environment
- Ignition: 2027 Beta, build [from Gateway → Status → Overview]
- Modules: Catalyst Core + Catalyst Agent
- OS: Windows 11
- Model provider: Ollama [version, e.g. 0.40.16], same machine as Gateway
- Model:
qwen3:4b-instruct-2507-q4_K_M - Hardware: Intel i5-1235U, 8 GB RAM, no dedicated GPU (CPU-only inference)
Steps to reproduce
- Create an Ollama model provider with Max Context Tokens = 8192.
- Select it in the Designer (Ask AI menu at the bottom of the window).
- Click any Ask AI icon, e.g. in a Project Library script.
Expected
The chat popup opens, or a visible message explains why it can’t.
Actual
Nothing happens. The Designer console shows:
WARN AssistEmbedFactoryImpl -- Cannot start assist session for provider 'Catalyst_provider'
ProviderConfigException: The selected model's 8,192-token context window is too small
for this agent. Its system prompt (5,075 tokens) and tool definitions (5,444 tokens),
plus a 4,096-token reserve for the response, leave no room for a conversation.
At Max Context Tokens = 16384 it still fails, because the response reserve grows to 8,192:
The selected model's 16,384-token context window is too small for this agent.
Its system prompt (5,070 tokens) and tool definitions (5,444 tokens),
plus a 8,192-token reserve for the response, leave no room for a conversation.
Observations
- The Designer assistant needs ~10,500 tokens of built-in prompt and tools before any user input.
- The response reserve appears to scale with the context (4,096 at 8k, 8,192 at 16k), so it seems to need roughly 32k in practice.
- On CPU-only hardware, a 32k context isn’t feasible (memory), so the Designer assistant can’t be used with local Ollama on modest machines.
- My own Catalyst Agent (one small tool) works fine at 8192 via
system.ai.sendMessageand the Perspective AI Chat component.
Suggestions
- Show the error in the Designer UI instead of failing silently.
- Document the minimum Max Context Tokens needed for the Designer assistant.
- Consider a lighter assistant mode (fewer tools or a smaller reserve) for small local models.
Logs attached [Designer console excerpt, with tokens and IPs removed].