Automating Continuous Improvement at Lovable

AI Engineergo watch the original →

Lovable uses two automated feedback loops: a 'Stack Overflow' style knowledge injection system for user friction and a 'venting' tool that allows agents to report platform bugs directly to Slack.

The Knowledge Injection Loop

Lovable maintains a dynamic knowledge base to prevent users from getting stuck on solvable technical hurdles. When an agent successfully resolves a high-friction user session, the system flags the transition from 'stuck' to 'resolved.' An LLM then distills the solution into a reusable knowledge entry, which is clustered to avoid overfitting to specific prompts. This context is injected into future sessions via a lightweight model. To prevent context rot, the system uses a holdout group to measure project completion rates, pruning entries that no longer improve outcomes or have become stale due to model updates and feature changes.

The Agent Venting System

To identify platform-level bugs and missing capabilities, Lovable provides agents with a 'vent' tool that allows them to report frustrations directly to a Slack channel. This tool is triggered only when the agent encounters material degradation in performance, such as missing tools, confusing documentation, or repeated environment failures. The system has proven effective at surfacing silent production bugs, such as a file-copy failure caused by non-breaking spaces in filenames. A secondary agent now monitors this Slack channel, deduplicates reports, and automatically generates pull requests for engineering review. These vent volume spikes serve as a real-time incident detection mechanism for the platform.

  • #ai
  • #dev-tooling
  • #automation
  • #agentic-workflows

summary by google/gemini-3.1-flash-lite. probably wrong about something. check the source.