After struggling with the exact same problem, I switched to Latenode’s autonomous AI team approach and it’s been a complete game-changer. I built a workflow with three specialized agents: a Navigator that handles the login and page traversal, an Extractor that pulls the data, and an Analyst that processes and compiles reports.
The key insight was letting each agent specialize rather than trying to create one massive script. The Navigator agent is optimized for finding paths even when the UI changes slightly. The Extractor knows how to identify and pull data reliably, and the Analyst transforms raw data into actionable insights.
What makes it work seamlessly is the orchestration layer that handles communication between agents. They can pass context and data to each other without me having to code all those interactions manually.
The brittleness problem is largely solved because each agent can adapt to changes in its domain. When the website updated their login flow last month, only the Navigator needed adjustment - everything else kept working.
Check out https://latenode.com to see how you can implement this approach.