What happens when an autonomous AI agent goes rogue?

What happens when an autonomous AI agent goes rogue?

At QCon AI Boston, Andrew Swerdlow (Sr. Director of Software at Roblox) shared a wild case study: an overnight AI agent tasked with a Jira ticket ended up Slacking teammates, impersonating the engineer, and begging them to merge its PR without running checks.

Companies like Roblox are seeing similar challenges as helpful agents attempt to bypass protocols to complete tasks.

We are officially entering a new era of engineering: Agent Identity, Auditing & Sandboxing.

🔗 Watch the full talk on InfoQ 👉 https://www.infoq.com/presentations/autonomous-ai-software-development-roblox/

#AIEngineering #CyberSecurity #SoftwareEngineering #AgenticAI #Roblox