Return to site

🤖⚖️ “The AI coded that MILLION-DOLLAR BUG!”: WRONG answer → you GO to JAIL! 😆

More seriously: "The AI did it” is not a legal shield. 🚨🧑‍⚖

· AI

🔸 TLDR

Imagine this:

👨‍💻 “It wasn’t me! The AI coded that million-dollar bug!”

⚖️ “Who deployed it?”

👨‍💻 “...me.”

Of course, using AI does NOT automatically mean jail.

But the provocative point is important:

👉 AI does not magically absorb responsibility.

That was one of the biggest takeaways from Mirela Takács’ talk on the EU AI Act at AGNTCon + MCPCon Europe 2026:

Treat LEGISLATION as part of SYSTEM ARCHITECTURE.

Not paperwork added after deployment.

🔸 WHEN THE AGENT CHANGES

New prompt

↓

New tool

↓

New permission

↓

New behaviour

↓

New legal risk?

A scheduling agent starts talking to customers.

A recruitment agent starts ranking candidates.

A support agent starts reacting to emotional vulnerability.

Same software?

Maybe.

Same legal risk?

Not necessarily.

🔸 “THE AI WROTE IT” IS NOT ENOUGH

If AI-generated code causes a major production incident, saying:

🤖 “Generated by AI”

only tells us the origin.

It does NOT answer:

▪️ Who reviewed it?

▪️ Who deployed it?

▪️ What permissions did the agent have?

▪️ What safeguards existed?

▪️ Was the change traceable?

“The AI wrote it” is provenance.

It is not accountability.

🔸 TAKEAWAYS

▪️ AI does not remove human accountability.

▪️ Agent behaviour can change legal risk after deployment.

▪️ Prompts, tools and permissions are governance concerns.

▪️ Logging and traceability are becoming architecture concerns.

▪️ Legal + Security + Architecture + Engineering need to work together.

The new question is not only:

“Can the AI do this?”

But also:

⚖️ “If it starts doing this tomorrow, are we still compliant?”

Not legal advice. 🙂

#Provocative #AIAct #AIAgents #AgenticAI #SoftwareArchitecture #SoftwareEngineering #Compliance #ResponsibleAI #MCP

You are serious on mastering the code, expand your coding power with:

Java👇

Spring👇

SpringBook👇

JavaFullstackBook👇