This tweet by Scott Manley a few weeks ago keeps coming to my mind... Mostly because it is exactly my thinking. Of course I use AI tools, I have worked too hard to get where I am today to not use them.
Do I trust without question that which comes out of AI, HELL NO! See previous point about having worked too hard to get to where I am today. Which I will note that it is because of my experience that I can detect AI going rogue. It is because of my experience that I can express in the prompt the key important systems-design criteria. It is because of my experience that I define test benchmarks before starting to develop something.
The deepest thing I have done is use vibe coding to create a security sensitive data labeling service reference implementation - Security Labeling Service - Reference Implementation
Do I think that AI could kill us all? Well, I have read plenty of science fiction, so I have the background. This worry is also a reason that I use AI, so that I can understand the tool. I do more than just understand, I write about controlling AI, and monitoring AI.
Some blog articles:
AI is neither good nor bad; it is a tool. When AI does something bad, the tool just did what the human/organization asked it to do. So, anything bad or good that AI does is not the responsibility of AI, but the human or organization that used the AI tool.
I largely agree with your post, however I take issue with your last sentence completely absolving AI. The recent case (https://cybersecuritynews.com/gym-api-exploited-by-ai-agent/) suggests that the makers of AI agent tools should foresee and prevent possible inappropriate actions that users of AI might not even dream to be possible. These AI agent vendors should share in the responsibility in some cases...
ReplyDeleteMy point, which others have made, is that YES those instructing the AI must be very careful at giving clear and safe instructions. This does mean that they can't just give general instructions. I expect someone who is responsible for using a tool is someone able to control that tool. This is true of a military tank, as it is an AI system.
DeleteSee Bruce Schneier -- https://www.schneier.com/blog/archives/2026/08/more-on-the-openai-agents-attack-on-hugging-face.html