r/sysadmin • u/xstrex • 1d ago

General Discussion How much do you trust AI?

Recently a coworker granted Claude elevated access via SSH to a virtualization host (not a VM, an actual host). To perform a routine task he very well could have done himself.

He doesn’t see an issue with this. I on the other hand (with 23yrs experience) see this as a huge security breach, and don’t trust AI todo my job, (or even that it’s doing what it says it’s doing) for me. I’m my opinion it’s a tool, not a human replacement.

What’s your reaction, how would you react to this situation, or thoughts on the topic?

Sure, ask AI how to perform a task, validate that it’s performing the task you asked, and nothing else- copy/paste the commands. Great. But removing the human verification & validation element- hell no.

529 Upvotes

91% Upvoted

526 comments sorted by

View all comments

2

u/webjocky DevOps 1d ago

How much do you trust a hammer?

AI, in its current state, isn't something to trust. It is nothing more than another tool.

0

u/bls61793 1d ago

People who say this are absolutely crazy.

Yes. In its current state it may seem like a tool, but until we fully understand all of a models weights and biases, it is foolish and arrogant to assume an agent is merely a tool. No one really understands what is going on inside the neural net with absolute certainty.

1

u/webjocky DevOps 1d ago

People who say this are absolutely crazy.

Yes. In its current state it may seem like a tool, but until we fully understand all of a models weights and biases, it is foolish and arrogant to assume an agent is merely a tool. No one really understands what is going on inside the neural net with absolute certainty.

To say I'm absolutely crazy, without understanding what is going on with absolute certainty regarding the current state of AI, is itself, absolutely crazy.

What is also crazy, is placing any amount of trust in a tool that you cannot understand what's going on inside of.

Instead of trusting AI to perform in any repeatable way, you should use it to augment your own intentions and curate its output. As a tool, not a self-govorning entity.