The proposal looked great.
It was polished, professional, and exactly the kind of document that makes a school look like it has everything under control.
Then the phone rang.
The market research cited in section two, the statistics that anchored the entire recommendation, did not exist. The AI had made them up. Not vaguely or accidentally, but confidently and in detail.
There is a name for this. It is called a hallucination. It happens when a capable and enthusiastic tool is given access to work without supervision and is expected to figure things out on its own.
Sound familiar?
The Intern Nobody Onboarded
Imagine hiring an intern and on the first day giving them access to everything.
Your school’s documents. Staff communications. Budget summaries. Internal planning files.
Then saying, “Just explore and let me know if you need anything.”
No orientation. No expectations. No guardrails.
That is how many organizations are adopting AI right now.
Not because they are reckless. In fact, it is the opposite. AI tools are genuinely helpful, easy to access, and increasingly built into the software schools already use every day. There is an AI button in email platforms, another in document editors, and more appearing across collaboration tools.
It feels like help has arrived.
And in many ways, it has.
AI is incredibly effective at drafting messages, summarizing information, organizing ideas, and speeding up work that used to take hours. The issue is not the tool itself. The issue is how it is being used.
Every application seems to include AI now. Not every school has stopped to think about what happens when someone clicks that button.
What Your Unsupervised Intern Is Actually Doing
When AI tools appear without a clear plan, three things tend to happen.
First, data gets shared in ways no one intended. Staff members paste documents into free AI tools to summarize reports or generate drafts. Research by CybSafe and the National Cybersecurity Alliance found that 38 percent of employees are sharing confidential information with AI platforms without approval, often without realizing it.
Many consumers AI tools use submitted data to improve their models. That means the information placed into those systems may not remain as private as expected. No one is trying to break the rules. They simply do not know where the boundaries are.
Second, tools begin appearing that were never approved. A BlackFog survey of 2,000 workers found that 49 percent are using AI tools their organization has not sanctioned. When that happens, IT teams lose visibility into what software is being used, what data those tools can access, and what the terms say about privacy and ownership.
It becomes a form of shadow IT.
Third, AI output begins to get trusted without verification. AI tools are extremely confident in how they present information. They produce clean and convincing content whether it is accurate or not.
The proposal with invented statistics looked just as credible as one built on real research. A human intern might make that mistake once. AI can do it repeatedly and at scale.
That is not a flaw. It is simply how the tool works.
The real risk appears when no one reviews the work before it is used.
AI does not fix broken processes. It accelerates them. A disorganized system with AI simply moves faster in the wrong direction.
How to Supervise Your Intern
The answer is not to ban AI.
That would be unrealistic and would leave schools behind while others learn how to use these tools effectively.
The better approach is to treat AI like a new employee with potential but very little context.
Start by defining which tools are approved and which are not. This can be as simple as a shared list that leadership and IT update together. The goal is not to add complexity. It is to maintain visibility into which tools interact with school systems.
Next, establish a simple review step. AI can draft content, but a human should always review it before it is shared externally. Nothing should go to parents, vendors, or staff communications without someone confirming it is accurate.
Finally, clarify what information should never be entered into consumer AI tools. Student data, staff records, contracts, financial information, and internal planning documents should remain inside trusted systems.
If staff do not know where the line is, they may cross it without realizing it.
The goal is not perfect AI usage. The goal is a school team that understands how to use AI responsibly without opening unnecessary risks.
A Conversation Worth Having
Maybe your school already has guidelines in place for AI tools. Perhaps your leadership team has identified approved platforms and built a review process.
But if your staff is using AI the way many organizations are using it today, enthusiastically and independently without much structure, it may be worth a conversation about how these tools fit into your school’s technology environment.
At IT for Education, we help schools across Florida adopt new technologies in ways that support educators while protecting systems and data.
If you would like a second set of eyes on how AI tools are being used across your school, we would be happy to talk.
You can schedule a quick discovery call with our team to explore how schools are safely integrating AI into their workflows while maintaining strong cybersecurity practices. Contact us at 305-403-7582.
And if you know another school leader navigating these same questions, feel free to share this article with them.
The schools that struggle with AI will not be the ones that used it.
They will be the ones that never decided how it should be used.
