Cite as: Real Problem AI problem “How do I stop employees running commands a ChatGPT conversation tells them to paste?”. Opportunity score 7.6 out of 10 (severity 9, AI feasibility 7, market signal 7, competition gap 7). Category AI / Agents. Trend LLM. Source signal: r/msp post "A ChatGPT conversation directed a user to a fake OpenAI verification site that tried to execute malware. Our EDR stopped it.", 8 October 2026, 124 comments.. Canonical URL: https://www.realproblem.ai/idea/how-do-i-stop-employees-running-commands-a-chatgpt-conversation-tells-them-to-paste.
How do I stop employees running commands a ChatGPT conversation tells them to paste?
Attackers now use malicious custom GPTs and malvertising so a fake security check appears inside a real ChatGPT conversation and tells staff to paste a command into Windows Terminal; IT only finds out when the endpoint tool kills the process.
Who has it: MSPs and IT admins at small and mid-sized companies whose staff use free or personal ChatGPT accounts for work.
- Severity9/10
- Feasible today7/10
- Market signal7/10
- Competition gap7/10
Heard in public
“This wasn't a phishing email pretending to be ChatGPT.”
Quoted word for word from the public post linked below. Nobody submitted it to Real Problem AI.
r/msp post "A ChatGPT conversation directed a user to a fake OpenAI verification site that tried to execute malware. Our EDR stopped it.", 8 October 2026, 124 comments.What nothing does yet
A browser-side guard for AI chat tabs that spots fake verification prompts, unknown custom GPTs and clipboard commands bound for a terminal, warns the user in plain words, and alerts IT with the conversation context.
Tools that solve this
4 named so far, and where each one stops.
- Huntress EDR and ESPM
Kills the PowerShell payload and can restrict the Run dialog, but acts after the user is already convinced.
- ChatGPT Enterprise admin controls
Can limit which GPTs staff use, but only for paid workspace seats, not the free accounts people use anyway.
- KnowBe4
Security awareness training built around phishing email; rarely covers instructions that appear inside a trusted AI chat.
- Microsoft Defender SmartScreen
Flags known bad sites, often too late for freshly registered ClickFix domains.
How you might build it
- 01Browser extension (Chrome, Edge)
- 02Clipboard and paste monitoring
- 03Custom GPT reputation list
- 04LLM classifier for social engineering text
- 05EDR and SIEM webhook alerts
#NOV56 · Canonical URL: https://www.realproblem.ai/idea/how-do-i-stop-employees-running-commands-a-chatgpt-conversation-tells-them-to-paste