Tech
Jun 10, 2026
The 'Poisoned' AI: How ChatGPT Search is Being Weaponized for E-Commerce Fraud
Scammers are exploiting the popularity of AI search tools like ChatGPT by creating fake websites fo…
The LeadAs consumers increasingly rely on ChatGPT for shopping recommendations, a sophisticated new wave of fraud has emerged. Scammers are 'poisoning' the AI's search index with cloned websites for defunct brands, tricking users into purchasing non-existent goods and handing over sensitive financial data.The 'Poisoned' Search Index: A New Frontier for E-Commerce FraudThe core of this issue lies in how Large Language Models (LLMs) retrieve information. Unlike traditional search engines that crawl the web, AI tools like ChatGPT can index content from the open web. Fraudsters are leveraging this by creating convincing replicas of legitimate retailers that have recently gone out of business.Targeted Victims: The primary targets are brands that have recently entered administration or been acquired, leaving a vacuum in search results.The Mechanism: Malicious content is inserted into the information an AI learns from, effectively 'poisoning' the dataset with fake URLs.Verified Cases: Services like Ask Silver have identified cloned sites for Russell & Bromley and Dunelm appearing in AI-generated results.The Anatomy of the Clone: How Fraudsters Exploit Brand AbsorptionThe scam relies heavily on the timing of corporate restructuring. Russell & Bromley went into administration in January 2026 and was absorbed by Next. This transition left a gap in official digital presence, which scammers immediately filled with high-fidelity replicas.These cloned sites are designed to deceive. They often feature massive 'discounts'—sometimes up to 80%—to lure in bargain hunters. The URLs are meticulously crafted to mimic legitimate domains, using slight variations like 'therussellbromleyofficial' or 'russell-and-bromley' to bypass basic domain verification.The Trust Gap: Why AI Recommendations are VulnerableThe psychological vulnerability here is the blind trust users place in AI. When an AI assistant lists a source, users assume it has been vetted. National Trading Standards has warned that this dynamic is a stark reminder that criminals will exploit any new technology to reach victims.Unlike traditional phishing emails, these scams appear within a trusted interface. The Next spokesperson noted that while they work to remove fraudulent sites, the speed at which AI indexes new content makes real-time takedowns difficult.The Future of AI Safety: Beyond Simple Content RemovalThis incident signals a critical turning point for AI safety. Simply removing content after a user reports it is no longer sufficient. The industry must move toward proactive verification of sources before they are indexed.Immediate Action: Users should verify URLs directly with the brand or use official apps rather than clicking through AI links.Regulatory Response: Expect tighter regulations on how AI models scrape and index third-party websites.Technical Defenses: Future AI models may need to implement 'source provenance' checks to distinguish between real and cloned domains.
#ChatGPT
#OpenAI
#Russell & Bromley
Read More