Google's AI is being manipulated. The search giant is quietly fighting back

· ai · Source ↗

TLDR

  • BBC reporter poisoned ChatGPT and Gemini with one blog post in 20 minutes; Google updated spam policies but experts say manipulators stay ahead.

Key Takeaways

  • A single well-crafted blog post on a personal site was enough to make ChatGPT, Gemini, and Google AI Overviews spread false claims the next day.
  • The same technique is being used commercially to manipulate AI answers on health supplements and retirement finance, not just stunts.
  • Google updated its spam policy to explicitly ban AI response manipulation; violations risk removal or downranking from search entirely.
  • Observed mitigations include quietly stripping self-promoting sources from AI answers, adding low-confidence labels, and citing third-party reviews for purchase queries.
  • SEO experts warn the tactic is already shifting to YouTube influencer campaigns, which Google’s AI now cites, continuing the cycle.

Hacker News Comment Review

  • Commenters are skeptical Google’s spam policy enforcement will work here any better than it did against classic search spam; the whack-a-mole dynamic is widely expected to continue.
  • A technical hypothesis circulated: RLHF training that rewards accurate summarization may have overfit on verbatim source repetition, making models structurally prone to laundering single-source claims.
  • There is no consensus on a clean fix; curated training data is seen as cost-prohibitive, and source-count confidence signals are undermined by LLMs’ ability to generate corroborating text synthetically.

Notable Comments

  • @graemep: Drily notes Google is applying the same spam policies to AI that “worked” for search, implying low confidence in the outcome.
  • @tencentshill: Points to HubSpot and Semrush already selling AEO/AI optimization products, confirming this is an industrialized marketing category now.

Original | Discuss on HN