John Draper could exploit it with his Captain Crunch whistle

Security expert Bruce Schneier has pointed out that large language models are open to the same kind of weaknesses that phones in the 1970s had, the kind that John Draper exploited.