Experts warn: nearly everyone in AI is susceptible to a honey trap scheme right now

Experts warn: nearly everyone in AI is susceptible to a honey trap scheme right now

Even as the fall-out for Nvidia over Jensen Huang’s alleged honey-trap scandal is still unfolding, Silicon Valley has yet to reckon with a new reality: many more people among them are at risk. 

“Nobody briefs founders on counterintelligence,” Aaron Brown, a former senior CIA officer and current founder of the software company Lumbra, told TechCrunch.

That’s because historically honey traps have been associated with politicians, the military and national intelligence — the people “behind clearances and a workforce trained to expect an approach,” from spies and other attackers.

But now many of the most valuable secrets “sit inside companies building chips, models, and infrastructure,” Brown says, adding that a spy “wants what the CEO can touch. The roadmap, the export decisions, the customer list, who gets the technology. The CEO is the shortest path to all of it.”

Huang has been accused of falling for just such a honey trap by having an affair with Alice Huang. She’s a former executive of a Singapore neocloud who’s been accused of being a Chinese spy and of smuggling billions of dollars’ worth of restricted Nvidia chips into China. 

After the Huang allegations broke, jokes flooded the internet about which tech CEO will be next, but it’s not just CEOs and founders who are at risk. The WSJ reported that OpenAI started warning its employees about outsiders trying to cozy up to them in search of company secrets. Anyone with access to sensitive information — from board members to executive assistants — can be the target of a honey-trap. 

And typically, the attackers aren’t lovers. Friendship is actually the oldest honest trap scheme around, Brown said.

Honey traps gain access to their targets as investors, customers, recruiters, and consultancies. Their requests look legitimate on paper and don’t need their targets to fall in love. “They need you to feel comfortable talking,” Brown said. “They last longer because nobody’s looking.”

What’s interesting, too, is the irony. So many tech founders are moving to automate and digitize so much of human life and yet remain vulnerable to the oldest bug around, a person who preys on the human need to be understood by others.

“Why fight through a firewall when you can get close to the person who can open doors, influence decisions, or make requests nobody wants to question?” Perry Carpenter, a cybercrimologist and chief deception strategist at KnowBe4, told TechCrunch.

Once targets realize they have been compromised, the threat can escalate: attackers now have a means of blackmail.

Another irony: AI has made honey trapping much easier and cheaper. Planning a scheme used to take months or years of research, crafting a persona, knowing the target, and executing a plan. These days, it’s easy to use AI to research a target, generate fake social profiles, fake backgrounds, even fake voice calls.

“AI can help sustain an entire fictional backstory,” Carpenter said. “The technology helps set the stage, but the deception ultimately plays out through human relationships.”

The AI industry “became a national security industry faster than its culture caught up,” Brown said.

“Part of being honey trapped is not knowing,” he added. “It doesn’t feel like manipulation. It feels genuine, even lucky.”

Carpenter said a good first step is looking for unusual patterns. Note, for instance, “coincidental encounters that happen a little too often,” he said. There are also obvious signs, like persistent curiosity about work and colleagues, or requesting secrecy about meeting up, and pressing for introductions or information.

Bigger red flags include if someone’s requests are getting bigger, pushing the boundaries of what you usually would be uncomfortable doing. “A simple gut check,” Brown said. “Would this person still be around if you lost your job tomorrow?”

It also helps to try and understand when emotions might be influencing a decision. Carpenter suggests putting up a clear boundary between one’s personal and professional life. Within companies, it also helps to “eliminate executive exceptionalism,” he said, the idea that the rules don’t apply to people in power at the company.

Brown added that company culture plays another role, too: are employees comfortable with raising concerns, challenging unusual requests, and escalating possible threats? “One of the most dangerous security cultures is one where nobody feels comfortable questioning the CEO,” Carpenter said.  

“Founders need to take risks, and they need to explore business opportunities,” Brown said. “Paranoia doesn’t help. Recognizing you’re a target does.”


Source: Read original article