New York will independently test AI models

The state’s research center will check AI companies’ work instead of taking their word.

As the federal government essentially leaves us all at the mercy of the AI industry, New York is taking matters into its own hands. On Tuesday, Governor Kathy Hochul launched the nation's first state-run AI testing program. Instead of trusting AI companies to police themselves, New York's system will task independent researchers with checking their work. "The stakes are too high to simply take AI companies at their word," Hochul stated in a press release.

The work will be handled by the New York Center for AI Responsibility and Research at Binghamton University. More than 80 New York scientists will contribute. They'll use computing power from Empire AI, the state's $500 million public-private AI partnership.

Hochul's office said the center will test advanced AI systems, study their risks and provide evidence to inform public officials' decisions. It will also look at how AI can be used responsibly in areas like medicine and scientific discovery.

One potential hole in the program is that it can only study what AI companies disclose publicly. New York's RAISE Act, signed by Hochul last year, requires large AI developers to register with the state by January 1, 2027. Starting then, companies will have to publish safety frameworks and transparency reports and report critical safety incidents within 72 hours. The RAISE Act won't plug the hole on unreleased models, but it will at least force companies to disclose more.

Source: Read original article