2 days ago California State Senate passed SB 1047, which establishes safety standards for AI developers of frontier models. A lot of the requirements directly demand guardrails that ZenGuard AI is developing. SB 1047 has far-reaching implications as it will inform other regulations in other states and countries. https://lnkd.in/dNSfJqun * All developers are strongly encouraged to follow safe, secure, and ethical AI development. The measures are (among others): pre-deployment safety testing, red-teaming, cybersecurity, safeguards to prevent the misuse of dangerous capabilities, and post-deployment monitoring. The goal is to set a community standard for safe, secure, and ethical AI development, that even smaller developers can adopt. * SB 1047 heavily targets its regulatory focus on "frontier" AI models requiring computing power greater than 10^26 floating-point operations that cost over $100 million to train. * The bill introduced CalCompute - a state-backed cloud computing cluster to democratize access to GPUs for smaller developers. In conjunction with the standards and guidelines in the bill, there is a clear motivation to adopt safety and security at the earliest stages of AI development for all developers. * This sets legal framework for attorneys to take legal action in the event the developer of a powerful AI harm or threat to the public safety.
Hey Galym, I'm curious with regards to ZenGuard AI - how do you see the future expand beyond just prompting a model with specific requirements to satisfy the detectors? Also this means that you are relaying user input to third-party models? Happy to hear and learn how you're handling the privacy risk and other concerns there :-)
🙌 Right place, right time!
15 years of experience fostering impactful multi-stakeholder relationships, analyzing market and policy trends, and aligning investor communications with business strategy.
5moAs an external observer, it seems to me that the California State Senate is far more functional and effective on frontier tech legislation than the US Senate or any of the 49 other State Senates for the matter.