Introduction to OpenAI’s New Role
OpenAI is seeking a new "leader of readiness" to head the company’s security strategy as concerns grow about the misuse of artificial intelligence tools. The new hire will be responsible for leading the company’s security systems team, which focuses on ensuring AI models are developed and deployed responsibly.
Job Responsibilities and Requirements
The head of preparedness will be tasked with tracking risks and developing mitigation strategies for what OpenAI calls "frontier capabilities that create new risks of serious harm." The ideal candidate will have deep technical expertise in machine learning, AI security, assessments, security, or related risk areas, and experience in designing or conducting rigorous assessments for complex technical systems. According to the job posting, the new hire will be paid $555,000.
Challenges and Concerns
OpenAI’s investments in safety efforts come as research into the impact of artificial intelligence on mental health intensifies. There have been allegations that OpenAI’s chatbot, ChatGPT, was involved in interactions that preceded a series of suicides. In one case, the parents of a 16-year-old sued the company, saying ChatGPT encouraged their son to plan his own suicide. This prompted OpenAI to announce new security protocols for users under 18.
Growing Security Risks
Concerns have also increased over how artificial intelligence could be used to carry out cybersecurity attacks. Samantha Vinograd, a former top Homeland Security official, raised the issue, stating that AI "doesn’t just level the playing field for certain actors, it actually brings new players into the field because individuals, non-state actors, have access to relatively inexpensive technologies that make different types of threats more credible and effective."
Acknowledging the Risks
OpenAI’s CEO, Sam Altman, acknowledged the growing security risks posed by AI, writing that while models and their capabilities have evolved rapidly, challenges have also emerged. He stated that the company is entering a world where a more nuanced understanding and measurement of how these capabilities might be abused and how to limit these disadvantages are needed.
OpenAI’s Preparation Team
According to OpenAI, the company first announced the creation of a preparation team in 2023. The team is focused on ensuring AI models are developed and deployed responsibly. The new head of preparedness will play a crucial role in leading this team and addressing the growing security concerns surrounding AI.
