NIST Staff Protest Expected Appointment of 'Effective Altruist' AI Researcher to US AI Safety Institute

The National Institute of Standards and Technology (NIST) is facing a significant internal crisis, with staff and scientists threatening to resign over the expected appointment of Paul Christiano to a key position at the newly-established US AI Safety Institute (AISI). Two anonymous sources close to the situation reported that the hiring process for Christiano, known for his connections to the effective altruism (EA) movement, was expedited without prior notice to staff.

NIST is part of the US Department of Commerce, dedicated to enhancing innovation and industrial competitiveness through advanced measurement science and technology. The agency also develops cybersecurity standards and frameworks, including an AI security framework released in January 2023.

Christiano's potential appointment, reportedly influenced by Secretary of Commerce Gina Raimondo, has generated considerable backlash among NIST employees. Concerns center around how his EA and longtermism affiliations could affect the institute's objectivity and integrity.

Divyansh Kaushik, associate director for emerging technologies and national security at the Federation of American Scientists, emphasized that Christiano is highly qualified for specific tasks outlined in President Biden’s AI Executive Order from November 2023, which directs NIST and the AISI to focus on areas such as chemical, biological, radiological, and nuclear (CBRN) security.

Critics argue that EA, described by the Center for Effective Altruism as a movement that uses evidence to maximize altruistic efforts, has devolved into a faction with disproportionate influence, particularly in the realm of AI safety. Detractors claim this focus on existential risks can overshadow pressing, measurable issues like bias and misinformation in current AI applications.

The AISI was created in November 2023 to fulfill the Department of Commerce’s responsibilities outlined in the AI Executive Order. US Senate Majority Leader Chuck Schumer recently announced funding of up to $10 million for the AISI, highlighting its importance. However, recent reports have criticized NIST for its lack of transparency regarding the suitability and competitive process for research grants associated with the institute. Concerns have also arisen about a potential grant to the RAND Corporation, which is linked to influential figures in the tech industry and effective altruism.

Kaushik noted that regardless of the appointment, it is crucial NIST remains committed to its mission. He stated, “We’re navigating uncharted territory in evaluating hypothetical risks from general-purpose models.” He urged the leadership at the Department of Commerce to prioritize scientific integrity in their appointments.

Kaushik warned that losing "superstar scientists" over such appointments would be detrimental. He hopes that Congressional committees monitoring AISI's work can ensure the institute utilizes its strengths effectively without compromising its core mission. In a recent post on X, he expressed optimism about the need for timely appointments, reiterating that proactive hiring should be seen positively in light of the Executive Order’s timelines.

Media inquiries have been made to Secretary of Commerce Gina Raimondo, AISI director Elizabeth Kelly, and Paul Christiano for further comment, and updates will be provided as responses are received.