Job opening: Supervisory IT Specialist (AI)
Salary: $120 579 - 195 200 per year
Published at: Jan 16 2025
Employment Type: Full-time
The Department of Commerce ranked top 5 in the 2023 Best Places to Work in the Federal Government amongst large agencies for the 12th year in a row! The ranking showcases the Department's continued commitment to increasing our employee engagement, employee satisfaction, and positive perceptions towards diversity, equity, accessibility, and inclusion.
This notice is issued under direct-hire authority to recruit new talent to occupations for which NIST has a severe shortage of candidates.
Duties
ZP-IV: You will manage activities focused on evaluating and improving AI systems to ensure their functionality, trustworthiness, and compliance with Executive Order 14110. This grade level involves designing robust evaluations, identifying vulnerabilities, and collaborating across teams to address AI safety challenges while contributing to technical guidelines and best practices. Key duties include:
Assess the effectiveness of AI model safeguards and recommend enhancements.
Conduct red-team operations to identify failures, vulnerabilities, and potential misuse in AI systems.
Develop and refine tools, workflows, and methodologies for red-teaming and safety/security evaluations.
Continuously improve evaluation techniques for greater efficiency and scalability.
Collaborate with team members and cross-functional teams to develop innovative solutions for AI safety challenges.
Clearly communicate complex AI concepts to diverse audiences, including technical and non-technical stakeholders.
Contribute to the development of technical guidelines and best practices for AI safety.
ZP-V: As a leader and technical expert in AI safety, you will lead and oversee the design and execution of evaluations to ensure the reliability and compliance of AI systems with Executive Order 14110. This grade level involves developing innovative solutions, leading cross-functional teams, refining best practices, and advising senior leadership on complex issues critical to the mission of the AI Safety Institute. Key duties include:
Formulate and manage the design and implementation of structured, scientifically sound evaluations of AI systems.
Lead the evaluation of existing AI model safeguards to determine their effectiveness and recommend improvements.
Plan and execute red-team operations using real-world adversarial tactics to identify failures, vulnerabilities, and potential misuse in AI systems.
Develop and refine software, workflows, and tools for red-teaming and safety/security evaluations.
Establish and improve coding standards, workflows, and product automation to enhance evaluation efficiency and scalability.
Collaborate with cross-functional teams to create innovative solutions to AI safety challenges.
Clearly communicate complex AI concepts to diverse audiences, including technical and non-technical stakeholders.
Contribute to the development of technical guidelines and best practices for AI safety.
Requirements
- U.S. citizenship
- Males born after 12-31-59 must be registered for Selective Service
- Suitable for Federal employment
- Completion of Confidential Financial Disclosure, Form OGE-450
- Designated and/or random drug testing required
- Bargaining Unit Position: No
Qualifications
ZP-4: Applicants must have at least one year of specialized experience at the GS-12 (ZP-III at NIST) or equivalent grade level. Specialized experience is defined as experience with Artificial Intelligence (AI) generative models and/or Machine Learning (ML) algorithms; carrying out technical evaluations to identify safety issues or security vulnerabilities; and collaborating and coordinating on AI-related projects.
ZP-5: Applicants must have at least one year of specialized experience at the GS-13 (ZP-IV at NIST) or equivalent grade level. Specialized experience is defined as experience with Artificial Intelligence (AI) generative models and/or Machine Learning (ML) algorithms; planning and designing technical evaluations to identify safety issues or security vulnerabilities; leading cross-functional AI-related teams and projects; and establishing best practices, including specific technical standards and workflows.
Experience refers to paid and unpaid experience, including volunteer work done through National Service programs (e.g., Peace Corps, AmeriCorps) and other organizations (e.g., professional; philanthropic; religious; spiritual; community, student, social). Volunteer work helps build critical competencies, knowledge, and skills and can provide valuable training and experience that translates directly to paid employment. You will receive credit for all qualifying experience, including volunteer experience.
The qualification requirements in this vacancy announcement are based on the U.S. Office of Personnel Management (OPM) Qualification Standards Handbook.
Applicant Reconsideration
Education
Qualifications are based upon meeting specialized experience only. Education cannot be used to qualify for this position.
Contacts
- Address NIST Office of the Director
100 Bureau Drive
Building 101/Room A1137
Gaithersburg, MD 20899
US
- Name: Tailor Thompson
- Email: tailor.thompson@nist.gov