AI Auditing Engineer (Temporary) - Penn Center for Media, Technology, and Democracy - Penn Engineering
The University of Pennsylvania is a world-renowned leader in education, research, and innovation. They are seeking a part-time AI Auditing Engineer to develop and productionize auditing and monitoring of large language models, creating tools for longitudinal monitoring of LLMs.
Responsibilities
- Develop and deploy an interoperable set of tools that is generally useful for longitudinal monitoring of LLMs
- Design and manage appropriate databases for LLM monitoring
- Advance research methods for LLM monitoring of political topics
Skills
- Bachelor's degree in a relevant field of study
- Required proficiency in developing efficient and scalable data pipelines in Python
- Required proficiency in designing and managing NoSQL databases
- Required proficiency in working with cloud computing platforms
- Preferred understanding or prior experience working with LLM APIs
- Preferred understanding or experience with natural language processing methods for LLM evaluation
- Preferred understanding or experience with cloud cost engineering and other aspects of DevOps, especially cost efficient use of LLMs
- Preferred experience with data visualization in interactive dashboards
- Interest in the political outputs and impacts of large language models (LLMs) is a bonus
Benefits
- Health and Life: Penn offers comprehensive medical, prescription, behavioral health, dental, vision, and life insurance benefits to protect you and your family’s health and welfare.
- Retirement: Penn offers generous retirement plans to help you save for your future. Penn’s Basic, Matching, and Supplemental retirement plans allow you to save for retirement on a pre-tax or Roth basis. Choose from a wide variety of investment options through TIAA and Vanguard.
Company Overview
Company H1B Sponsorship