LLM Security Evaluation Expert
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
LLM Security Evaluation Expert responsible for testing and ensuring the security of AI systems. Focused on adversarial prompt attacks and vulnerability assessments in SilverEdge's AI operations.
Responsibilities:
- Test the security and integrity of Large Language Models (LLMs)
- Design and execute adversarial prompt attacks
- Develop prompts targeting LLM vulnerabilities
- Systematically test LLMs against adversarial prompts
- Analyze LLM responses for security weaknesses
Requirements:
- Strong knowledge of how LLMs work
- Familiarity with prominent LLM families
- Proven experience in crafting and refining prompts
- Demonstrable understanding of prompt injection techniques
- Strong understanding of cybersecurity principles
- Ability to think like an attacker
- Excellent ability to analyze complex systems
- Clear and concise written and verbal communication skills
- Understanding of ethical implications of AI security
- Commitment to responsible testing practices
- Prior experience in AI red teaming or LLM security roles
- Familiarity with LLM security evaluation frameworks
- Knowledge of common LLM fine-tuning and alignment techniques
- Contributions to the AI security community
Benefits:
- N/A
Similar Jobs
Lead Technical Consultant, Cybersecurity Defense
Lead Technical Consultant managing Cyber Defense projects across Germany, Austria, and Switzerland. Responsible for technical implementation and innovation in Cyber Defense architectures.
Staff Security Product Engineer
Security Engineer building AI-driven security products for application security and operations. Collaborating with product teams to design systems that act on security signals and workflows.
Cybersecurity Risk Engineer
Designing and maintaining secure cloud infrastructures as a Cybersecurity Engineer at Ensemble Health Partners. Focused on enhancing security controls and analyzing potential vulnerabilities in cloud structures.
Engineer, Cybersecurity Risk
Engineer II, Cybersecurity designing and maintaining secure infrastructures for Ensemble Health Partners, while analyzing cloud structures for enhanced security methods.
Senior AI Cybersecurity Engineer
AI Cybersecurity Engineer designing and executing cybersecurity-focused AI governance programs. Collaborating with cross-functional teams on secure AI solutions and policies while ensuring compliance and risk management.
Technical Writer, Cybersecurity
Technical Writer ensuring clarity and consistency in federal cybersecurity documentation. Edit and format various technical documents while collaborating with analysts and SMEs.
Cybersecurity Program Manager
Cybersecurity Program Manager overseeing contract performance and managing cybersecurity teams for federal clients in a remote capacity. Ensuring quality, audit-ready security assessment services are delivered.
Information Security Engineer
Information Security Engineer assessing web technologies and coordinating remediation at G-P. Collaborating with teams to enhance application security and develop automation tools.
Cybersecurity Compliance Lead
Cybersecurity Compliance Lead at Fresche Solutions responsible for leading the cybersecurity compliance program and mentoring team members. Overseeing audits, developing strategies, and fostering a security culture.
Senior Security Architect
XAAS Consultant advising clients on IT Security, focusing on infrastructure, cloud, and application security. Involves hands-on security assessments and developing security architectures.
Security Specialist – Cryptography
Security Specialist focusing on Cryptography for remote projects at The Whiteam Consulting. Collaborating with technology consultants to optimize business profitability.
Protection and Security Specialist
Sicherheitskraft plant und setzt Maßnahmen zur Gefahrenabwehr für Veranstaltungen um. Zusammenarbeit mit Kunden und Behörden in einem der größten Messeunternehmen der Welt.
Information System Security Officer
Information System Security Officer managing security authorization for federal information systems. Overseeing RMF lifecycle activities and ensuring compliance with federal directives.
KMS Security Engineer – Security
KMS Security Engineer ensuring security in crypto wallets for a leading money app company. Responsible for mitigating security risks and collaborating with development teams to maintain security integrity.
Staff Security Engineer
Staff Security Engineer role at a Managed Service Provider overseeing security solutions across diverse clients. Focus on technical leadership, architecture, mentoring, and compliance.
Bug Bounty Security Researcher
Bug Bounty Security Researcher identifying and reporting vulnerabilities in software applications and systems for Inspectiv. Contributing to improving security and participating in bug bounty programs.
IT Security Compliance Assurance Manager – CAM
Information Security Compliance Assurance Manager at Gainwell, managing audits and compliance with HIPAA and NIST frameworks for the organization. Leading security controls and compliance efforts with executive stakeholders and IT.
Social Security Disability Case Manager
Social Security Disability Claims Case Manager at Mindset assisting clients with claims application processes. Responsible for gathering documentation and advocating for clients' claims.
Analyst – Cyber Security Compliance
Cyber Security Analyst conducting PCI Compliance assessments at global live entertainment company Live Nation. Assuring effective implementation of security controls aligned with organizational standards.
Cloud Security Engineer
Cloud Security Engineer ensuring cloud infrastructure security at Camping World. Bridging strategic security requirements with technical implementation in a fast-paced environment.