Senior Application Security Engineer – GenAI Security Evaluation
Posted 1hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Application Security Engineer evaluating LLM agent and RAG vulnerabilities for Gramian Consultancy. Building security test repositories and assessing SAST tools.
Responsibilities:
- Build runnable agent and RAG repositories containing code-reachable Sensitive Information Disclosure and Excessive Agency vulnerabilities.
- Develop realistic security scenarios involving tool calling, agent memory, Model Context Protocol (MCP), and other LLM application components.
- Create vulnerable, fixed, and hard-negative code variants with minimal security-relevant differences.
- Evaluate static application security testing (SAST) tools and assess their ability to detect genuine vulnerabilities while avoiding false positives.
- Perform source-to-sink analysis and trace relevant data flows, action paths, and trust boundaries.
- Annotate security findings, including affected assets, root causes, controls, severity, and residual risk.
- Define authorization contexts covering actors, tenants, identities, permitted data, actions, purposes, and recipients.
- Develop deterministic tests to validate vulnerable, fixed, and negative security behaviors.
- Recommend appropriate security controls and remediation approaches.
- Participate in technical calibration, peer reviews, and quality assurance activities.
Requirements:
- 5+ years of professional experience in application security, product security, or security-focused software engineering.
- Strong experience conducting secure code reviews and identifying application-level vulnerabilities.
- Practical knowledge of source-to-sink analysis, taint analysis, and static application security testing (SAST).
- Hands-on experience with security analysis tools such as CodeQL or Semgrep.
- Experience building or securing LLM agents and/or Retrieval-Augmented Generation (RAG) applications.
- Familiarity with LangChain, LlamaIndex, OpenAI or Anthropic SDKs, and Model Context Protocol (MCP).
- Strong understanding of authorization models, including actors, identities, trust boundaries, multi-tenant authorization, access control, OAuth, IAM, identity management, permitted data access and actions, purpose and recipient restrictions, and document-level access control.
- Production-level coding experience in Python and/or TypeScript.
- Ability to distinguish genuine Sensitive Information Disclosure and Excessive Agency vulnerabilities from non-findings and false positives.
- Strong analytical skills and ability to communicate technical security findings clearly.




















