AI training and LLM evaluation jobs
App Security Expert
Apply on micro1 ↗View source posting ↗
Application-security specialists will build small code fixtures containing deliberate vulnerabilities or secure implementations, with particular attention to OWASP risks for LLM-enabled applications. They will create deterministic tests, security manifests, and hidden answer keys so scanners or models can be evaluated reliably. The source prefers roughly five or more years in AppSec, secure development, or CyberSWE work, plus knowledge of OSWE methods, LLM security, AI-assisted static analysis, and agent-based application risks. Strong documentation and realistic vulnerability design are essential.
Responsibilities
- Design and implement small, purpose-built application fixtures with embedded security vulnerabilities or secure solutions, specifically addressing OWASP LLM risks such as Sensitive Information Disclosure and Excessive Agency.
- Develop deterministic test cases and security-context manifests to robustly assess application security posture.
- Create detailed hidden answer keys to enable accurate AI or scanner evaluation of vulnerable versus secure code.
- Evaluate and iterate on pipeline methodologies to ensure synthetic tasks and fixtures are challenging yet realistic for AppSec assessment.
- Document technical insights and methodologies, ensuring clarity in written feedback and communication.
- Collaborate through clear and thorough written and verbal communication to share findings and review peer contributions.
- Engage with agent-based security architecture and contribute to continuous improvement of the evaluation pipeline.
Requirements
- Extensive experience (ideally 5+ years) in application security, secure software development, or CyberSWE roles.
- Strong understanding of OSWE, LLM security, AI-powered static analysis (AI-SAST), and AppSec best practices.
- Proven track record designing or evaluating security architecture for traditional and agent-based applications.
- Expertise in building, securing, and testing application codebases, including identifying and remediating advanced vulnerabilities.
- Exceptional written and verbal communication skills, with a focus on precise technical documentation and collaborative feedback.
- Experience with synthetic security fixtures and deterministic testing approaches is highly desirable.
- Demonstrated ability to deliver thoughtful insights and actionable security recommendations in a remote contribution context.
Eligibility
Bangladesh · Hong Kong · India · Indonesia · Japan · Kazakhstan · Kyrgyzstan · Malaysia · Pakistan · Philippines · Singapore · Sri Lanka · Taiwan · Thailand · Uzbekistan · Vietnam · Austria · Belarus · Belgium · Denmark · France · Germany · Greece · Italy · Netherlands · Portugal · Russia · Spain · Switzerland · United Kingdom · Argentina · Brazil · Chile · Colombia · Mexico · Peru · Algeria · Bahrain · Egypt · Iraq · Jordan · Kuwait · Lebanon · Libya · Morocco · Oman · Palestine · Qatar · Saudi Arabia · Tunisia · United Arab Emirates · United States · Canada · Nigeria · Kenya · South Africa · Ghana · Ethiopia