Intelligence Analyst (Strategic Defense & Assessment) — Remote AI Systems & Data Evaluation

Imagine logging in on your own terms, skipping the traffic entirely, and doing meaningful work that actually pays what you're worth. That's what we offer at AnyHired! We're seeking a remote Intelligence Analyst (Strategic Defense & Assessment) — Remote AI Systems & Data Evaluation ($30 - $80/hour) to assist with advanced AI calibration across Analytic rigor, Source handling, Over-refusal detection, All-Source Intelligence Analysis. Whether you're balancing family life, personal passions, or other projects, this contract gives you the genuine flexibility you've been looking for.

Your Remote Flow & Daily Responsibilities

• Collaborate with project leads to refine procedures for source evaluation and confidence-level assignment.
• Contribute insights to help calibrate analytic standards and enhance the overall quality of AI system benchmarks.
• Develop and map analytic cases to defined taxonomies across multiple evaluation areas, ensuring comprehensive coverage of relevant intelligence scenarios.
• Author complex test cases designed to evaluate model performance on source handling, analytic rigor, and nuanced uncertainty expression.
• Assess and grade AI-generated responses based on criteria such as reasoning, source use, recognition of limitations, and practical utility.
• Identify and flag instances where legitimate analytic exploration is over-refused by the model, providing clear documentation and feedback.
• Document edge cases and analytic disagreements, supporting continuous improvement of evaluation methodologies.

Who Thrives in This Role

• Previous participation in AI evaluation or model assessment initiatives is a plus.
• Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline, ideally with a civilian-IC background.
• Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards.
• Experience in teaching, mentoring, or leading analytic reviews, with a record of fostering analytic rigor.
• Exceptional written and verbal communication skills, with a focus on clarity and precision.
• Ability to identify and articulate nuanced model limitations and over-refusal scenarios.
• Familiarity with structured analytic techniques and intelligence tradecraft standards.

Transparent Earnings & Schedule Autonomy

• Compensation Rate: $30 - $80/hour (verified contractor remuneration)
• Work Arrangement: 100% Remote / Work From Home
• Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
• Core Competencies: Analytic rigor, Source handling, Over-refusal detection, All-Source Intelligence Analysis
• Hiring Lead: Chloe Bennett (Remote Culture Director) at AnyHired

Direct Application Process: Click the Apply button on this page to submit your profile directly for immediate evaluation.