AI Training Subject Matter Expert — Accounting

We are seeking highly skilled Subject Matter Experts in accounting and bookkeeping to participate in an intensive, two-week pilot campaign centered on AI model evaluation, task design, and objective grading framework development. The primary goal of this campaign is to challenge and benchmark next-generation AI models by designing complex, highly realistic, domain-specific tasks. Experts will craft workflows requiring multi-step web research, data extraction, and deep professional reasoning to evaluate model performance and establish scoring criteria. This is a full-time commitment for the duration of the contract. Key Responsibilities Complex Prompt Creation: Craft detailed, highly realistic scenario prompts rooted in actual accounting workflows — reconciliation and month-end close, AR/AP management, payroll processing, BAS/tax preparation, financial statement review, chart-of-accounts restructuring, and multi-entity reporting in QuickBooks. AI Model Testing: Execute prompts directly within the AI platform to surface failure modes, hallucination triggers, and reasoning gaps. Continuously iterate and escalate task complexity to rigorously evaluate performance. Rubric & Checklist Authoring: Write objective, self-contained scoring checklists and rubrics supported by explicit reference sources and justifications so peer reviewers can grade AI outputs consistently.

Requirements

& Eligibility - Domain Expertise: 5+ years professional experience in accounting or bookkeeping. - Platform Expertise: 3–4 years hands-on QuickBooks experience. - AI Training Experience: Hands-on experience creating complex prompts, evaluating LLM outputs, and constructing detailed evaluation rubrics. - Language: Professional English fluency (written and spoken). - Availability: Full-time availability across the full two-week campaign. - Device Security: Work must be conducted exclusively on secure personal or corporate devices. Access via public or shared computers is strictly prohibited.