Software Dev Engineer II

Get AI-powered advice on this job and more exclusive features.This range is provided by Aditi Consulting. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Base pay range$50.00/hr - $55.00/hrPayrate: $ 50.00- $ 55.00/ hr.Job Description:As an LLM Evaluation Expert specializing in Coding, you will play a crucial role in assessing and improving our language models' coding capabilities. Your expertise will be instrumental in evaluating LLM-generated code responses, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted coding.Key Responsibilities:Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigmsExercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated optionsMake informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needsDevelop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiencyProvide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and outputCollaborate with the AI research team to identify areas for improvement in the LLM's coding capabilitiesStay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations remain cutting-edgeRequired Qualifications:Advanced degree in Computer Science, Software Engineering, or a related fieldExtensive experience (5+ years) in software development across multiple programming languages and paradigmsDemonstrated ability to critically evaluate code quality, efficiency, and adherence to best practicesStrong analytical and decision-making skills, with the ability to make complex judgments under ambiguous circumstancesExcellent written and verbal communication skills, with the ability to explain technical concepts clearlyExperience in technical writing, particularly in creating coding examples or tutorialsPreferred Qualifications:Previous experience working with or evaluating AI systems, particularly in the context of code generationFamiliarity with a wide range of software development methodologies and architectural patternsUnderstanding of machine learning concepts, particularly as they apply to natural language processing and code generationExperience in creating or contributing to coding standards or style guidesPay Transparency:The typical base pay for this role across the U.S. is: $ 50.00- $ 55.00/hr. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience and the benefits package you select. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, 10 paid days off, 401(k) plan participation, commuter benefits and life and disability insurance.For information about our collection, use, and disclosure of applicant's personal information as well as applicants' rights over their personal information, please see our Privacy Policy (Consulting LLC uses AI technology to engage candidates during the sourcing process. AI technology is used to gather data only and does not replace human-based decision making in employment decisions. By applying to this position, you agree to Aditi’s use of AI technology including calls from an AI Voice Recruiter.#AditiConsultingSeniority levelSeniority levelEntry levelEmployment typeEmployment typeContractJob functionJob functionEngineering and Information TechnologyIndustriesSoftware DevelopmentReferrals increase your chances of interviewing at Aditi Consulting by 2xSign in to set job alerts for “Software Engineer” roles.Washington, DC $95,000.00-$125,000.00 1 month agoWashington DC-Baltimore Area $130,000.00-$140,000.00 2 weeks agoPotomac, MD $125,000.00-$150,000.00 1 week agoWashington DC-Baltimore Area $140,000.00-$150,000.00 3 weeks agoWashington, DC $65,000.00-$185,000.00 8 months agoReston, VA $75,000.00-$100,000.00 1 month agoWashington DC-Baltimore Area $140,000.00-$150,000.00 3 weeks agoReston, VA $110,160.00-$129,600.00 2 months agoArlington, VA $150,000.00-$200,000.00 5 months agoFull Stack Software Engineer, Observability AIWashington, DC $140,000.00-$170,000.00 1 month agoFull Stack Software Engineer (GoLang + JS + React Native)Machine Learning Engineer, AI (FULLY REMOTE, USA)We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr

Created: 2025-09-17