Senior Data and AI Analyst
Auditoria.AI - San Jose, CA
Apply NowJob Description
About UsAuditoria is an AI-driven SaaS automation provider for corporate finance that automates back-office business processes involving tasks, analytics, and responses in Vendor Management, Accounts Payable, Accounts Receivable, and Planning. By leveraging natural language processing, artificial intelligence, and machine learning, Auditoria removes friction and repetition from mundane tasks while automating complex functions and providing real-time visibility into cash performance. Corporate finance and accounting teams use Auditoria to accelerate business value while minimizing heavy IT involvement, improving business resilience, lowering attrition, and accelerating business insights.Founded in 2019 and backed by Venrock, Workday Ventures, Neotribe Ventures, Engineering Capital, and Firebolt Ventures, we build intelligent automation by combining fine-grained analytical orchestration of a company’s typical financial and audit workflows with conversational AI, delivering rapid value to the finance/audit back office.Since then, Auditoria was again named to the Constellation Shortlist for a record four consecutive years (‘20, ‘21, ‘22, ‘23). In 2022, Gartner named Auditoria a “Cool Vendor in Finance ,” a curated list of solutions that challenge the traditional finance software market. In 2023, CRN once again recognized Auditoria as a Finalist for the CRN Tech Innovators Award . The SaaS Awards named Auditoria as a 2023 SaaS Awards Finalist for Best SaaS for Improved Productivity (USA). Most recently Auditoria was named a finalist for the 2023 SSON Impact Awards for Technology of the Year.The Opportunity for YouWe’re seeking a Senior Data and AI Analyst to drive insights across both our AI platform performance and business operations. You’ll work at the intersection of AI, financial operations, and advanced analytics, helping to optimize our AI models, evaluate automation effectiveness, and deliver data-driven value to enterprise clients. This role combines traditional business analysis with the exciting challenge of measuring and improving AI system performance.Key ResponsibilitiesBusiness Process AnalysisDesign and maintain comprehensive analytics frameworks for business processes and financial workflowsDevelop dashboards and reports that provide real-time insights into key business metricsAnalyze user interaction patterns with AI features to improve adoption and effectivenessCreate and maintain ETL pipelines (if necessary) to ensure data quality and accessibilityGenerate actionable insights from complex financial datasets to guide product strategyAI Platform AnalysisDevelop and implement frameworks to evaluate the performance of LLM-based systems and AI agent.sAnalyze AI model outputs, response quality, and automation effectivenessTrack and report on key AI performance metrics such as accuracy, latency, and automation ratesCollaborate with ML engineers to identify areas for model improvements based on data insightsCreate dashboards for monitoring AI system performance and reliabilityConduct A/B testing of different AI configurations and prompt strategiesStrategic ImpactProvide data-driven recommendations for improving both AI capabilities and business processesPartner with product teams to define and track success metrics for AI featuresCollaborate with customer success teams to analyze user feedback and AI system effectivenessBuild and maintain documentation for AI performance metrics and analytics processesQualificationsRequired Qualifications5+ years of experience in data analysis, with recent exposure to AI/ML systemsStrong proficiency in SQL and Python for data manipulation and analysisExperience analyzing AI/ML system performance and metricsExpert-level experience with business intelligence tools (e.g., Tableau, Power BI, Looker)Experience working with large-scale financial datasets and ETL processesStrong statistical analysis skills and experience with A/B testingExperience with cloud-based data warehouses (preferably Snowflake)Bachelor’s degree in Statistics, Mathematics, Computer Science, or related fieldPreferred QualificationsExperience analyzing LLM-based systems and generative AI applicationsKnowledge of NLP metrics and evaluation frameworksExperience with financial systems and processes (AP, AR, Vendor Management)Familiarity with prompt engineering and LLM performance optimizationExperience with real-time analytics and streaming dataKnowledge of data privacy and compliance requirements in financeMaster’s degree in related fieldTechnical SkillsData Analysis & VisualizationPython (Pandas, NumPy, Matplotlib, Seaborn, Plotly, Dash)SQL (expert-level analytics)Tableau/Power BI/QuickSightExcel (advanced)AI/ML AnalyticsLLM evaluation metricsAI monitoring frameworksPrompt effectiveness analysisData InfrastructureSnowflake or similar data warehousesExperience with ETL tools and frameworksData modelingStatistics & TestingStatistical analysisA/B testingHypothesis testingBusiness & DomainSaaS metricsProcess optimizationData governanceWhat We OfferCompetitive startup compensation packageEarly-stage equity optionsUnlimited PTOFlexible work environmentOpportunity to shape the future of AI in enterprise financeAuditoria.AI is an equal-opportunity employer committed to building a diverse and inclusive team. We welcome candidates of all backgrounds passionate about combining cutting-edge AI with practical business solutions.The Auditoria logo, Auditoria SmartFlow Skills, Auditoria AR Collections, Auditoria SmartPay, Auditoria SmartBots, Auditoria SmartInsights, and Auditoria SmartVendor are trademarks or registered trademarks of Auditoria.AI Inc. All rights reserved. #J-18808-Ljbffr
Created: 2025-09-18