Senior Business Intelligence Analyst – AI Evaluation, Monitoring
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior BI Analyst supporting AI Evaluation & Monitoring, utilizing analytic expertise for data-driven decisions. Collaborating with stakeholders and mentoring junior BI developers in a healthcare setting.
Responsibilities:
- The Senior BI Analyst serves as a partner to the business or clinical area supported (AI Evaluation & Monitoring)
- Use analytic expertise including knowledge of data structures, programming, and statistics with critical thinking
- Collect, clean, and interpret data sets to answer a question or solve a problem
- Identify and effectively communicate improvement opportunities and support evaluation of existing AI/ML projects
- Act as the analytics expert in meetings and discussions with stakeholders
- Consult with AI stakeholders to gather evaluation and data requirements and define scope on projects of all sizes
- Execute the evaluation work that keeps Geisinger's AI portfolio safe, performant, and accountable
- Collaborate with internal partners and organizations in design and development of reporting solutions and analytic studies
- Develop, validate, and execute complex queries and reports that answer business questions for internal customers
- Present analysis and reports to internal customers and stakeholders
- Report and help troubleshoot data quality issues during data profiling, testing, or validation
- Participate in strategic departmental initiatives and mentor junior BI developers
Requirements:
- Minimum of 8 years-Relevant experience* (Required)
- Healthcare, clinical, or regulated-industry data experience strongly preferred
- Applied statistics: hypothesis testing, confidence intervals, power and sample size, regression, and non-parametric methods
- SQL with large, messy clinical data warehouses, including window functions, CTEs, debugging query plans, and performance tuning
- Python for analysis: pandas, numpy, scikit-learn, statsmodels, common evaluation libraries
- Production monitoring design and execution: drift detection, performance decay tracking, adoption and outcome metrics
- LLM and generative AI evaluation execution: golden sets, judge-based scoring, hallucination and grounding checks
- Education: High School Diploma or Equivalent (GED)- (Required)
Benefits:
- Healthcare benefits for full time and part time positions from day one, including vision, dental and domestic partners
- Encouragement of collaboration, cooperation and collegiality
Similar Jobs
Senior Business Intelligence Developer
Business Intelligence Developer creating and implementing advanced BI solutions for clients. Collaborating with engineers and developers to optimize existing applications and deliver actionable insights.
Business Intelligence Analyst – Supply Chain
Business Intelligence Analyst developing and maintaining solutions for supply chain operations at Solventum. Collaborating with cross-functional teams to provide insights and improve efficiencies.
BI Developer
BI Developer transforming complex data into meaningful solutions at Health Advocate. Building scalable analytics solutions that drive smarter decisions for healthcare organizations.
Business Intelligence Analyst – Senior
Business Intelligence Analyst involved in developing BI solutions for OHSU's Information Technology Group. Collaborating with clinical departments to enhance decision-making processes through data analysis.
Business Intelligence Analyst
Business Intelligence Analyst responsible for building and maintaining end-to-end reporting and analytics solutions. The role involves collaborating with business stakeholders to deliver accurate insights from raw data.
Senior BI Analyst
Senior BI Analyst creating and evolving dashboards and reports for strategic insights. Ensuring data quality and supporting business areas in decision-making.
Business Intelligence Analyst
BI Analyst overseeing data visualizations and ensuring accurate insights from data warehouse for Blueprint's mission. Collaborating to build clean dashboards and validate data across platforms.
Contract Power BI Developer
Power BI Developer helping organizations understand their data through dashboards and analytics. Designing reports, supporting ETL processes, and collaborating with stakeholders.
BI Developer
BI Developer creating and optimizing Power BI dashboards and data models for efficient data storytelling. Collaborating with stakeholders to ensure high-quality data integration and visualization.
Senior Power BI Developer
Senior Power BI Developer designing and supporting business intelligence solutions using Power BI and Microsoft Fabric. Collaborating with business teams and applying data modeling best practices for effective reporting.
Senior Business Intelligence Analyst
Business Intelligence Analyst responsible for project completion tasks and report development. Proficient in SQL and Tableau, with a focus on data analysis and governance.
Senior Business Intelligence Analyst
Senior Business Intelligence Analyst connecting CRM and financial data into actionable insights for growth strategy. Collaborating with leadership to drive data-driven decisions in healthcare analytics.
Business Intelligence Analyst
Business Intelligence Analyst in Bogotá, D.C. transforming data into actionable insights. Developing reports and dashboards while collaborating with cross-functional teams remotely.
Business Intelligence Analyst – System Application Analyst, Entry
Business Intelligence Analyst supporting data analytics and BI tool integration at OHSU. Collaborating with stakeholders to enhance decision-making through effective data analysis and reporting.
BI Analyst
BI Analyst responsible for creating dashboards and reports for global companies. Assisting with data analysis and reporting needs in a modern engineering culture.
Power BI Developer, Finance-Focused
Power BI Developer designing and maintaining financial reporting infrastructures for the Finance team. Integrating data and real-time insights into performance metrics through expert use of Power BI.
Business Intelligence Analyst
Business Intelligence Analyst at Gainwell using data to create reports and dashboards. Collaborating with stakeholders to enhance operational performance and improve healthcare outcomes.
Business Intelligence Consultant – Chemicals Vertical
Business Intelligence Consultant responsible for managing client relationships and driving revenue in the chemicals sector. Collaborating with teams to ensure customer satisfaction and maximize client value.
Power BI Developer
Power BI Developer designing advanced reports and dashboards for Atlas Technica's clients. Responsibilities include data transformation, query optimization, and collaboration with stakeholders.
EBI Analyst II – Pharmacy
EBI Analyst II supporting Enterprise Business Intelligence for pharmacy operations. Collaborating with stakeholders to ensure medication access and regulatory compliance with data-driven insights.