Junior Data Engineer at Superior Insurance Partners in Chicago, IL

Summary: Superior Insurance Partners is a rapidly growing insurance brokerage platform focused on providing tailored insurance solutions. They are seeking a Junior Data Engineer to support and scale their data platform by building and maintaining data ingestion and ETL pipelines, ensuring operational reliability and efficiency. Responsibilities: - Build, maintain, and enhance Azure Data Factory (ADF) pipelines - Own day-to-day reliability of data ingestion and ETL processes - Troubleshoot pipeline failures, performance issues, and data anomalies - Refactor and improve existing ETL processes to increase efficiency, reliability, and maintainability - Reduce manual data movement through automation and standard patterns - Support schema changes, incremental loads, and new data elements - Integrate data from third-party systems such as: - Insurance agency management systems (e.g., Applied EPIC, Vertafore AMS360, or similar) - CRM and ERP platforms - File-based sources (CSV, Excel, SFTP) - REST-based APIs - Work with API documentation to authenticate, extract, and ingest data - Handle pagination, rate limits, and incremental data extraction - Assist with vendor-provided APIs or SDKs when available - Write SQL queries to validate data completeness and accuracy - Reconcile ETL outputs to source system reports and extracts - Identify and resolve data quality issues - Assist with performance tuning, indexing, and schema cleanup - Create and maintain runbooks for data pipelines and ingestion processes - Document ETL logic, assumptions, and known limitations - Follow and reinforce standards for naming, structure, and deployment - Support change tracking and controlled releases Required Qualifications: - Understanding of ETL concepts and data pipelines - Hands-on experience or strong exposure to Azure Data Factory or similar ETL tools - Experience working with APIs (REST), including reading documentation and handling JSON payloads - Familiarity with cloud-based databases such as Azure SQL, SQL Server, or similar - Experience writing SQL queries (joins, aggregations, filtering) - Strong attention to detail and data accuracy - Ability to document work & processes and follow defined standards Preferred Qualifications: - Experience with insurance systems such as Applied EPIC or Vertafore AMS360 - Exposure to Power BI datasets or backend reporting models - Experience improving or refactoring existing ETL pipelines - Familiarity with basic authentication methods (API keys, OAuth, tokens) - Experience supporting production data environments Required Skills: Azure Data Factory, ETL concepts, SQL queries Important Skills: APIs (REST), cloud-based databases Nice-to-Have Skills: data accuracy