Spot Freight→
Data Engineer at Spot Freight in Indianapolis, IN
Skills
Job Description
Today’s logistics marketplace is an ever-changing landscape where you can make your mark. Spot gives you the tools to tackle industry challenges for our partners. Here, initiative, drive, and teamwork form the basis for a rewarding, fast-paced career.
About the Role
Red Technologies is seeking a Data Engineer with a strong passion for building scalable, reliable data platforms that power analytics, decision-making, and operational systems. Our team is responsible for turning complex, high-volume data into accessible, actionable insights for our customers, carriers, and internal teams.
In this role, you will take ownership of critical components of our data platform and pipelines, partner closely with data science, analytics, and software engineering teams, and help evolve our architecture as we ingest and process increasingly large and complex datasets. You’ll work on everything from batch and streaming pipelines to data modeling, governance, and performance optimization. If you enjoy solving real business problems with data and want to have a direct impact on daily operations, this role is for you.
Responsibilities
- Design, build, and support Red Technologies’ data and business intelligence platform using Databricks, Azure Synapse, Sigma Computing, and SQL Server.
- Own and maintain production-grade data pipelines that reliably serve data scientists, analysts, internal applications, and customer-facing systems.
- Lead or contribute to the ingestion of near-real-time and streaming data into the platform.
- Partner with software engineers, product managers, analysts, and non-technical stakeholders to translate business needs into scalable technical solutions.
- Design and implement data quality checks, testing frameworks, and governance processes to ensure accuracy, reliability, and trust in our data.
- Optimize data models, queries, and pipelines for performance, scalability, and cost efficiency.
- Contribute to architectural decisions and help guide best practices across the data engineering stack.
- Mentor junior team members and help raise the overall technical bar of the team.
Qualifications
- 3+ years of experience building and maintaining data pipelines using tools such as PySpark, Pandas, SQL, and similar technologies.
- Bachelor’s degree in Data Engineering, Computer Science, a related field, or equivalent real-world experience.
- Strong understanding of data modeling, joins, aggregations, and analytical patterns.
- Solid experience working with cloud and distributed data systems.
- Proven ability to debug complex data issues and deliver reliable solutions in production environments.
- Strong problem-solving skills, attention to detail, and ownership mindset.
- Ability to independently research, evaluate, and adopt new tools and technologies.
- Experience with Azure, Databricks, Azure Synapse, SQL Server, and/or Kafka is a plus.
- Experience in logistics, transportation, or supply chain environments is a plus.
Additional Information
- Visa sponsorship is not available for this position.
- This role is available at our Indianapolis, IN or Tampa, FL office locations only.
#LI-ZH1
Spot is built on relationships, combining 24/7 support with a proven, passionate, and dedicated team of logistics professionals. You can reach your true potential through the unlimited opportunities we offer. When you put in the effort, show initiative, solve problems, and build lasting client relationships, you earn respect and rewards. You’ll also be a key component to the success of an industry leader. At Spot, we’ve never lost the entrepreneurial spirit that provides the foundation for our success.
Spot Freight, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Spot Freight is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a disability, you need a reasonable accommodation, please contact our Human Resources team to notify us of your request. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.