Consult Asia→

Senior Data Engineer at Consult Asia in Pune

ExperiencedOn-sitePune1800000 INR–2750000 INR/yr

Skills

ScalaKafka / SolaceDelta Lake / Iceberg / HudiSparkAirflow / DBTJavaData Pipeline DevelopmentSQL

Job Description

Develop and migrate data pipelines using Spark, Python/Scala. Move Hive and Control-M jobs to Airflow/DBT. Integrate with Kafka, Solace, S3, MinIO, and deploy on Kubernetes ensuring scalable, automated, production-ready solutions.Experienced Data Engineer (6–9 yrs) with strong Spark, Python/Scala, and SQL skills. Hands-on in Airflow, DBT, Kafka, Kubernetes, and data lakehouse tools.Capable of independent delivery and migration