Epam Systems→
Lead Data Engineer at Epam Systems in Hybrid - Bengaluru
ExperiencedHybridHybrid - Bengaluru
Skills
SparkPythonPysparkData EngineeringAzure Data WarehouseAdlAzure DatabricksAWS Glue
Job Description
Create and maintain optimal cloud-based Operational Datasource (ODS) & data pipeline architectures capable of ingesting structured and unstructured data using both batch & kafka streaming methods
Build the infrastructure required for optimal extraction,transformation,and loading of data from a wide variety of data sources
Proficient in Databricks
Build the infrastructure required for optimal extraction,transformation,and loading of data from a wide variety of data sources
Proficient in Databricks