HCLTech→
SME - AWS IAC, Terraform,Python at HCLTech in Mississauga, Ontario, CA
Skills
Job Description
Job Summary
Job Summary We are seeking a highly skilled Senior Platform Engineer with extensive experience in Big Data technologies, AWS Cloud, and data platform engineering. The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands-on experience in Big Data ecosystem tools, AWS services, and real-time data processing. This role involves working on data platform modernization, cloud migrations, Data Warehousing and ETL in a fast-paced enterprise environment. Key Responsibilities Design, develop, maintain and support scalable data pipelines using Big Data and AWS technologies Lead and support data platform migration initiatives (On-Prem to AWS Cloud) Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow Build and optimize data workflows and orchestration pipelines using Airflow Work with real-time streaming technologies such as Kafka and Spark Streaming Perform data ingestion, transformation, and validation from multiple data sources Optimize SQL queries for performance and scalability Monitor system performance, troubleshoot issues, and ensure system reliability Collaborate with cross-functional teams including developers, architects, and infrastructure teams
Key Responsibilities
Job Summary We are seeking a highly skilled Senior Platform Engineer with extensive experience in Big Data technologies, AWS Cloud, and data platform engineering. The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands-on experience in Big Data ecosystem tools, AWS services, and real-time data processing. This role involves working on data platform modernization, cloud migrations, Data Warehousing and ETL in a fast-paced enterprise environment. Key Responsibilities Design, develop, maintain and support scalable data pipelines using Big Data and AWS technologies Lead and support data platform migration initiatives (On-Prem to AWS Cloud) Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow Build and optimize data workflows and orchestration pipelines using Airflow Work with real-time streaming technologies such as Kafka and Spark Streaming Perform data ingestion, transformation, and validation from multiple data sources Optimize SQL queries for performance and scalability Monitor system performance, troubleshoot issues, and ensure system reliability Collaborate with cross-functional teams including developers, architects, and infrastructure teams
Skill Requirements
Job Summary We are seeking a highly skilled Senior Platform Engineer with extensive experience in Big Data technologies, AWS Cloud, and data platform engineering. The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands-on experience in Big Data ecosystem tools, AWS services, and real-time data processing. This role involves working on data platform modernization, cloud migrations, Data Warehousing and ETL in a fast-paced enterprise environment. Key Responsibilities Design, develop, maintain and support scalable data pipelines using Big Data and AWS technologies Lead and support data platform migration initiatives (On-Prem to AWS Cloud) Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow Build and optimize data workflows and orchestration pipelines using Airflow Work with real-time streaming technologies such as Kafka and Spark Streaming Perform data ingestion, transformation, and validation from multiple data sources Optimize SQL queries for performance and scalability Monitor system performance, troubleshoot issues, and ensure system reliability Collaborate with cross-functional teams including developers, architects, and infrastructure teams
Other Requirements
Job Summary We are seeking a highly skilled Senior Platform Engineer with extensive experience in Big Data technologies, AWS Cloud, and data platform engineering. The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands-on experience in Big Data ecosystem tools, AWS services, and real-time data processing. This role involves working on data platform modernization, cloud migrations, Data Warehousing and ETL in a fast-paced enterprise environment. Key Responsibilities Design, develop, maintain and support scalable data pipelines using Big Data and AWS technologies Lead and support data platform migration initiatives (On-Prem to AWS Cloud) Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar Implement and manage AWS services such as EMR, S3, EC2, Redshift, Glue, and Airflow Build and optimize data workflows and orchestration pipelines using Airflow Work with real-time streaming technologies such as Kafka and Spark Streaming Perform data ingestion, transformation, and validation from multiple data sources Optimize SQL queries for performance and scalability Monitor system performance, troubleshoot issues, and ensure system reliability Collaborate with cross-functional teams including developers, architects, and infrastructure teams