Aws Data Engineer at Lancesoft in Bengaluru

Role & responsibilities

AWS Data Engineer Job Description

Role Overview

We are looking for an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure on AWS cloud. The ideal candidate will have strong experience in big data technologies, ETL processes, and cloud-based data platforms.

Key Responsibilities
• Design and develop data pipelines using AWS services like Glue, Lambda, and Step Functions
• Build and manage data lakes and data warehouses using Amazon S3, Redshift, and Athena
• Perform ETL/ELT processes to ingest, transform, and load data from multiple sources
• Optimize data workflows for performance, scalability, and cost efficiency
• Ensure data quality, governance, and security compliance
• Collaborate with data scientists, analysts, and stakeholders
• Monitor and troubleshoot pipeline issues

Required Skills

Core AWS Services
• Amazon S3
• AWS Glue
• Amazon Redshift
• AWS Lambda
• Amazon Kinesis (for streaming)
• AWS IAM (security)
• CloudWatch (monitoring)

Programming & Tools
• Python / PySpark / Scala
• SQL (advanced querying)
• Apache Spark / Hadoop (optional but valuable)
• ETL tools and frameworks
• Data modeling (star/snowflake schema)

Preferred candidate profile