Digitain→
Data Engineer at Digitain in Yerevan, Yerevan, Armenia
Mid LevelOn-siteFull-timeYerevan, Yerevan, Armenia
Skills
sqldatabase designdata modelingpythonjavascalaetleltrelational databasesnosql databaseslinuxbash scriptingsnowflakeamazon redshiftgoogle bigqueryhadoopapache sparkapache kafkaspark streamingapache airflowaws glueawsmicrosoft azuregoogle cloud platformci/cdgitgdprhipaaapache atlasamundsenanalytical skillsproblem-solvingcommunicationcollaborationattention to detail
Job Description
We are looking for a skilled Data Engineer to design, build, and maintain the infrastructure that supports our data management, processing, and analytics capabilities.
In this role, you will work closely with cross-functional teams to develop scalable data pipelines, modern storage solutions, and effective data governance frameworks. You will play a key role in ensuring that organizational data is accurate, accessible, secure, and optimized for reporting, analytics, and machine learning use cases.
Responsibilities
- Design, develop, and maintain scalable and efficient data pipelines for collecting, processing, transforming, and storing large volumes of data.
- Build, manage, and optimize modern data storage solutions, including data lakes and data warehouses.
- Collaborate with cross-functional teams to define and implement data governance, security, and compliance practices.
- Partner with data analysts and data scientists to optimize data architecture for reporting, analytics, and machine learning workloads.
- Monitor data pipelines and storage infrastructure, identify performance or reliability issues, and implement appropriate solutions.
- Ensure data quality, accuracy, consistency, and integrity through validation, monitoring, and control mechanisms.
- Conduct code reviews and contribute to the continuous improvement of engineering standards and practices.
- Mentor and support junior engineers when required.
- Communicate with business stakeholders to understand data requirements and deliver effective, scalable solutions.
- Stay up to date with emerging technologies, industry trends, and best practices in data engineering.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Software Engineering, or a related field.
- At least 3 years of hands-on experience in data engineering or a related technical role.
- Strong expertise in SQL, database design, and data modeling.
- Proficiency in at least one programming language, such as Python, Java, or Scala.
- Strong knowledge of ETL and ELT processes, tools, and best practices.
- Experience working with relational and NoSQL databases.
- Experience with Linux-based environments and Bash scripting.
- Hands-on experience with data warehouse technologies such as Snowflake, Amazon Redshift, or Google BigQuery.
- Knowledge of Big Data technologies, including Hadoop and Apache Spark.
- Experience with data streaming technologies such as Apache Kafka and Spark Streaming.
- Experience with workflow orchestration tools such as Apache Airflow, AWS Glue, or similar platforms.
- Practical experience with cloud-based data platforms, including AWS, Microsoft Azure, or Google Cloud Platform.
- Experience implementing CI/CD pipelines for data workflows.
- Familiarity with version control systems, particularly Git.
- Knowledge of data security, privacy, and regulatory compliance standards, including GDPR and HIPAA.
- Exposure to data cataloging, metadata management, and data lineage tools such as Apache Atlas or Amundsen.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
- High attention to detail and the ability to perform effectively in a fast-paced environment.