Data Engineer at Insight Global in Warszawa, mazowieckie

Insight Global are seeking a Data Engineer for a leading global pharmaceutical organisation, joining its R&D AI function and supporting a Platform team. This position is fully remote on a contract through June 2027.

The Data Engineer will join a small engineering team building and expanding an internal AWS-based platform for the storage and processing of large-scale, non-GxP omics datasets. You will develop scalable data processing pipelines, work with structured and unstructured scientific data, capture relevant metadata, and help create standardised ways for scientific and technical teams to ingest, process, store and consume rapidly growing datasets.

Must-Have Requirements Include:

• Strong Python experience.
• Experience with Databricks and data lake-style architectures.
• Experience building and maintaining scalable data processing pipelines.
• Hands-on experience handling large structured and unstructured datasets and files.
• Experience designing schemas and data models for both tabular and non-tabular data.
• Experience with data processing tools such as Pandas, DuckDB or similar.
• Strong AWS experience, particularly with data technologies such as S3, Apache Airflow and/or Apache Iceberg.
• Ability to operate effectively within a collaborative, fully remote engineering environment.

Plusses Include:

• Educational or professional background within biology, bioinformatics, biotechnology or another scientific discipline.
• Experience working with omics or sequencing data.
• Experience with Nextflow and/or Seqera.
• Experience with TileDB.
• Experience with WEKA storage.
• Understanding of data archiving strategies.
• Experience supporting scientific or bioinformatics users and workflows.

Job Type: Contract
Contract length: 9 months

Pay: 15,000.00zł - 25,000.00zł per month

Work Location: In person