Data Engineer (Databricks & Python)

About Us

BySix Engineers the future and drives innovation. We are more than just a standard software engineering company, we believe that true impact comes from combining technical expertise with human values. That's why we reflect that in our approach - technology is not the end goal, but the enabler.

Why Us?

🫸 Multidisciplinary team
📒 Training on demand
💴 Attractive salary and benefits package
📈 Career progression plans
👌 And amazing get together events

What are we looking for?

We are looking for a Data Engineer with:

• Proven experience with Databricks, PySpark, and Python library design.
• Strong software engineering background — OOP, testing, CI/CD, and abstraction principles.
• Understanding of both batch and streaming data processing.
• Knowledge of Medallion Architecture and data lifecycle best practices.
• Familiarity with Airflow (AKS), Terraform, and Azure ADLS Gen2.

What do we expect from you?

• Design and implement a common Python library for Databricks used across batch and streaming data pipelines.
• Develop reusable PySpark modules and abstract classes for Bronze, Silver, and Gold processing layers.
• Collaborate with other engineers to ensure coding standards, documentation, and testing practices are followed.
• Maintain CI/CD integration with GitLab and Databricks Asset Bundles (DABs).
• Work closely with DataOps to ensure library updates are stable and observable in production.
• Integrate monitoring and logging standards using Grafana and DQX for data quality validation.
• Work within Databricks, Airflow on AKS, and Terraform-managed infrastructure.
• Ensure smooth library deployment, versioning, and package management across environments.
• Collaborate with DataOps to enforce secure and performant runtime environments.
• Our stack includes Talend, Azure ADLS Gen2, Azure Databricks, Airflow (AKS),
• Terraform, SQL, Python, PySpark, Grafana, Kafka (Aiven), GitLab, Databricks Asset
• Bundles (DABs), and DQX (Data Quality Framework).

Are you ready?

If you're ready to make a real impact by leveraging cutting-edge technology and fostering human-centric solutions, BySix is the place for you. Together, we'll drive innovation and create lasting business value.

Note: BySix is an equal opportunity employer. All applicants will be considered and analyzed regardless of ethnicity, religion, gender identity, sexual orientation, national origin, age, or disability status.