Data Engineer (Performance & Security)

About Us

BySix Engineers the future and drives innovation. We are more than just a standard software engineering company, we believe that true impact comes from combining technical expertise with human values. That's why we reflect that in our approach - technology is not the end goal, but the enabler.

Why Us?

🫸 Multidisciplinary team
📒 Training on demand
💴 Attractive salary and benefits package
📈 Career progression plans
👌 And amazing get together events

What are we looking for?

We are looking for a Data Engineer with:

• Deep knowledge of Databricks configuration, optimization, and administration.
• Experience with PySpark, SQL, and data performance tuning.
• Familiarity with Unity Catalog, DABs, and Terraform integration.
• Strong understanding of data governance, cost optimization, and cluster policies.
• Basic to intermediate experience with Kafka or interest in learning streaming processing.

What do we expect from you?

• Optimize Databricks performance across jobs, clusters, and data workloads.
• Implement and maintain governance, security, and permissions via Unity Catalog and Terraform.
• Contribute to Databricks feature enablement — Delta Live Tables, Databricks Asset Bundles (DABs), and cost efficiency improvements.
• Monitor cluster and job performance using Grafana and internal observability tools.
• Support data engineers in troubleshooting and fine-tuning jobs and SQL queries.
• Explore and progressively implement streaming features (Structured Streaming, Autoloader, Kafka integration).
• Manage Databricks environments integrated with Airflow on AKS, Azure ADLS Gen2, and Terraform.
• Collaborate with DataOps to ensure high availability, logging, and monitoring coverage.
• Implement performance and security benchmarks for production workloads.
• Our stack includes Talend, Azure ADLS Gen2, Azure Databricks, Airflow (AKS), Terraform, SQL, Python, PySpark, Grafana, Kafka (Aiven), GitLab, Databricks Asset Bundles (DABs), and DQX (Data Quality Framework).

Are you ready?

If you're ready to make a real impact by leveraging cutting-edge technology and fostering human-centric solutions, BySix is the place for you. Together, we'll drive innovation and create lasting business value.

Note: BySix is an equal opportunity employer. All applicants will be considered and analyzed regardless of ethnicity, religion, gender identity, sexual orientation, national origin, age, or disability status.