Data Engineer

ABOUT THE OPPORTUNITY

We are looking for a PySpark Developer/Data Engineer to support a financial services sector organization in the development, optimization and industrialization of large-scale data processing solutions for business-critical application environments.

WHAT YOU WILL DO

- Design, develop and maintain scalable batch and streaming data pipelines using PySpark and Apache Spark.

- Optimize existing Spark workloads by improving partitioning, reducing shuffle operations, tuning memory utilization and resolving data skew issues.

- Integrate, transform and validate large heterogeneous datasets from databases, APIs, file-based sources and streaming platforms.

- Translate functional requirements into efficient technical designs, data flows and implementation approaches.

- Apply software engineering best practices, including clean code principles, code review, automated testing and maintainable delivery standards.

- Deploy, automate and monitor data pipelines using orchestration and delivery tools.

- Collaborate with data engineers, data scientists, architects and cross-functional teams in an Agile environment.

WHAT WE ARE LOOKING FOR

- Professional experience in software development or data engineering, with proven specialization in PySpark and Apache Spark.

- Strong analytical capability, technical rigor and autonomy in solving data processing and performance challenges.

- Ability to communicate clearly with technical and functional stakeholders and contribute to collaborative delivery.

- Commitment to software quality, maintainability, optimization and reliable data engineering practices.

TECHNICAL SKILLS

- Python

- PySpark

- Apache Spark

- Spark SQL

- DataFrames and Datasets API

- Spark architecture, including Driver, Workers, DAG, lazy evaluation and caching mechanisms

- SQL and complex query optimization

- Parquet

- Delta Lake

- Avro

- SQL and NoSQL databases

- APIs

- Kafka streams

- Apache Airflow

- Git

- CI/CD pipelines

- PyTest

- Unit testing and integration testing

- Spark data mocking

- AWS, Azure or GCP

- Databricks or EMR

- Agile delivery methodologies

NICE TO HAVE

- Experience with Prefect or additional workflow orchestration tools.

- Experience with advanced monitoring and performance analysis of distributed data processing workloads.

COMPENSATION TRANSPARENCY

Base salary range: EUR 22,000 - EUR 28,000 gross/year

Total compensation: up to EUR 34,000/year

The salary range is based on objective and gender-neutral criteria, including required competencies, professional experience, level of responsibility and role requirements. Final compensation will be determined according to the candidate's profile and position requirements.

WHAT WE OFFER

- Private health insurance from the first day, with optional family extension.

- Confidential mental health support through free access to psychological support, content and live sessions.

- Continuous training and certification opportunities to support long-term professional development.

- Flexibility whenever the role and context allow it, supporting sustainable delivery and daily balance.

- Childcare vouchers and practical support measures designed to help balance personal and professional life.

- Team moments, shared milestones and leadership presence when it matters most.

- Upskilling opportunities in quality management, information security, AI governance and cybersecurity best practices.

EQUAL OPPORTUNITY

Hexa is committed to equal opportunity and inclusive recruitment practices. We value diverse backgrounds, perspectives and experiences, and our approach is aligned with the principles of the Portuguese Diversity Charter.

HEXA LIFE

At Hexa, every professional is a Builder. We work with honesty, mutual support and agility, creating strong professional relationships and contributing to projects, solutions and teams with responsibility, transparency and continuous improvement.