โก New
Senior Data Engineer
TMC
RemoteFull-timeMid LevelRemote
Job Description
We are looking for a Senior / Lead Data Engineer (+5y) to join in Lisbon and help build scalable, cloud-native data platforms that enable data-driven decision-making across the organization.
Key Responsibilities
- Design and implement end-to-end data architectures, including data ingestion, modelling, storage, and orchestration.
- Build and maintain cloud-native data pipelines using Microsoft technologies.
- Develop scalable data warehouse and data lake solutions.
- Create high-performance, reliable, and cost-efficient data platforms.
- Implement data quality, validation, lineage, monitoring, and documentation practices.
- Optimize data pipelines and storage solutions for performance and scalability.
- Support DevOps/DataOps practices and CI/CD automation.
Technical Skills
- Strong experience in data architecture and end-to-end data platform design.
- Expertise in Microsoft data technologies such as:
- Microsoft Fabric
- Azure Data Factory
- Azure Synapse Analytics
- Experience with other cloud platforms (AWS or Google Cloud) is a plus.
- Strong knowledge of data warehouses and data lakes, including:
- Azure Data Lake
- Delta Lake
- Amazon Redshift
- BigQuery
- Proficiency in:
- Python (Pandas, Boto3, and other data libraries)
- SQL
- Spark
- Experience with relational and NoSQL databases:
- Oracle
- SQL Server
- MongoDB
- Elasticsearch
- Hands-on experience with CI/CD, DevOps, and DataOps practices.
Posted Today