Data Engineer

Responsibilities

• Participate in cross-functional meetings to define project objectives and scope
• Analyze and prioritize business requirements related to data
• Design and develop data extraction, transformation, and loading pipelines (ETL/ELT)
• Develop applications for extracting data from various sources and formats (JSON, XML, PDF, etc.)
• Write clean, efficient, and scalable code, adapting to new technologies as needed
• Implement data quality methodologies throughout ingestion and transformation processes
• Optimize services, queries, and processes to reduce operational costs and improve performance
• Validate the functionality, integrity, and security of data engineering processes

Requirements

Bachelor's degree in Computer Systems Engineering, Computer Science, or related field.

Specialization in Data Engineering (preferred).

5 to 8 years of experience in similar roles.

Intermediate-Advanced English proficiency.

Technical Skills

• Programming languages: Java, Scala, Python, and SQL
• Experience with data processing frameworks (Spark, Flink, etc.)
• Experience with SQL and NoSQL databases (PostgreSQL, Cassandra, MongoDB, etc.)
• Experience with orchestration and ETL tools (Airflow, Airbyte, Stitch, etc.)
• Experience implementing data quality methodologies throughout ingestion and transformation processes
• Design and architecture of Data Lakes, Data Warehouses, and Lakehouse solutions
• Data modeling (star schema, snowflake schema, OBT)
• Development and consumption of REST APIs
• Experience with Git

Nice to Have

• Experience with web scraping projects
• Knowledge of additional languages such as Go or JavaScript
• Experience with streaming and messaging systems (Kafka, RabbitMQ)
• Background in data science projects