ETL Developer
Elysium Digital
Job Description
We are seeking an ETL Integration Developer to join our team for a short term contract engagement (6-8 weeks initially with potential extensions) to support the modernisation of a business-critical Salesforce-based platform that manages customer records and facilitates integration with external service providers.
The successful person will be responsible for analysing existing integration processes, designing and implementing a replacement ETL solution, and ensuring the secure and reliable movement of data between Salesforce, Azure-based services, databases and third-party systems.
Key Responsibilities
Discovery and Analysis
- Review and document existing ETL processes, workflows and integration architecture.
- Analyse current data movements between Salesforce, databases, Azure services and external vendors.
- Assess dependencies, risks and technical constraints associated with legacy integration components.
- Develop data flow diagrams, mappings and transformation specifications.
Solution Design
- Design a scalable replacement ETL/integration architecture within Microsoft Azure.
- Define integration patterns, security requirements, error handling and monitoring processes.
- Produce detailed technical design documentation and implementation specifications.
- Recommend appropriate Azure integration services and data management approaches.
Development
- Build and configure ETL and data integration solutions using Azure services.
- Develop data extraction, transformation and loading processes.
- Create APIs, connectors and integration components where required.
- Develop SQL objects including:
- Stored procedures
- Views
- Functions
- Indexes
- Implement data cleansing, enrichment and transformation logic.
Testing and Quality Assurance
- Create and execute unit tests.
- Develop automated testing processes and validation scripts.
- Verify data accuracy, completeness and reconciliation between systems.
- Conduct performance testing and optimisation activities.
- Support defect identification, troubleshooting and resolution.
DevOps and Deployment
- Implement CI/CD pipelines and deployment automation.
- Support deployment planning, release execution and rollback procedures.
- Produce technical documentation and deployment artefacts.
Key Selection Criteria
- Experience designing and developing ETL solutions.
- Demonstrated experience delivering enterprise integration projects.
- Experience working in Agile delivery environments.
- Strong stakeholder engagement and technical communication skills.
Technical Skills Required
- ETL Development
- Data Analysis
- Data Quality Management
- Azure Analysis Services / Power BI Semantic Models
- Data Security
- Salesforce Integration, Salesforce APIs, integrations and middleware solutions