Data Engineer

Start Date: ASAP
Contract Length: 6 months
Hours: 37 hours per week
IR35 Status: Outside IR35
Location: Edinburgh-based, hybrid working (primarily remote with occasional onsite activities).
Rate: 450 per day
Basic disclosure Scotland required at the cost of 25 if successful

Role Overview:

Our client is seeking an experienced Data Engineer to support the development of a Data Warehouse and associated data solutions. The role involves streamlining data processes, migrating workflows to AWS, and delivering resilient data integration and automation.

Key Responsibilities:

- Develop solutions for customer data products and reports.
- Migrate on-premise data processes to AWS cloud.
- Deliver and maintain robust data integration solutions.
- Enhance and support data outputs for internal and external users.
- Collaborate across teams to design scalable solutions.
- Ensure high-quality, maintainable, and secure software practices.

Essential Skills & Experience:

- Expertise in Python, PostgreSQL, REST APIs, SQL, and data transformation.
- Proficiency in CI/CD practices, including Docker, GitLab CI, and AWS tools.
- Experience with Agile delivery models and ETL/data streaming systems.

Desirable Skills:

- Familiarity with AWS Glue, Step Functions, S3, RDS, and PostGIS.
- Knowledge of data warehousing and hybrid on-prem/cloud solutions.
- Experience with monitoring tools like Grafana and test automation frameworks.

This is an excellent opportunity to contribute to a dynamic and collaborative environment, delivering impactful data engineering solutions.