This is a 12 - month contract with our client in the banking sector.
We are looking for a detail-oriented Data Engineer to join our client's team in driving the bank toward a data-driven future. You will play a pivotal role in maintaining robust data pipelines, enhancing our cloud infrastructure, and providing the clean, reliable data necessary for advanced analytics, machine learning, and AI initiatives.
Core Responsibilities
- Pipeline Management: Build and maintain end-to-end data pipelines, including Data Virtualization, Ingestion, Provisioning, Streaming, and APIs.
- Operational Excellence: Perform daily monitoring of data warehouses and cloud services (Compute/Storage) to ensure all jobs run successfully and meet SLA timelines.
- Infrastructure Support: Secure and maintain the data infrastructure to ensure high availability and reliability for stakeholders.
- Data Quality & Analysis: Execute data profiling, cleaning, validation, and documentation in collaboration with Data Analysts to deliver "fit-for-purpose" data products.
- Business Enablement: Create virtual databases and data extracts to support business needs; optimize and improve business queries through active stakeholder collaboration.
- Technical Support: Act as first-line support for pipeline issues, resolving blockers to ensure continuous data availability.
Minimum Requirements
- Education: A Bachelor's Degree in Information Technology, Computer Science, Data Science, or a related field.
- Technical Skills: * Proven experience in building and monitoring Data Pipelines (Ingestion and Provisioning).
- Familiarity with Cloud Infrastructure management and monitoring.
- Proficiency in Big Data solutions, API integration, and data streaming.
- Strong knowledge of SQL, data profiling, and data virtualization tools.
- Soft Skills: Collaborative mindset with the ability to translate complex business needs into technical data solutions.
- Advantageous: Experience in a banking or highly regulated environment; knowledge of AI/ML data preparation.
Originally posted on