Note: The job is a remote job and is open to candidates in USA. The Brixton Group is seeking an experienced Senior Data Engineer to design, build, and optimize scalable data platforms that support enterprise analytics and data-driven decision-making. This role involves developing modern batch and real-time data processing solutions, cloud-based data infrastructure, and high-performance data pipelines.
Responsibilities
- Design, develop, and maintain scalable batch and real-time data processing pipelines
- Build high-performance, fault-tolerant data processing systems using technologies such as Apache Spark, Apache Flink, Apache Druid, or similar frameworks
- Develop and optimize Extract, Transform, Load (ETL) pipelines and data models supporting analytics and reporting
- Write and optimize complex SQL queries for large-scale data analysis
- Build and maintain cloud-based data warehousing and data infrastructure solutions
- Collaborate with cross-functional teams to integrate data from multiple sources while ensuring data quality, consistency, and reliability
- Monitor, troubleshoot, and optimize pipeline performance, scalability, and operational efficiency
- Evaluate and implement modern data engineering best practices and emerging technologies
Skills
- 10+ years of Data Engineering experience
- Strong expertise in Apache Spark and Python
- Experience building scalable ETL pipelines and distributed data processing systems
Company Overview