Note: The job is a remote job and is open to candidates in USA. Red Ventures is a global portfolio of high-growth companies, and they are seeking a Senior Data Engineer to help build, maintain, and strengthen the data platform that powers analytics, reporting, and decision-making across their education platforms. The role involves owning and improving production data pipelines, developing analytics-ready data models, and partnering with various teams to deliver reliable, scalable data solutions.
Responsibilities
- Build, maintain, and optimize batch ETL/ELT pipelines in Databricks using Python and SQL
- Support day-to-day production pipeline operations, including monitoring, troubleshooting failures, managing backfills, and performance tuning
- Develop and maintain analytics-ready data models that support reporting, dashboards, and business insights
- Partner with analytics, BI, product, and business stakeholders to align data definitions and deliver scalable data solutions
- Integrate third-party data sources and APIs into the platform, ensuring clean ingestion, transformation, validation, and documentation
- Implement and maintain data quality checks, validation logic, observability practices, and operational documentation
- Support BI and reporting tools such as Tableau, Looker, or similar platforms by ensuring underlying data tables are performant, trusted, and well-modeled
- Help optimize Databricks workloads for reliability, scalability, performance, and cost efficiency
- Contribute to infrastructure-related work for data pipelines, including Terraform-managed resources and environment configuration
- Work with platform and security teams on Databricks governance, identity and access management, Unity Catalog registration, ownership, and permissions
- Participate in code reviews and contribute to engineering standards, CI/CD practices, and collaborative development workflows
- Support data migration and platform improvement efforts that move datasets and pipelines into production-grade environments
Skills
- 5+ years of professional data engineering experience designing, building, and operating production data solutions
- Hands-on experience with Databricks, Spark, and cloud-based data platforms, preferably AWS
- Strong SQL skills and proficiency in Python or Scala for building reliable, performant data pipelines
- Experience building and maintaining batch ETL/ELT pipelines in production environments
- Strong understanding of data modeling for analytics, including fact/dimension-style schemas and semantic-layer support
- Experience debugging, monitoring, backfilling, and tuning production data pipelines
- Working knowledge of infrastructure-as-code, particularly Terraform, as it applies to data platforms
- Familiarity with CI/CD, Git, GitHub, pull requests, code reviews, and collaborative engineering workflows
- Experience with Databricks Unity Catalog, including table registration, ownership, grants, and permission management
- Understanding of data governance, identity and access management, role-based access control, and service principals
- Ability to communicate clearly with technical and non-technical stakeholders
- Collaborative mindset and experience working across analytics, product, platform, and business teams
- Experience supporting BI and analytics platforms such as Tableau, Looker, or similar tools
- Familiarity with Delta Lake and governed lakehouse environments
- Exposure to dbt or other SQL-based transformation frameworks
- Experience integrating third-party data sources and external APIs into data platforms
- Experience with AWS services such as S3, EC2, Lambda, IAM, or related cloud infrastructure
- Background working with consumer-facing, content-driven, education, media, or digital platform data
- Experience supporting privacy-safe data sharing patterns, secure data exchange, or clean-room environments
Benefits
- Health Insurance Coverage (medical, dental, and vision)
- Life Insurance
- Short and Long-Term Disability Insurance
- Holiday Pay
- 401(k) with match
- Paid Parental Bonding Benefit Program
- Flexible Paid Time Off (PTO): We believe time to rest and recharge is essential. That’s why we offer a generous and flexible PTO policy. Full-time employees accrue 20 days of PTO for a full calendar year annually, with an increase to 25 days after five years of service.
Company Overview
Company H1B Sponsorship