Senior Data Engineer - AdTech
We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.
The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.
You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
- Build and optimize distributed data applications using Apache Spark and Python Scala.
- Develop reliable, high-performance data pipelines for batch and streaming workloads.
- Design and manage data workflows using Apache Airflow.
- Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
- Work with large datasets to ensure data quality, consistency, reliability, and performance.
- Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
- Optimize data workflows for scalability, reliability, performance, and cost efficiency.
- Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.
Candidates who demonstrate:
- 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
- Strong hands-on experience with Apache Spark and Scala.
- Experience designing, building, and maintaining large-scale ETL pipelines.
- Strong hands-on experience with AWS, particularly Amazon S3.
- Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
- Strong SQL skills and a solid understanding of distributed data processing concepts.
- Experience working with batch and/or streaming data pipelines.
- Excellent debugging, problem-solving, and performance optimization skills.
- Strong communication and collaboration skills.
Good to Have
Experience with Databricks and the broader Databricks data platform.
Familiarity with streaming technologies such as Apache Kafka.
Experience working on large-scale data platforms handling high-volume data workloads.
Exposure to additional AWS data services and cloud-native data architectures.
- Best-in-class salary: We hire strong talent and compensate accordingly.
- Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
- Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
- High-impact work: Build AI-first systems and products used at scale by global clients.
About Us
Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world. We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore.
Since 2019, Proximity has built high-impact, scalable products used by millions of users every day. Today, we are a global team of engineers, designers, product managers, and experts solving complex problems and building cutting-edge technology at scale.
Similar roles
Associate Advisory Account Manager
Freshworks·Chennai, India
About the Role The Advisory Account Manager (AAM) is a dual-mandate, portfolio-owning role. Unlike a traditional CSM or a pure hunter-AM, the AAM operates as a trusted advisor across the full customer lifecycle — responsible simultaneously for protecting Gross Revenue Retention (GRR) and driving Net Expansion through upsell and cross-sell. This is a digital-first, high-velocity motion that blends proactive advisory…
- On-site
- Full-time
Senior Manager - Business Development, Renewable Energy (Maharashtra)
Enfinity Global·Mumbai, India
About Enfinity Global Enfinity Global is a purpose-driven company focused on making a positive impact on the planet by helping companies, governments, and individuals transition to a carbon-free and sustainable economy. Our role as a leading IPP is to develop, finance, build, operate, and own renewable energy assets in the long term in Europe, Asia, and the Americas through our…
- Full-time
Business Manager (Accounting)
Docyt·Jaipur, India
Work involves working on our proprietary docyt software and online accounting software. The candidate will serve as an account manager for account bookkeeping of businesses for our US-based clients. The ideal candidate should have knowledge of preparing balance sheets, P&L statements, income & expenditure statements in addition to being able to verify and reconcile journal entries in a chart of…
- Full-time
Process Automation Specialist (m/w/x)
Thorlabs·Bergkirchen, Germany
As a Process Automation Specialist (m/w/x) at Thorlabs, you will be responsible for identifying, designing, implementing, and optimizing automation solutions that improve operational efficiency, reduce manual effort, and support business growth. You will collaborate with cross-functional teams to analyze business processes, develop scalable automation workflows, and continuously enhance existing solutions while ensuring compliance and security standards. This position is limited…
- Full-time
- Blue Card — tied; settle 21–33mo
HR Business Partner (India)
Teleport·Gurugram, India
ABOUT US As Southeast Asia’s #1 integrated logistics provider, Teleport is all about making logistics fast, affordable and reliable. Our mission? To move things across Southeast Asia better than anyone else. We’re focused on making next-day delivery a reality for all. #TeamTeleport is guided by our values: Move with urgency — because time is crucial; Aim to pioneer — constantly…
- Full-time
Senior Product Manager - SyncOS
Botsync·Bengaluru, India
Asia's leading robotics solutions provider, automating enterprise supply chains since 2017. We build syncOS — the industry-first no-code platform that lets manufacturers and warehouse operators integrate, reprogram, and scale automation systems without halting production or calling in specialists. Our autonomous mobile robots (AMRs) run 24/7 for global brands — transforming production lines in hours, not weeks. Our product stack spans…
- Full-time
Senior Product Manager - AMR
Botsync·Bengaluru, India
Asia’s leading robotics solutions provider, automating enterprise supply chains since 2017. We build syncOS — the industry-first no-code platform that lets manufacturers and warehouse operators integrate, reprogram, and scale automation systems without halting production or calling in specialists. Our autonomous mobile robots (AMRs) run 24/7 for global brands — transforming production lines in hours, not weeks. Our product stack spans…
- Full-time
HR Business Partner
2070Health·Mumbai, India
About the Role We are seeking a dynamic Recruiter to manage end-to-end hiring for clinical and non-clinical roles within our hospital network. The ideal candidate will have experience in healthcare recruitment and a strong ability to source, screen, and onboard quality talent efficiently. KEY RESPONSIBILITIES * Manage full-cycle recruitment: sourcing, screening, interviewing, and offer management * Source candidates for clinical…
- Full-time
