AWS Glue Python Developer
We are seeking an experienced AWS Glue Python Developer to design, develop, and support scalable cloud-based inbound and outbound file based data integration and processing solutions. The ideal candidate will have strong expertise in Python, AWS Glue, PySpark, and serverless AWS services.
The candidate will work with business and technical teams to develop reliable data processing workflows using services such as Amazon S3, EventBridge, Lambda, SNS, SQS, CloudWatch, IAM, and AWS Step Functions or Glue Workflows.
Key Responsibilities
Design and develop inbound and outbound file processing using AWS Glue, Python, and PySpark.
Develop reusable Python modules, utilities, and frameworks for data ingestion, validation, transformation, and error handling.
Build batch inbound and outbound file processing using Amazon S3 and AWS Glue.
Configure Amazon EventBridge rules for scheduling and event-based processing.
Develop AWS Lambda functions for lightweight processing, automation, validation, and integration activities.
Implement messaging and notification solutions using Amazon SNS and Amazon SQS.
Configure Amazon CloudWatch logs, metrics, dashboards, and alarms for operational monitoring.
Develop workflows using AWS Glue Workflows, AWS Step Functions, or equivalent orchestration services.
Integrate AWS services with relational databases, APIs, file systems, and external applications.
Implement data ingestion from CSV, XML, JSON, Excel, fixed-length, variable-length, and delimited files.
Develop data validation, reconciliation, audit, retry, and exception-handling processes.
Optimize AWS Glue jobs for performance, scalability, and cost efficiency.
Implement secure access using AWS IAM roles, policies, encryption, and secrets management.
Support production deployments, incident resolution, root-cause analysis, and performance tuning.
Collaborate with DevOps teams to implement CI/CD pipelines for AWS Glue jobs and related infrastructure.
Prepare technical documentation, data flow diagrams, operational procedures, and support documentation.
8+ years of experience in Python development and data engineering.
Strong hands-on experience with AWS Glue and PySpark.
Excellent knowledge of Python programming, object-oriented programming, and exception handling.
Experience designing ETL pipelines and data processing frameworks.
Strong experience with Amazon S3, including bucket structures, lifecycle policies, partitioning, and file formats.
Experience with Amazon EventBridge for scheduled and event-driven execution.
Experience developing and deploying AWS Lambda functions using Python.
Experience with Amazon SNS and SQS for notifications, messaging, and asynchronous processing.
Experience with Amazon CloudWatch for logging, monitoring, alerting, and troubleshooting.
Understanding of AWS IAM, security policies, encryption, and least-privilege access.
Experience working with relational databases such as Oracle, PostgreSQL, MySQL, or Amazon RDS.
Strong knowledge of SQL and database connectivity from Python or AWS Glue.
Experience working with REST/SOAP APIs and external system integrations.
Understanding of JSON, XML, CSV, Excel, and fixed-width file formats.
Experience with Git and software development best practices.
Preferred Skills
Experience with AWS Step Functions or AWS Glue Workflows.
Experience with CI/CD tools such as Jenkins, GitHub Actions, GitLab, or AWS CodePipeline.
Knowledge of data quality, reconciliation, lineage, and audit requirements.
Similar roles
Customer Support Executive
TrueGether·Jaipur, India
About TrueGether: TrueGether is a US-based, zero-fee e-commerce marketplace helping small businesses and individual sellers reach customers without the heavy costs of traditional platforms. As we continue to grow, we’re looking for a Customer Support Executive who can help us provide a smooth and reliable experience for both buyers and sellers. About the Role: We are looking for a Customer…
- Full-time
Software Engineer, Backend (BI Platform)
Wolt - English·London, United Kingdom
ABOUT WOLT At Wolt, we create technology that brings joy, simplicity and earnings to the neighborhoods of the world. In 2014 we started with delivery of restaurant food. Now we're building the delivery of (almost) everything and you'll find us in over 500 cities in 30 countries around the world. In 2022 we joined forces with DoorDash and together we…
- On-site
- Full-time
Senior Java Developer - E-Commerce + Accounting & Marketplaces - remote in EU
pathway solutions gmbh·Hamburg, Germany
At pathway Solutions GmbH, we're on a mission to automate accounting for E-Commerce and SaaS companies. Our goal is to free 10,000 entrepreneurs from the burden of manual bookkeeping so they can focus on what they do best: growing their business. We are a fast-paced, fully remote company experiencing significant customer growth, and we're looking for passionate builders to join…
- Remote
- Full-time
- Blue Card — tied; settle 21–33mo
Backend Engineer (Golang) - Transfers EU
SumUp·Berlin, Germany
At SumUp, we empower small businesses with simple, affordable tools to start, run, and grow. Our Global Bank teams build the financial services that help merchants manage their money and keep their businesses moving. For merchants, a transfer should feel simple. Behind that experience is a complex network of payment schemes, banks, providers, messages, certificates, reconciliations, and edge cases—all of…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Cloud Infrastructure & Platform Specialist (Databricks + AWS + Azure) (Mid-Level
Irth Solutions·India
About Irth Solutions Irth Solutions is a leading provider of cloud-based SaaS software for damage prevention, asset integrity, stakeholder engagement and land management, helping energy, utility, telecom, and infrastructure companies protect their critical network infrastructure. With nearly three decades of industry experience, Irth serves customers across North America and continues to expand its platform with new data-driven and AI-powered capabilities.…
- Remote
- Full-time
Graduate Software Engineer - Assessment Day 17th September
OpenWorks Engineering·Prudhoe, United Kingdom
The Opportunity We’re looking for ambitious Graduate Software Engineers to join us and help design technology that protects people and critical infrastructure around the world. We have two slots available for our assessment day which is happening on Thrusday 17th September. From day one, you’ll be learning on the job, hands-on with engineering challenges and contributing to live projects in…
- Full-time
AWS Glue Python Developer
ProArch·Bengaluru, India
We are seeking an experienced AWS Glue Python Developer to design, develop, and support scalable cloud-based inbound and outbound file based data integration and processing solutions. The ideal candidate will have strong expertise in Python, AWS Glue, PySpark, and serverless AWS services. The candidate will work with business and technical teams to develop reliable data processing workflows using services such…
- Contract
Data Engineer (Mid Level)-Orbit
Irth Solutions·India
About Irth Solutions Irth Solutions is a leading provider of cloud-based SaaS software for damage prevention, asset integrity, stakeholder engagement and land management, helping energy, utility, telecom, and infrastructure companies protect their critical network infrastructure. With nearly three decades of industry experience, Irth serves customers across North America and continues to expand its platform with new data-driven and AI-powered capabilities.…
- Remote
- Full-time
