Senior Data Engineer with Python (IR-491)
Intellectsoft is a software development company delivering innovative solutions since 2007. We operate across North America, Latin America, the Nordic region, the UK, and Europe. We specialize in industries like Fintech, Healthcare, EdTech, Construction, Hospitality, and more, partnering with startups, mid-sized businesses, and Fortune 500 companies to drive innovation and scalability. Our clients include Jaguar Motors, Universal Pictures, Harley-Davidson, and many more where our teams are making daily impactTogether, our team delivers solutions that make a difference. Learn more at www.intellectsoft.net
Our customer's product is an AI-powered platform that helps businesses make better decisions and work more efficiently. It uses advanced analytics and machine learning to analyze large amounts of data and provide useful insights and predictions. The platform is widely used in various industries, including healthcare, to optimize processes, improve customer experiences, and support innovation. It integrates easily with existing systems, making it easier for teams to make quick, data-driven decisions to deliver cutting-edge solutions.
- 5–6+ years of hands-on experience in Data Engineering.
- Strong proficiency in Python and advanced SQL, including query optimization, data modeling, and performance tuning.
- Deep understanding of distributed data processing frameworks, particularly Apache Spark.
- Strong practical experience with Apache Airflow for workflow orchestration and pipeline management.
- Working knowledge of backend application development frameworks such as FastAPI.
- Foundational understanding of LLMs, AI/GenAI concepts, and their practical applications within data platforms.
- Familiarity with modern AI and data infrastructure concepts, including:
- Vector Databases
- Semantic Search
- Knowledge Graphs
- Retrieval-Augmented Generation (RAG) architectures (preferred)
- Hands-on experience with at least one major cloud platform: AWS, Azure, or GCP.
- Hands-on experience with Git and CI/CD pipelines.
Responsibilities
- Design and build highly reliable and scalable data pipelines using PySpark and big data technologies.
- Collaborate with the data science team to develop new features that enhance model accuracy and performance.
- Create standardized data models to improve consistency across various deployments.
- Troubleshoot and resolve issues in existing ETL pipelines and optimize workflows.
- Conduct POCs to evaluate new technologies and integrate additional data sources.
- Follow and promote best practices for software development, ensuring high-quality solutions that meet requirements and deadlines.
- Document development updates and maintain clear technical documentation.
- Employment-based cooperation
- Comprehensive insurance for you and your family (health, life, and accident)
- Paid PTO policy (vacation, sick leaves, and public holidays)
- Tech equipment provided
- Udemy courses, workshops, trainings & expert knowledge-sharing
- Flexible hours & work setup
Similar roles
Deep Learning Solution Architect - RL and Post-training
Nvidia·Beijing, China
NVIDIA is leading company of AI computing. At NVIDIA, our employees are passionate about AI, HPC , VISUAL, GAMING. Our SA team is more focusing to bring NVIDIA new technology into difference industries. We help to design the architecture of AI computing platform, analysis the AI and HPC applications to deliver our value to customers. You will work closely with…
- Full-time
Data Engineer
1Global·Berlin, Germany
About Us 1GLOBAL is a technology-driven global mobile communications provider, delivering global connectivity solutions to enterprises and consumers. Powered by a best-in-class telecom platform with its own owned and operated global mobile core network in 15 countries, fully fledged in-house developed eSIM technology, and an extensive portfolio of telecom licenses; 1GLOBAL operates as a fully regulated telecommunications provider across 43…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Lead Data Architect
LOGEX·Hamburg, Germany
Our mission At LOGEX, we turn data into better healthcare. As we continue to scale our healthcare intelligence platform across Europe, we're investing in a modern, unified data foundation that supports analytics, AI, and data-driven decision-making across our products and services. You will define the future-state architecture that enables this vision. You will establish the standards, models, and principles that…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Senior Data Engineer, Constellation Services
planetlabs·Berlin, Germany
<div class="content-intro"><p><strong>Welcome to Planet. We believe in using space to help life on Earth.</strong></p> <p>Planet designs, builds, and operates the largest constellation of imaging satellites in history. This constellation delivers an unprecedented dataset of empirical information via a revolutionary cloud-based platform to authoritative figures in commercial, environmental, and humanitarian sectors. We are both a space company and data company all…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Sales Operations & Analytics Manager (m/w/d)
everdrop GmbH·Germany
DAS IST DER JOB everdrop entwickelt sich von einer Digital-Native-Marke zu einer festen Größe im stationären Handel und gestaltet so die Zukunft der Reinigungsmittelbranche aktiv mit. Als Sales Operations & Analytics Manager (m/w/d) verantwortest Du das operative Rückgrat unseres B2B-Vertriebs: Du steuerst die Daten, Systeme und Prozesse, auf die sich unser Sales-Team täglich verlässt. Wir suchen ein Profil mit fundierter…
- On-site
- Full-time
- Blue Card — tied; settle 21–33mo
Data Operations Associate
Gigmo Solutions·Gurugram, India
About us: Gigmo Solutions Pvt. Ltd is a fast-growing organization with global experience, having presence in several countries in the Americas, Europe, Africa, and Asia. Expertise in Spanish, Portuguese, French, Italian, German, and global English. Gigmos aims to transform customer support domain by leveraging curated Gig workforce across the globe and using cutting edge AI technologies for increased support efficiency…
- Full-time
Director of Sales and Marketing (Hotel Background )
Monsoon Empress·Kochi, India
Company Description Monsoon Empress is a luxury 5-star boutique hotel situated on the NH Bypass in the heart of Kochi, offering convenient access to major tourist attractions, shopping malls, and business hubs. The hotel features well-appointed rooms and suites, diverse dining options, and versatile banqueting facilities suited for both corporate and social events. As a trend setter in Kochi’s hospitality…
- Full-time
Application for Visiting Faculty for Physics in Optometry Department
Bhawanipur Global Campus·Kolkata, India
No. of Position 1 Designation Visiting Faculty Educational Qualifications Master’s degree in Physics / Applied Physics / Optics or a closely related discipline from a recognized university/institution. Demonstrated knowledge of Geometrical Optics and Physical Optics . Ability to teach Physics and Optics at undergraduate Optometry level. Desirable Ph.D. in Physics, Applied Physics, Optics, Photonics, Biomedical Optics or a related discipline.…
- Full-time
