Data engineer (Azure)
Job Scope
• Design, review and development of Pyspark scripts. Testing, troubleshooting of data pipelines, orchestration.
• Designing and developing reports and dashboards in PowerBI,setting up access control with row level security DAX query experience.
• Establishing connections to source data systems such as on-prem databases, IOT devices, APIs.
• Managing the collected data in appropriate storage/data-base solutions e.g. file systems, SQL servers, Big Data platforms such as Hadoop, HANA, etc. as required by the specific project requirements.
• Design, development of relevant data pipelines using pyspark, copy data activities for batch ingestion.
• Performing data integration e.g. using database table joins, or other mechanisms at an appropriate level as required by the analysis requirements of the project.
• Deployment of pipeline artifacts from one environment to the other using Azure Devops.
Skills & Experience
• Bachelor’s Degree in Computer Science or Engineering with 2 years of experience in Azure Data engineering, Python, Pyspark or Big Data development.
• Sound Knowledge of Azure Synapse analytics for pipelines, orchestration, set up.
• 1-2 experience in Visualization design and development with Power BI. Knowledge on row-level security, access control.
• Sound experience in SQL, Datawarehouse, data marts, data ingestion with Pyspark and Python.
• Expertise in developing and maintaining ETL processing pipelines in cloud-based platforms such as AWS, Azure, etc. (Azure Synapse or data factory preferred)
• Team player with good interpersonal, communication, and problem-solving skills.
• Preferred to have Devops expertise.
Working hours :
8:30am to 6pm (Monday to Friday) onsite, no hybrid option.
Similar roles
Senior / Project Engineer (Based in Toa Payoh)
Sembcorp Industries Ltd·Singapore, Singapore
About Sembcorp Sembcorp is a leading energy and urban solutions provider headquartered in Singapore. Led by its purpose to drive energy transition , Sembcorp delivers sustainable energy solutions and urban developments by leveraging its sector expertise and global track record. About Sembcorp Sembcorp is a leading energy and urban solutions provider headquartered in Singapore. Led by its purpose to drive…
- Full-time
- SGD 720–SGD 1k / yr
- Employment Pass — tied to employer
Automation Manager (Industrial Robotic & Automation)
STAFFKING PTE. LTD.·Singapore, Singapore
Salary: Up to S$7,500 Working Hours: 5 Days Location: East Singapore Employment Type: Full-time About the Role We are looking for an experienced Manager – Robotics & Automation to lead automation and robotics initiatives within a technology-driven engineering and operations environment. The successful candidate will be responsible for identifying automation opportunities, developing and implementing robotic solutions, and driving continuous improvement…
- Full-time
- SGD 804–SGD 1k / yr
- Employment Pass — tied to employer
VP, Structured Receivables & Working Capital Finance
JPMorganChase·Singapore, Singapore
JPMorgan Chase is seeking a Transactor within its Trade & Working Capital team to design and manage structured receivables and inventory finance operations on a global scale. You will work with clients to understand objectives, identify opportunities and tailor structures, from bilateral to syndicated financing, enhancing their working capital flows while coordinating with cross-functional partners across risk, legal and operations.…
- Full-time
- SGD 1k–SGD 2k / yr
- Employment Pass — tied to employer
Business Intelligence Analyst
Signal·London, United Kingdom
About Signal Ocean: Signal Ocean is the technology arm of the Signal Group. Our primary product, The Signal Ocean Platform, helps shipping and commodities professionals navigate their complex decision making. Driven by advanced machine learning and artificial intelligence, our technology suite provides tailored, exclusive insights that support our clients in achieving performance and efficiency. By securely handling and combining private…
- Hybrid
- Full-time
Data Engineer - Full Stack (m/f/d)
Alcemy·Germany
Berlin Mitte · Hybrid (2 days/week remote) · €60,000–75,000 + VSOP equity Help us decarbonize cement and concrete - not tomorrow, today. alcemy is on a mission to keep 100 million tons of CO₂ out of the atmosphere every year by 2030. Making concrete accounts for around 8% of global CO₂ emissions, and our machine-learning software runs inside cement and…
- Hybrid
- Full-time
- Blue Card — tied; settle 21–33mo
Solutions Engineer
Johnson Controls·Singapore, Singapore
Who we are: Johnson Controls, a global leader in thermal management, mission-critical building systems, energy efficiency, and decarbonization, helps customers use energy more productively, reduce carbon emissions, and operate with the precision and resilience required in rapidly expanding industries such as data centers, healthcare, pharmaceuticals, advanced manufacturing, and higher education. For more than 140 years, Johnson Controls has delivered performance…
- Full-time
- Tech.Pass — self-sponsored, 2-yr
Senior Associate Data Scientist
ProArch·Bengaluru, India
About ProArch: At ProArch, we partner with businesses around the world to turn big ideas into better outcomes through IT services that span cybersecurity, cloud, data, AI, and app development. We’re 400+ team members strong across 3 countries (we call ourselves ProArchians)—and here’s what connects us all: * A love for solving real business problems * A belief in doing…
- Hybrid
- Full-time
Senior Associate Data Scientist
ProArch·Hyderabad, India
About ProArch: At ProArch, we partner with businesses around the world to turn big ideas into better outcomes through IT services that span cybersecurity, cloud, data, AI, and app development. We’re 400+ team members strong across 3 countries (we call ourselves ProArchians)—and here’s what connects us all: * A love for solving real business problems * A belief in doing…
- Hybrid
- Full-time
