Seeking a skilled Data Engineer with strong ETL/ELT expertise, particularly in Azure Databricks and Snowflake, to develop and manage data pipelines for advanced analytics.

About the Company

Delphic Global is a forward-thinking organization focused on leveraging technology to drive innovative solutions in data analytics and engineering. With a strong emphasis on cloud solutions and modern data practices, the company is well positioned to impact various sectors through its advanced data capabilities.

Role Overview

We are seeking a highly skilled Data Engineer with substantial expertise in ETL/ELT development, especially with cloud-based data platforms. The ideal candidate will be well-versed in Azure Databricks, Snowflake, and a variety of data processing technologies. This role involves extensive collaboration with cross-functional teams to ensure data governance, quality, and operational excellence across our data platforms.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines for enterprise data platforms.
• Build and optimize data processing solutions using Python, PySpark, and Spark SQL.
• Develop and manage data solutions on Azure Databricks and Snowflake.
• Implement and maintain Unity Catalog-based governance and security frameworks.
• Create serverless integrations and event-driven workflows using Azure Functions and Azure Service Bus.
• Develop efficient SQL queries, data models, and performance optimization strategies.
• Automate infrastructure deployment and management using Terraform.
• Implement CI/CD pipelines and DevOps best practices using GitHub Actions, Git, Artifactory, and SonarQube.
• Collaborate with data architects, business analysts, and cross-functional teams to deliver data-driven solutions.
• Support AI/ML initiatives by preparing and engineering datasets for predictive analytics and LLM-based applications.
• Ensure data quality, security, governance, and operational excellence across data platforms.

Tech Stack

• Python
• Apache Spark (PySpark, Spark SQL)
• Azure Databricks
• Snowflake
• Azure Functions
• Azure Service Bus
• SQL
• Terraform
• GitHub Actions
• Git
• Artifactory
• SonarQube
• AI/ML and Large Language Models (LLM)

Required Skills

• Data Engineering and ETL/ELT Processes
• Python
• Apache Spark (PySpark, Spark SQL)
• Azure Databricks (Unity Catalog)
• Snowflake
• Azure Functions
• Azure Service Bus
• SQL
• Terraform
• CI/CD Tools and Processes
• GitHub Actions
• Git
• Artifactory
• SonarQube
• AI/ML and Large Language Models (LLM)

Required Qualifications

• Bachelor's or Master's degree in Computer Science, IT, Engineering, or a related field.
• 7–8 years of hands-on experience in Data Engineering and ETL/ELT development.
• Strong expertise in Python, Spark, and SQL.
• Experience working with Azure Databricks and Snowflake in enterprise environments.
• Hands-on experience with Terraform and Infrastructure as Code (IaC).
• Strong understanding of DevOps and CI/CD methodologies.
• Experience with cloud-native services and distributed data processing systems.
• Excellent analytical, troubleshooting, and communication skills.

Preferred Qualifications

• Experience with AI/ML model deployment and MLOps practices.
• Exposure to Generative AI and LLM implementations.
• Knowledge of data governance, data security, and metadata management.
• Azure or Snowflake certifications are a plus.

• Competitive salary
• Hybrid work model (Pan India)
• Opportunity to work with advanced technologies
• Professional development and growth opportunities
• Supportive team environment
• Flexible work hours (11:00 AM – 9:00 PM IST)