Design, develop, and optimize scalable batch and real-time data pipelines. Build ETL/ELT workflows using Scala, Apache Spark, Python, and SQL. Work with Azure/AWS cloud data services and ensure data quality.

About the Company
Technology Next is a growing technology solutions provider with a strong focus on data engineering, cloud migration, and advanced analytics. The company works with enterprises across multiple domains, delivering scalable data platforms that empower data-driven decision making. With a hybrid-first work culture and teams spread across India, Technology Next emphasizes collaboration, continuous learning, and engineering excellence.

Role Overview
We are looking for an experienced Data Engineer – Scala to design, develop, and optimize scalable data platforms and enterprise data pipelines. This is a contract-to-hire (C2C) position requiring 6+ years of experience. The role demands strong hands-on skills in Scala, Apache Spark, Python, and SQL, along with experience in Azure or AWS cloud data services. You will work in a hybrid setup (PAN India) with a shift from 11:00 AM to 9:00 PM. The ideal candidate has a deep understanding of data warehousing, big data technologies, and CI/CD practices, and is comfortable collaborating with cross-functional teams in an Agile environment.

Key Responsibilities

• Design, develop, and optimize scalable batch and real-time data pipelines.
• Build ETL/ELT workflows using Scala, Apache Spark, Python, and SQL.
• Develop high-performance SQL queries and data models.
• Work with Azure/AWS cloud data services (e.g., Azure Data Factory, AWS Glue).
• Build and maintain data ingestion and transformation pipelines.
• Monitor, troubleshoot, and optimize pipeline performance.
• Ensure data quality, reliability, and scalability.
• Collaborate with engineering, analytics, and business teams.
• Participate in code reviews, architecture discussions, Agile ceremonies, and CI/CD activities.

Tech Stack

• Languages & Frameworks: Scala, Apache Spark, Python, SQL
• Cloud Platforms: Microsoft Azure, Amazon Web Services (AWS)
• Data Services & Tools: Azure Data Factory, AWS Glue, Azure Synapse Analytics, Databricks, Delta Lake, Lakehouse
• Streaming & Messaging: Apache Kafka (good to have)
• Data Governance & Quality: Data governance and data quality tools (good to have)
• CI/CD & Agile: CI/CD pipelines, Agile methodologies
• Other: ML/GenAI data pipelines (good to have)

6+ years of Data Engineering experience. Strong hands-on experience with Scala and Apache Spark. Good experience with Python and advanced SQL. Experience with Azure and/or AWS. Strong ETL/ELT and data pipeline development experience. Experience with Azure Data Factory, AWS Glue, or similar tools. Strong understanding of Data Warehousing and Big Data technologies. Experience with CI/CD and Agile methodologies.

Contract-to-hire with competitive monthly pay; hybrid work arrangement; exposure to modern cloud and big data technologies; opportunities to work on enterprise-scale data platforms.