Redient Security logo

Senior Data Engineer

Redient Security
11 hours ago
Full-time
On-site
Chennai, Tamil Nadu, India

🚀 Job Title: Senior Data Engineer
📍 Location: Chennai / Bangalore / Hyderabad
💼 Experience: 8+ Years
🏢 Employment Type: Full-Time, Permanent
🕒 Work Mode: 5 Days WFO

✨ Job Overview:
We are looking for an experienced Senior Data Engineer with strong expertise in Azure Data Engineering technologies, Databricks, and modern data pipeline architectures. The ideal candidate should have hands-on experience in building scalable ETL/ELT workflows, optimizing large-scale data platforms, and working with structured as well as unstructured data.

🎯 Key Responsibilities:
• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows
• Build and optimize data processing solutions using Azure Data Engineering services
• Work extensively on Azure Databricks, Spark, and PySpark-based data processing
• Implement and manage Lakeflow Declarative Pipelines
• Develop and optimize SQL queries and data transformation processes
• Handle large-scale structured and unstructured datasets
• Monitor, troubleshoot, and optimize data pipeline performance
• Ensure data quality, governance, and security best practices
• Collaborate with business, analytics, and engineering teams to deliver data solutions
• Participate in code reviews, testing, deployment, and performance tuning

✅ Must-Have Skills:
• Azure Data Engineering
• Azure Databricks
• Lakeflow Declarative Pipelines
• PySpark / Spark
• ETL / ELT Development
• SQL & Data Modeling
• Azure Data Factory (ADF)
• Data Warehousing Concepts
• Performance Optimization
• Large-scale Data Processing

🎓 Required Experience:
• Overall 8+ years of software/data engineering experience
• 7+ years of relevant experience in Data Engineering
• Strong hands-on experience with Azure Data Engineering services
• 4+ years of experience in Databricks and Lakeflow Declarative Pipelines

⭐ Preferred Skills:
• Azure Synapse Analytics
• Azure Data Lake
• CI/CD & Git
• Python Programming
• Data Governance & Data Quality
• Experience with large-scale cloud data platforms

⚠ Additional Guidelines:
• Preferred Notice Period: 30 Days or Serving Notice Period only
• Please avoid immediate joiners (10–15 Days NP)
• Expected processing timeline: 10–15 days
• Minimum 2 years stability in each organization preferred
• Candidate should be comfortable with coding assessments/interview rounds
• This is an Individual Contributor (IC) role