Azure Databricks Developers (Pyspark, Databricks)
TalentXO Verified employer
Actively hiring · Posted 23d ago · JEV261022AA5BFE53
Job description
Roles & ResponsibilitiesDesign, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integrationof enterprise-wide data from diverse sources• Build and optimize data engineering workflows using Databricks and PySpark• Write efficient, high-performance SQL for data transformation and analysis• Work with the Azure Cloud platform and associated services, applying strong understanding of data warehousing,data models, and pipelines• Provide technical leadership to a team of developers, including code reviews and enforcing best practices across thedevelopment lifecycle• Oversee CI/CD implementation using Azure DevOps, managing deployments across development, QA, and productionenvironments with proper change control processes• Collaborate with cross-functional teams to translate business requirements into scalable data solutions• Ensure data quality, reliability, and performance across all pipelines and platformsIdeal Candidate1Strong Azure Databricks Engineer / Senior Data Engineer Profile2Mandatory (Experience 1) – Must have minimum 8+ years of overall experience in Data Engineering, Data Development, or related data technology roles, with strong hands-on experience in enterprise data pipeline development.3Mandatory (Experience 2) – Must have strong hands-on experience with Azure Databricks, including development and optimization of scalable data engineering workflows using Databricks and PySpark.4Mandatory (Experience 3) – Must have strong hands-on proficiency in PySpark/Python and SQL, with proven experience developing complex data transformations, processing workflows, and performance-optimized queries.5Mandatory (Experience 4) – Must have hands-on experience with Azure Data Factory (ADF) for designing, developing, and orchestrating end-to-end data pipelines and integrating data from multiple sources.6Mandatory (Experience 5) – Must have strong experience working on the Azure Cloud platform and associated data services, with solid understanding of data warehousing, data modeling, pipeline architecture, and enterprise data solutions.7Mandatory (Experience 6) – Must have hands-on experience implementing CI/CD using Azure DevOps, including deployment and release management across development, QA, and production environments.8Mandatory (Experience 7) – Must have proven technical leadership experience, including code reviews, enforcing development best practices, mentoring developers, and providing technical guidance to a data engineering team.9Mandatory (Notice Period) – Immediate joiners or candidates who can join within 15 days.10Mandatory (Note) - The position is open across all Cognizant offices pan India. Candidates must be willing to attend the F2F interview at the nearest Cognizant office location.
Key skills
How to apply
- Sign in or create your free profile — takes about two minutes.
- Apply with one tap — your profile is shared directly with TalentXO.
- Track your application and get updates by email and WhatsApp.