Databricks Consultant

About the Role

We are looking for a senior Databricks Engineer to join a cross-functional team in Noida, Bangalore, Kochi, Pune, or Mumbai. The role focuses on designing and delivering dependable data platforms, pipelines, and curated datasets that support business reporting, analytics, and operational decision-making.

You will build scalable batch and, where needed, near real-time ingestion and transformation workflows, shape standardized data models, and help create a consolidated view of customers and advisers. A major part of the role is to work closely with business and technology teams to ensure strong data quality, governance, security, and delivery aligned with enterprise standards.

Key Responsibilities

• Design, develop, and tune data solutions and curated datasets that support use cases such as distribution finance, commissions, adviser performance, customer insight, and management reporting, while keeping reliability, scalability, and cost efficiency in mind.
• Monitor, troubleshoot, and improve production data pipelines so they continue to meet agreed service levels, including incident handling, root-cause analysis, and ongoing enhancements.
• Handle recurring reports and ad hoc data extraction requests accurately and quickly, while encouraging reusable datasets, self-service access patterns, and proper controls for sensitive financial and customer information.
• Create and deliver solutions in line with SDLC practices, architectural guidelines, and security policies, along with supporting documents such as technical specifications, data models, data dictionaries, interface and mapping documents, and test plans.
• Apply data governance practices by implementing quality checks, reconciliation where needed, access controls, and clear lineage and documentation.
• Coordinate with business and technology stakeholders to communicate risks, dependencies, timelines, queries, and issues through to closure.
• Work with agile delivery teams, data analysts, and upstream system owners to source, integrate, model, test, release, and support data solutions after production go-live.

Requirements

• 5 to 8 years of experience delivering enterprise data engineering solutions in cloud and big data environments, including production support and stakeholder-facing delivery.
• Strong hands-on experience with ETL/ELT pipeline development, data modelling using dimensional and normalized approaches, and performance tuning for analytics workloads.
• Practical exposure to Azure data platform tools such as Synapse, ADLS, Data Factory, and Databricks.
• Working knowledge of governance and catalog tools such as Unity Catalog, along with RBAC-based access control.
• Proficiency in PySpark, Python, and SQL; Scala knowledge is considered an added advantage.
• Experience with data testing and data quality validation methods.
• Comfort using engineering collaboration and delivery tools such as Git/GitHub, CI/CD pipelines, JIRA, and Confluence.
• Understanding of DevOps practices, including version control, build and release automation, and monitoring.
• Experience in insurance data domains is preferred.
• Exposure to finance advisory or distribution finance areas such as commissions, adviser hierarchy, campaigns, remuneration, and persistency will be beneficial.
• Certifications in data and analytics are an advantage.
• Must have a bachelor’s or master’s degree in STEM.
• Strong written and spoken English communication skills are required.

Additional Information

This position is based in India and may be located in Noida, Bangalore, Kochi, Pune, or Mumbai.

The role involves close partnership with enterprise stakeholders and requires a person who can work independently, collaborate well in teams, and adapt to a fast-changing environment.

Relevant strengths for success in this role include problem-solving, clear communication, customer focus, cultural awareness, and familiarity with modern technology trends.

About the Company

Tenarai Technologies Private Limited is an enterprise AI acceleration company headquartered in Silicon Valley. The organization helps Fortune 500 leaders across technology, retail/CPG, travel, insurance, healthcare, and telecom convert AI potential into real business outcomes. Its approach combines strong engineering capability, domain knowledge, and customer context to deliver solutions that create competitive advantage and support growth.