Data Engineer Job in Bengaluru – 7.5+ Years Exp | Databricks, Terraform, CI/CD – Apply Now
Job Role: Data Engineer – Databricks Unified Data Analytics Platform
Location: Bengaluru, India
Experience Required: 5 to 10 years
Job ID: ATCI-4929577-S1868696
Employment Type: Full-time
Required Skill: Databricks Unified Data Analytics Platform
Overview
Are you a data engineering professional with a strong command over Databricks and cloud-based data solutions? Join one of the world’s leading professional services organizations as a Data Engineer – Data Science Analytics Associate Manager and work at the forefront of digital transformation. This is your opportunity to lead innovative data engineering initiatives and build scalable data solutions in a collaborative and forward-thinking environment.
This role is based in Bengaluru, where you will collaborate with global teams to design, implement, and optimize robust data architectures on cloud platforms, with a primary focus on the Databricks Unified Data Analytics Platform.
Key Responsibilities
As a Data Engineer, your core responsibility is to design, develop, and deploy data pipelines and infrastructure that support advanced analytics, business intelligence, and cloud-native applications. Your primary focus will be on the Databricks platform, though your work will extend across multiple technologies and environments.
Role-specific Deliverables:
-
Architect and develop ETL/ELT pipelines to collect, transform, and load data from disparate sources into cloud-based data lakes and warehouses.
-
Lead the implementation of Databricks workflows for distributed data processing, machine learning, and real-time analytics.
-
Ensure data quality, governance, and security standards are maintained across all data solutions.
-
Optimize data pipelines and automate deployment using CI/CD best practices and infrastructure-as-code tools like Terraform.
-
Integrate structured and unstructured data across multiple environments using containerization tools such as Docker and Kubernetes.
-
Collaborate with cross-functional teams including data scientists, product managers, and DevOps engineers to ensure data availability and performance.
-
Mentor junior data engineers and analysts to enhance their technical skills and contribute effectively to ongoing projects.
-
Offer practical support and serve as the go-to expert for all matters related to the Databricks platform, ensuring best practices and advanced solutions are consistently applied.
Technical Skills & Expertise
To succeed in this role, the following technical capabilities and professional attributes are essential:
Must-Have Technical Skills:
-
Expert-level proficiency in Databricks Unified Data Analytics Platform for building scalable and secure data solutions.
-
Cloud-native architecture expertise, with experience deploying applications across AWS, Azure, or GCP.
-
Infrastructure as Code (IaC): Strong hands-on experience with Terraform, ARM templates, or similar technologies for automated infrastructure provisioning.
-
Containerization Technologies: Familiarity with Docker, Kubernetes, and orchestration practices for deploying scalable data services.
-
CI/CD Pipeline Management: Proven experience in implementing continuous integration and deployment workflows, ideally using tools like Jenkins, GitLab CI, or Azure DevOps.
-
Programming & Scripting Languages: Proficiency in Python, SQL, and Spark for data engineering tasks.
Good to Have (Optional but Advantageous):
-
Familiarity with data orchestration frameworks like Apache Airflow.
-
Working knowledge of data lake architectures, Delta Lake, and real-time streaming using tools like Kafka or Spark Structured Streaming.
-
Experience with data visualization platforms (Power BI, Tableau) and exposure to machine learning workflows is an added advantage.
Leadership & Collaboration Responsibilities
This role is not just about technical execution—it’s also about leadership and communication. In the role of Associate Manager, your responsibilities will include:
Make strategic decisions for data engineering projects and guide your team toward achieving performance targets.
-
Collaborate with multiple internal stakeholders and external clients to translate business requirements into technical specifications.
-
Conduct code reviews, ensure adherence to best practices, and drive continuous improvement across the team.
-
Conduct regular team meetings to track progress against project goals and ensure timely communication of key updates to senior leadership.
-
Foster a culture of innovation, actively encouraging experimentation and adoption of modern data engineering tools and approaches.
Educational Requirements
To be eligible for this role, candidates must possess:
-
Minimum Educational Qualification: A full-time education spanning 15 years (10+2+3 or equivalent).
- A preferred qualification is a bachelor’s degree in Computer Science, Information Technology, Engineering, or a closely related discipline.
-
Certifications in Databricks, cloud platforms (Azure, AWS), or DevOps tools are a plus.
Why Join Us?
At our organization, we believe in enabling our talent to explore possibilities, upskill continuously, and contribute meaningfully to cutting-edge global projects. This Data Engineer role is ideal for individuals who:
-
Enjoy problem-solving at scale in a cloud-first environment.
-
Thrive in fast-paced, agile project settings.
-
Seek opportunities to work with global teams and deliver tangible business impact.
-
Are passionate about mentoring, collaboration, and technical excellence.
By joining us, you’ll gain exposure to some of the most innovative data ecosystems and work alongside seasoned professionals in a diverse, inclusive, and rewarding workplace.
Location and Work Mode
-
Primary Work Location: Bengaluru, India
-
While the role is Bengaluru-based, occasional travel or hybrid/remote collaboration may be required depending on project needs.
Application Process
If you possess the required qualifications and have a passion for turning data into actionable insights, we invite you to submit your application today.
Steps to Apply:
-
Click on the Apply for this Job button.
-
Create or sign in to your professional profile.
-
Upload your updated resume and supporting documents.
-
Candidates selected for further consideration will be notified regarding the next steps in the hiring process.
Job Reference Details
-
Job Title: Data Engineer – Data Science Analytics Associate Manager
-
Job Number: ATCI-4929577-S1868696
-
Employment Type: Full-time
-
Location: Bengaluru, India
-
Experience Level: 5–10 years (Minimum 7.5 years in Databricks platform required)
About the Company
We are a global technology consulting and digital transformation firm, delivering innovation-led solutions to businesses across multiple sectors. With a vast global network, we empower organizations to harness the power of data, AI, cloud, and intelligent platforms. Our commitment to sustainability, ethics, and digital responsibility makes us a preferred partner for clients worldwide.
Disclaimer and Equal Opportunity Statement
We are proud to be an Equal Opportunity Employer, committed to fostering an inclusive workplace culture. We do not discriminate based on race, religion, color, gender, sexual orientation, age, disability status, or any legally protected status.
Important Note: Please be cautious of fraudulent recruitment messages. We never request personal information or payment during the hiring process. All official communications will come from verified email addresses.
Stay Connected
Want to stay updated on new job openings and career opportunities?
Register for job alerts and be the first to know about roles tailored to your skill set.
Keywords (SEO Tags)
Databricks job in Bengaluru, Data Engineer with Databricks, Cloud Data Engineer, ETL Pipeline Developer, Data Engineering Manager, Databricks Unified Analytics, Terraform CI/CD jobs, Docker Kubernetes Data Engineer, Data Platform Associate Manager, Data Engineering career India, Full-time Cloud Engineer jobs Bengaluru, Python Spark Developer jobs, Big Data roles in Bengaluru, Cloud-based data jobs, DevOps Data Engineer roles India.