Lead Data Engineer
Chennai, Tamil Nadu, India
- Experience
- 7–15 years
- Employment
- Full-time
- Work mode
- Hybrid
- Salary
- ₹18 L–27 L / year
- Deadline
- Apply by 1 Nov 2026
- Posted
- 2026-06-29
Required skills
| Skill | Experience | Level |
|---|---|---|
| SQL | 5+ years | Not specified |
| GIT | 5+ years | Not specified |
| Agile Methodology | 3+ years | Not specified |
| Data Modeling | 5+ years | Not specified |
| CI/CD | 5+ years | Not specified |
| ETL(Extract, Transform, Load) | 3+ years | Not specified |
| Software Debugging | 5+ years | Not specified |
| BigQuery | 5+ years | Not specified |
| Stream Processing | 3+ years | Not specified |
| Google Dataflow | 7+ years | Not specified |
| Apache Beam | 6+ years | Not specified |
| Java | 1+ years | Not specified |
| Google Cloud Platform (GCP) | 6+ years | Not specified |
About the role
Job Title: Lead Data Engineer – GCP | Dataflow | Java | BigQuery
Experience: 7+Years
Location: Chennai / Bangalore / Coimbatore (Hybrid)
Job Summary
We are looking for a highly skilled Senior Data Engineer with strong expertise in Google Cloud Platform (GCP), Apache Beam/Dataflow, Java, and BigQuery. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and cloud-based data processing solutions for enterprise applications.
Key Responsibilities
• Design and develop scalable ETL/ELT pipelines using GCP services.
• Build and maintain real-time and batch data processing pipelines using Dataflow and Apache Beam.
• Develop robust backend processing solutions using Java.
• Work extensively with BigQuery for data warehousing, analytics, and performance optimization.
• Integrate data from multiple sources including APIs, databases, and streaming platforms.
• Optimize pipeline performance, cost, scalability, and reliability on GCP.
• Collaborate with cross-functional teams including Architects, Analysts, DevOps, and Business stakeholders.
• Ensure data quality, governance, monitoring, and security best practices.
• Troubleshoot production issues and provide long-term scalable solutions.
Required Skills
• Strong hands-on experience with GCP services.
• Expertise in Google Dataflow / Apache Beam.
• Strong programming skills in Java.
• Hands-on experience with BigQuery.
• Experience in building batch and streaming data pipelines.
• Good knowledge of SQL and data modeling concepts.
• Experience with CI/CD, Git, and Agile methodologies.
• Strong problem-solving and debugging skills.
Good to Have
• Experience with Pub/Sub, Cloud Composer, Cloud Storage, Dataproc, or Kafka.
• Exposure to Python or Spark.
• Experience in handling large-scale enterprise data platforms.
Preferred Qualifications
• Bachelor’s/Master’s degree in Computer Science, Engineering, or related field.
• GCP certifications are an added advantage.