LiveFull-timeApply by 1 Nov 2026
Principal/Senior Data Engineer : Product Development
Hyderabad, India
- Experience
- 3–10 years
- Employment
- Full-time
- Work mode
- Onsite
- Salary
- ₹14.4 L–28.9 L / year
- Deadline
- Apply by 1 Nov 2026
- Posted
- 2025-08-20
Required skills
| Skill | Experience | Level |
|---|---|---|
| CI/CD | 4+ years | Advanced |
| Agile Methodology | 3+ years | Intermediate |
| Distributed Computing | 2+ years | Not specified |
| Google Cloud | 4+ years | Intermediate |
| Azure | 4+ years | Advanced |
| AWS S3 | 4+ years | Advanced |
| BigQuery | 3+ years | Intermediate |
| Snowflake | 3+ years | Advanced |
| Apache Spark | 3+ years | Intermediate |
| Apache-Kafka | 4+ years | Advanced |
| Go Lang | 3+ years | Advanced |
| PostgreSQL | 4+ years | Advanced |
| C++ | 3+ years | Advanced |
| Java (All Versions) | 4+ years | Advanced |
| CPPUnit Testing | Not specified | Not specified |
About the role
Job Description
- Understand the design specifications.
- Follow the best practices for core product development.
- Data ingestion for distributed system with parallel processing, in Java, CPP or Golang for
- from cloud storage – Amazon S3/Azure Cloud Storage/Google Cloud Storage, relational database – Snowflake, Google BigQuery, PostgreSQL, Files, Kafka, data lakehouse (Iceberg)
- High-availability (HA) loading, cross-region replication
- Loading monitoring/error reporting
- Spark Connector
- Third-party management – Kafka, Kafka Connect
Requirements
- building distributed systems applying applying parallel processing.
- Any or of the following – Kafka, Zookeeper, Spark, Stream processing.
- Experience in Kafka Connect, Kafka stream, Kafka security and customization
- Spark connectors
- Event driven architectures.
- Agile development
- CICD
Nice to have:
· gRPC protocol experience and multi-threading
· Zookeeper/ ETCD/ Consul
· Familiarity with distributed consensus algorithms (Paxos / Raft)
· Docker, Kubernetes