AI Data Engineer
Cephas Consultancy Services Private Limited
India, Maharashtra, Pune
Positions: 2 full-time roles
Experience: 5–10 years
Job Description
Essential Requirements
Education and qualifications
Bachelor’s degree in Computer Science, Engineering, or a related field.
Work experience
- 5–8 years of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery, with demonstrated ownership of production pipelines and platform components.
Technical and professional skills
Please meet at least three of the following requirements:
- Proven ability to independently design, build, optimise, and operate production-grade batch or streaming data pipelines, including orchestration, observability, error handling, performance tuning, and operational support.
- Hands-on experience with Python and SQL for data transformation and validation.
- Familiarity with Apache Spark, especially PySpark, and large-scale data processing concepts.
- Experience implementing knowledge base and RAG solutions for agentic AI use cases.
Non-technical and soft skills
- Self-starter with strong problem-solving skills and attention to detail.
- Able to work independently and lead technical discussions with engineers, architects, product owners, source-system teams, and business stakeholders to translate requirements into secure and maintainable platform solutions.
- Strong documentation and communication skills.
Other task-specific knowledge
- Strong understanding of enterprise data architecture, cloud security, access control, CI/CD, release management, and production operations for data and AI platform solutions.