AI Data Engineer

Cephas Consultancy Services Private Limited

India, Maharashtra, Pune

Positions: 2 full-time roles

Experience: 5–10 years

Job Description

Essential Requirements

Education and qualifications

Bachelor’s degree in Computer Science, Engineering, or a related field.

Work experience

  • 5–8 years of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery, with demonstrated ownership of production pipelines and platform components.

Technical and professional skills

Please meet at least three of the following requirements:

  • Proven ability to independently design, build, optimise, and operate production-grade batch or streaming data pipelines, including orchestration, observability, error handling, performance tuning, and operational support.
  • Hands-on experience with Python and SQL for data transformation and validation.
  • Familiarity with Apache Spark, especially PySpark, and large-scale data processing concepts.
  • Experience implementing knowledge base and RAG solutions for agentic AI use cases.

Non-technical and soft skills

  • Self-starter with strong problem-solving skills and attention to detail.
  • Able to work independently and lead technical discussions with engineers, architects, product owners, source-system teams, and business stakeholders to translate requirements into secure and maintainable platform solutions.
  • Strong documentation and communication skills.

Other task-specific knowledge

  • Strong understanding of enterprise data architecture, cloud security, access control, CI/CD, release management, and production operations for data and AI platform solutions.