Prompt AI Engineer
Job Description
What you’ll do in the role:
* Design, test, and refine prompts for diverse AI applications/products, ensuring accuracy, relevance, and engagement.
* Collaborate with product team, data scientists, tech teams to align prompts with product features/ requirements and user needs.
* Analyze AI-generated responses to improve model behavior, consistency, and performance.
* Take ownership of Prompt Management: Continuous refinement, storage, versioning, conformity across various environments of prompts.
* Conduct A/B testing to evaluate and enhance prompt effectiveness and response quality.
* Develop and document best practices for scalable prompt engineering across different projects/products.
* Optimize prompts working closely with tech teams to improve system performance.
* Stay informed on advancements in Gen AI space, share developments and best practices with the extended team.
What you’ll bring to the role
* 2-4 years of hand-on experience building solution in Machine learning, NLP, AI applications, or related fields.
* Expertise in prompt engineering for large language models (LLMs) such as OpenAI’s GPT, Google’s Gemini, or Claude.
* Strong analytical and problem-solving abilities to optimize AI responses.
* Excellent time management skills to juggle multiple competing priorities.
* Strong critical thinking and attention to detail.
* Ability to work collaboratively with cross-functional teams.
* Experience with AI frameworks like Retrieval-Augmented Generation (RAG), NL to SQL etc.
* Proficiency in Python
* Experience with AI model performance evaluation or AI annotations.
* Previous experience in AI-driven chatbot development or conversational AI platforms.
