Senior Prompt Engineer Configuration and AI… at Aone Staffing… · Pune

Position Summary:

We are looking for a Prompt Engineer who views LLMs as a powerful engine requiring a precision-tuned transmission.

You won't just be writing instructions; you will be architecting the bridge between raw model potential and production-ready, deterministic AI solutions.

In this role, you will move beyond basic "chat" interfaces to build sophisticated Voice Bots, knowledge assistants, and automated workflows that are fast, reliable, and scalable.

Role & responsibilities

1. Architecting Intelligence

• Precision Engineering: Design and maintain high-fidelity prompts for Voice AI, summarization, and complex automation.

• Advanced Logic: Deploy Few-Shot, Chain-of-Thought, and Structured Output techniques to transform probabilistic models into reliable business tools.

• Efficiency: Optimize token usage to balance high performance with cost-effectiveness.

2. Evaluation & Reliability

• Science-Based Testing: Move beyond "vibes" by conducting A/B testing and automated evaluations using frameworks like BLEU, ROUGE, or BERTScore.

• Guardrail Development: Build monitoring frameworks to proactively detect and neutralize hallucinations, bias, and irrelevance.

• Human-in-the-loop: Design feedback loops that allow human expertise to refine AI accuracy over time.

3. Collaborative Integration

• Bridge the Gap: Partner with Data Scientists and Engineers to integrate prompts into RAG pipelines and production APIs.

• Knowledge Leadership: Maintain a reusable prompt library and mentor the broader team on LLM best practices. Qualifications:

Preferred candidate profile

• Academic Foundation: Bachelors or Masters in CS, AI/ML, Data Science, or Computational Linguistics.

• Technical Fluency: Proficient in JavaScript, Python for automation, and a deep understanding of REST APIs, RAG Pipelines.

• Cloud Native: Hands-on experience with Azure OpenAI Service or similar enterprise-grade LLM platforms.

• The RAG Expert: You understand embeddings, vector search, and how retrieval improves model context.

Good To Have:

• Experience with Voice AI testing tools (e.g., Hamming AI, Cekura).
• Familiarity with Vector Databases like Pinecone, Weaviate, or Azure AI Search.
• A background in Cognitive Science or UX Writing you understand how humans and machines process language.