1. Job Title: Senior AI/ML Data Engineer
2. Introduction/Overview: Do you dream in algorithms and speak fluent machine learning? Are you passionate about using cutting-edge AI to solve real-world problems? If so, then we want you on our team! We are seeking a highly motivated and technically skilled AI expert to join our growing team. In this role, you will play a pivotal role in designing, developing, and implementing innovative AI solutions leveraging Intelligent Document Processing (IDP), Retrieval-Augmented Generation (RAG), and Generative AI (GenAI) technologies. You will also be expected to apply your expertise in Neural Networks and Machine Learning to optimize these solutions and achieve superior performance. The key problem we are trying to solve is the Document Indexing, data extraction from documents & extracted data validation for nearly 500+ document types in the US Mortgage origination & servicing domain.
3. Roles & Responsibilities: Build Automation pipelines using CNN/RNN models as well as RAG techniques & LLM (or even Small Language Models) for Document Indexing, Data extraction from documents. Critical to Success is the speed to market in deploying these Automations in Intelligent Document Processing. Critical to Success is the low operational cost to run these deployments which means minimizing costs yet optimally using RAG + LLM (and/or fine-tuning) for solutions. Craft and optimize text prompts for various generative AI tasks (text generation, translation, code completion, etc.). Collaborate with data scientists to understand GenAI model capabilities and tailor prompts for optimal performance on specific datasets. Continuously iterate on prompts through A/B testing and human evaluation, using metrics (fluency, coherence, creativity) to achieve desired model outputs. Partner with data scientists to analyze results, identify GenAI biases/errors, and adjust prompts accordingly. Research and explore new prompting techniques (few-shot learning, zero-shot learning) to enhance how prompts guide GenAI model behavior and creative text generation. Focus on prompt design but stay informed on advancements in NLP and GenAI models to understand their capabilities and limitations for prompt effectiveness. Develop and implement data pipelines for efficient prompt evaluation. Analyze GenAI outputs generated from prompts to identify potential issues and refine prompts for optimal results. Become an expert in prompt engineering best practices for GenAI applications. Share knowledge and best practices within the team. (Optional) Contribute to developing internal prompt management and evaluation tools. Effectively communicate the impact of prompts on GenAI outputs to both technical and non-technical audiences. Develop frameworks and tools (optional) to empower data scientists and analysts working with GenAI models, potentially including solutions for prompt creation, version control, and data analysis. Possess strong problem-solving skills, considering multiple prompting approaches and weighing them to achieve the best creative outputs from GenAI models.
4. Years of Experience: No Details Found
5. Education Qualification: Bachelor/Master/Engineering degree in IT/Computer Science/software engineering or relevant field.
6. Skills/Knowledge: Python, SQL, Pandas, AI architectures, IDP, RAG, GenAI technologies, Neural Networks, Machine Learning algorithms, NLP, transformers, Python frameworks (Django, Flask, Pyramid), API framework, Microservices, AWS tools and technologies (EC2, EMR, ECS, Docker, Lambda, Sagemaker), AWS GenAI FMs, Bedrock, Titan, relational SQL and NoSQL databases, Machine learning/Deep learning concepts in cognitive areas (NLP, Computer vision, image analytics), structured/unstructured data analysis, descriptive and prescriptive analytics.
7. Key Competencies: Strong programming expertise, AI architecture design and development, knowledge of AI technologies, expertise in Python and relevant frameworks, hands-on experience with AWS tools and technologies, familiarity with SQL and NoSQL databases, proficiency in machine learning and deep learning concepts.
8. Domain/Industry: US Mortgage origination & servicing domain.
9. Employment Type: Full Time
10. Company Overview: No Details Found
11. Benefits & Opportunities: No Details Found
12. Location & Travel: 2 - 11 PM IST, Mon – Fri. No travel.