Descrizione:
FairMind is looking for a LLM Ops Engineer to help us building and maintaining the groundings of our Generative AI applications. Your role is pivotal in constructing and upholding infrastructure and pipelines, especially working alongside the FairMind AI Team. You'll be key in automating and optimizing the ML lifecycle to ensure our Generative AI models' efficiency, scalability, safety and reliability in production.Responsibilities:
• Create and manage ML/LLM pipelines for Generative AI models, covering data ingestion, processing, training, deployment, and monitoring.
• Automate ML tasks using GitOps, CI/CD pipelines, and container technologies like Docker and Kubernetes.
• Implement version control, CI/CD, and containerization for streamlined ML and LLM workflows.
• Design monitoring and alerting systems to track model performance, data drift, and key metrics.
• Perform ground truth analysis to gauge LLM outputs against accurate data.
• Develop robust monitoring and alerting for Generative AI models in production to proactively handle issues.
• Work with the AI Team to enhance model performance and resource use.
• Manage cloud infrastructure (e.g., AWS, Azure) for ML workloads, ensuring cost-efficiency and scalability.
• Keep updated with MLOps advancements to integrate into our platform and processes.
• Communicate with various stakeholders about the health and performance of generative AI models.
Qualifications:
• Bachelor’s in Computer Science, Data Science, Engineering, or related, or equivalent experience.
• Experience in MLOps, DevOps, data engineering, or ML infrastructure.
• Proven expertise in deploying and managing ML and large language model pipelines, especially on cloud platforms like AWS (preferred), Azure, etc.
• Strong knowledge of CI/CD principles and container technologies like Docker and Kubernetes.
• Familiarity with monitoring tools (e.g., Prometheus, Grafana) for ML systems.
• Excellent communication, teamwork, and problem-solving skills.
• Independent work ethic and team collaboration.
• Passion for Generative AI and its transformative potential.