Description
Elevate AI system quality with Jobber as a Data Scientist focused on ML model evaluation. Harness your Python and statistical skills to ensure reliability and performance.<br/><br/>As a Data Scientist at Jobber, you will ensure the accuracy, reliability, and performance of our machine learning models, primarily focusing on validation and monitoring. Collaborate with MLOps and product teams to design evaluation frameworks and regression test suites that enhance model integrity. Your hands-on experience with Python and an understanding of model architectures will be critical in promoting trust in our AI systems.<br/><br/>Key Responsibilities:
• Design and maintain ML model validation frameworks
• Build and manage regression test suites for model performance
• Execute MCP evaluations to assess model capability
• Monitor production models for performance issues
• Document methodologies for clarity and transparency<br/><br/>Requirements:
• Experience in data science or machine learning
• Proficiency in Python, Pandas, and Scikit-Learn
• Strong grasp of statistical model evaluation concepts
• Experience with LLM evaluation frameworks
• Attention to detail in model validation<br/><br/>Contribute to high-quality AI systems that assist small businesses thrive at Jobber.
