Join to apply for the AI, Data Scientist role at PFF
Join to apply for the AI, Data Scientist role at PFF
Get AI-powered advice on this job and more exclusive features.
About PFF
PFF is a leading sports analytics company that transforms complex football data into powerful insights. Our exclusive player grades, advanced metrics, and tools fuel winning decisions for NFL and college teams, broadcasters, fantasy players, bettors, and fans alike.
About PFF
PFF is a leading sports analytics company that transforms complex football data into powerful insights. Our exclusive player grades, advanced metrics, and tools fuel winning decisions for NFL and college teams, broadcasters, fantasy players, bettors, and fans alike.
We are seeking an experienced AI Data Scientist with deep expertise in Large Language Models (LLMs) to lead efforts in model evaluation, tracing, optimization, and distillation. You will play a key role in enhancing the performance, reliability, and safety of generative AI systems across our consumer and B2B products including football chatbots, scouting assistants, and fan-facing analytics platforms.
What You’ll Do
* Design robust evaluation frameworks for LLMs (e.g., hallucination detection, factual accuracy, prompt robustness, calibration).
* Use model tracing tools (e.g., OpenAI trace logs, LangSmith, Weights & Biases) to analyze model behavior and failure modes.
* Lead or assist with LLM distillation projects, compressing large foundation models into smaller performant versions fine-tuned on football-specific domains.
* Create and test structured prompting strategies, build RAG pipelines, and implement safety/guardrails.
* Curate and synthesize football-specific data and knowledge graphs for fine-tuning, evaluation, and few-shot performance.
* Deploy dashboards and alerts to monitor drift, toxicity, bias, or degradation in real-world usage.
* Collaborate with engineers, designers, and product teams to bring LLM-powered features to life in production.
Minimum Qualifications
* 3+ years experience in applied AI/ML roles with at least 1–2 years focused on LLMs or foundation models.
* Deep understanding of transformer-based models, their limitations, and evaluation strategies.
* Proficiency with Python and key libraries: Hugging Face Transformers, LangChain, OpenAI API, PyTorch/TensorFlow.
* Experience with tracing/debugging LLM outputs using tools like LangSmith, W&B Traces, or custom logs.
* Experience with model distillation, quantization, or fine-tuning on domain-specific tasks.
* Strong communication skills with the ability to translate complex model behavior into actionable insights.
Preferred Qualifications
* Prior experience building or maintaining RAG pipelines (e.g., vector databases, retrieval logic, hybrid search).
* Knowledge of sports analytics or passion for football
* Familiarity with prompt evaluation benchmarks (e.g., TruthfulQA, MMLU, ARC) or custom evaluation harnesses.
* Experience with safety/guardrail frameworks (e.g., OpenAI Moderation, Guardrails.ai, Rebuff).
Seniority level
* Seniority level
Mid-Senior level
Employment type
* Employment type
Full-time
Job function
* Job function
Engineering and Information Technology
* Industries
Software Development
Referrals increase your chances of interviewing at PFF by 2x
Get notified about new Data Scientist jobs in Greater Leeds Area.
Leeds, England, United Kingdom 1 week ago
Leeds, England, United Kingdom 1 week ago
Senior Machine Learning Scientist (UK Remote)
Leeds, England, United Kingdom 2 weeks ago
Leeds, England, United Kingdom 1 week ago
Software Developer (Python skills required)
Leeds, England, United Kingdom 2 weeks ago
Research Scientist (Biology) - AI Trainer
Research Scientist (Biology) - AI Trainer
Leeds, England, United Kingdom 1 week ago
AI Software Engineer (Fixed term 24 months)
Leeds, England, United Kingdom 4 hours ago
Wakefield, England, United Kingdom 15 hours ago
Wakefield, England, United Kingdom 15 hours ago
Research Scientist (Chemistry) - AI Trainer
Research Scientist (Chemistry) - AI Trainer
Data Science Analyst, General Insurance Risk Specialists
Leeds, England, United Kingdom 19 hours ago
Leeds, England, United Kingdom 1 week ago
Research and Development Physicist - AI Trainer
Research Scientist (Physics) - AI Trainer
Shadwell, England, United Kingdom 3 weeks ago
Junior Software Developer in Test - SDET
Leeds, England, United Kingdom 4 days ago
Leeds, England, United Kingdom 2 days ago
Wakefield, England, United Kingdom 1 week ago
Leeds, England, United Kingdom 1 week ago
Leeds, England, United Kingdom 1 week ago
Leeds, England, United Kingdom 2 weeks ago
Leeds, England, United Kingdom 1 week ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr