University of Worcester Worcester Research and Publications
 
  USER PANEL:
  ABOUT THE COLLECTION:
  CONTACT DETAILS:

The landscape of validity and reliability practices from applied performance analysts: Establishing a best practice framework

Francis, John ORCID logoORCID: https://orcid.org/0000-0001-7457-5665, Kyte, J., Bateman, Michael and Nicholls, S. (2025) The landscape of validity and reliability practices from applied performance analysts: Establishing a best practice framework. International Journal of Sports Science & Coaching, Online (First). pp. 1-23. ISSN 1747-9541 (print) 2048-397X (eISSN)

[thumbnail of Author Upload] Text (Author Upload)
Manuscript with author details IJSSC V3.docx - Accepted Version
Restricted to Repository staff only

Download (564kB) | Request a copy
[thumbnail of Binder2.pdf]
Preview
Text
Binder2.pdf - Published Version
Available under License Creative Commons Attribution Non-commercial.

Download (6MB) | Preview

Abstract

Whilst Theoretical Performance Analysts benefit from established validity and reliability frameworks, their practical application faces several challenges for Applied Performance Analysts (APAs). We explored the current practices and perceptions regarding validity and reliability by APAs to formulate best-practice recommendations. An open and closed-answer survey was completed by 175 APAs from a range of sports and countries, with responses analysed based on experience (early-career APAs vs experienced APAs). Findings reveal a desire for robust validity and reliability methods, particularly among experienced APAs. Collaborative approaches amongst APAs and other stakeholders were identified when determining performance indicators, yet decisions for live data collection were primarily made by APAs. Familiarisation and reliability processes varied, specifically the frequency of checks, with experienced APAs dedicating more time to learning new systems and checking data more frequently. Despite the existing theoretical frameworks, time constraints and personnel changes pose challenges for practical implementation, with APAs calling for an applied framework. These insights inform the development of a best-practice recommendations framework for collecting, analysing, and presenting accurate and meaningful performance analysis data in applied settings.

Item Type: Article
Uncontrolled Discrete Keywords: Career, collaborative learning, decision-making, expertise, technology, video
Divisions: College of Business, Psychology and Sport > School of Sport and Exercise Science
Related URLs:
Copyright Info: © The Author(s) 2025., Open Access article, This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/)
Depositing User: John Francis
Date Deposited: 27 Feb 2025 11:19
Last Modified: 27 Feb 2025 11:19
URI: https://eprints.worc.ac.uk/id/eprint/14643

Actions (login required)

View Item View Item
 
     
Worcester Research and Publications is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.