INTRODUCTION
To improve athletic performance in soccer, coaches first evaluate each player’s physical capacity to determine personal strengths and weaknesses. They also need to assess the efficacy of various training methods performed in the field by adopting an appropriate testing method that is reliable, valid, and sensitively measures soccer-specific physical capacity [
1-
3]. To date, although a number of laboratory and field tests have been developed to assess the physical capacity [
4,
5] of soccer players, who, during a match, intermittently travel a total of approximately 10-12 km while moving at different speeds and executing various technical actions that require muscular strength and power [
6], many of such tests are seldom used in South Korea due to practical limitations, such as a lack of time, or to a lack of awareness of the importance of such evaluation processes.
Lee and Yoon developed the 21-m shuttle-run test (21-m SRT) to evaluate soccer-specific aerobic fitness levels in 2005 and widely provided it to numerous soccer teams from youth to professional players [
7]. The 21-m SRT was designed to evaluate the various levels of a soccer player’s capability to perform high-intensity, intermittent aerobic exercise with a large anaerobic component. Unlikely to the Yo-Yo intermittent recovery test Level 2, which is mostly used by professional teams, the 21-m SRT, which begins at 11 km/hour, is more suitable for evaluating youth or recreational soccer players who have a relatively lower fitness capacity. In addition, it has an unpredictable (irregularly placed) 8-meter recovery zone where players are required to walk back and forth before increasing their speed for the next stage. From a practical standpoint, a submaximal version of the 21-m SRT (67
th shuttle run) is expected to efficiently capture improvements in aerobic capacity by monitoring each player’s heart rate response as a performance indicator during the training period.
Despite the numerous practical advantages of the 21-m SRT, to date there has been no research performed on topics such as its reliability or validity. Therefore, the present study aims to (1) examine the reliability and validity of the 21-m SRT for youth soccer players and (2) test the practicality of using the 21-m SRT to evaluate the performance of youth soccer players during preseason training, focusing on fitness improvement.
METHODS
Participants
Twenty-seven high school male soccer players who were registered in the Korean Football Association participated in this study. A researcher who received prior approval from the head coach visited the training ground, explained the purpose of the reseach to the participants as well as their parents, and obtained their voluntary informed consent to participate in the study. Characteristics of the participants are shown in
Table 1.
Experimental procedures
All data collection was performed at a laboratory setting or on a training ground with an artificial grass surface. Among the twenty-seven players, those without injuries performed two graded exercise tests (GXT) on a treadmill (20 of 27 players participated) before and after preseason training and the 21-m SRT on four separate occasions at the same time of day during preseason training. To determine the reliability of the 21-m SRT, it was conducted twice, a test and a retest, at a one-week interval (weeks 1 and 2) immediately after the start of preseason training (27 players participated). To evaluate its validity and practicality, it was also conducted three times at four-week intervals (weeks 2, 6, and 10) during the last eight weeks of preseason training (16 of 27 players participated). The maximal oxygen consumption of each participant was measured in the laboratory before and after preseason training to examine the validity of the 21-SRT as a tool for soccer players’ fitness development. Each procedure was configured as shown in
Figure 1. Participants were instructed not to consume food or caffeine at least 4 hours prior to each test.
21-m shuttle-run test (SRT)
The reliability, validity, and practicality of the SRT with an irregular recovery period, which was developed by Lee and Yun (2005), for evaluating the aerobic capacity of soccer players in a field setting was examined.
Before the SRT, participants performed 10 minutes of light-intensity warming up with stretching. The SRT was performed on artificial turf. The SRT requires participants to run twenty-one meters back and forth across a marked track keeping time with prerecorded beep signals. If a participant reaches the relevant marker in time, 15 seconds of active recovery time, during which the participant walks within an eight-meter area, is given, then the next level commences: participants must run faster in order to keep time with faster beeps (
Figure 2). If a participant fails to reach the relevant marker in time, they are warned. A second warning terminates the test for that participant. The number of shuttle runs completed successfully and the total distance traversed are recorded to represent the performance of that player. The heart rate of participants during the SRT were obtained using the AIRBEAT system [
8].
Measurement of maximal oxygen consumption
Participants were taken to an air-conditioned laboratory which had a relative humidity of 50-60% at a temperature of 20-22℃. The GXT was performed on a treadmill with a modified Bruce protocol, which is highly correlated to directed measured maximal oxygen consumption [
9]. Individual maximal oxygen consumption was obtained using open-circuit spirometer techniques (Quark metabolic cart, COSMED, Italy), and heart rate was measured with a Polar heartrate monitor. During the GXT, gas exchange data were collected continuously using an automated breath-by-breath method and were manipulated to calculate V
E, VO
2 consumption, and VCO
2 production; Borg’s rating of perceived exertion (RPE) was measured at the end of every minute [
10]. All participants were encouraged to exercise to volitional exhaustion during the GXT. VO
2max was reached when at least two of the following criteria were satisfied: a leveling off of the VO
2, a RPE > 17 using Borg’s scale, voluntary exhaustion, and achievement of 90% the age-predicted maximal heart 4 rate [
11,
12].
Statistical analyses
To test its reliability, participants performed the 21-m SRT on two separate occasions, exactly 1 week apart, and at the same time of day. Pearson’s correlation coefficients and paired sample t-
Figure 1. Experimental procedures.
t-tests were used to examine the relationship and systemic bias between the test and retest. The criterion-related validity of 21-m SRT performance was investigated using Pearson’s correlation coefficients between directly measured VO
2max and 21-m SRT performance, which is the total distance covered during the test. To evaluate the practicality of the 21-m SRT for soccer players during preseason training, paired sample t-tests were performed for the level of VO
2max before and after 8 weeks of preseason training. Moreover, 21-m SRT performance, which is represented by heartrate immediately after the 67
th repetition (SRT
HR67) and by the total distance covered (SRT
Distance), during the preseason training was measured on three separate occasions with two 4-week intervals. Statistical comparisons were performed using a repeated one-way ANOVA design with a within-subject factor of time [baseline (2
nd week), 6
th week, and 10
th week] for 21-m SRT performance during preseason training. When a significant M
F value was obtained, a posthoc test using the Bonferroni method was applied. Statistical analyses were performed using GraphPad Prism 9.5.1 packages.
RESULTS
Test-retest reliability
The test and retest of the 21-m SRT were performed by 27 participants exactly 1 week apart at the beginning of preseason training. The mean of SRT
Distance for the test was 2770 ± 451.2 m (95% confidence interval (CI) 2591 - 2948 m) and that for the retest was 2916 ± 482.2 m (95% CI 2725 - 3107 m). A strong correlation existed between the test and retest for SRT
Distance (
Figure 3A). The paired
t-test conducted to test the hypothesis for the equality of mean between the SRT test and retest revealed a statistically significant bias (
p = 0.0057). The absolute mean difference ± 95% Limit of Agreement was 146.2 ± 494.1 m. The Bland-Altman plot for mean test and retest is depicted in
Figure 3B.
Validity of 21-m SRT
Twenty players performed a GXT on a treadmill to examine the criterion-related validity of the 21-m SRT using Pearson’s correlation coefficients between directly measured VO
2max in the laboratory and SRT
Distance performed in the second week. The mean VO
2max of the twenty players was 58.6 ± 4.6 ml・min・kg
-1 (95% CI, 56.4 - 60.7 ml・min・ kg
-1). There was a significant correlation between directly measured VO
2max and SRT
Distance (
r = 0.465,
p = 0.039). The equation for estimated VO
2max from the 21-m SRT is depicted in
Figure 4.
Practicality of 21-m SRT for soccer players during preseason training
Twenty players performed a GXT on a treadmill before and after 10 weeks of preseason training to examine the effect of preseason training on maximal oxygen consumption. The VO
2max of the twenty players [61.6 ± 5.3 ml・min・ kg
-1 (95% CI, 59.2 - 64.1 ml・min・kg
-1)] was significantly higher after the preseason training (
t(19) = 2.36, 95% CI of difference 0.3403 to 5.780,
p < 0.05). To determine the manner of the changes in players’ aerobic capacity after preseason training, whether 21-m SRT performance (SRT
Distance and SRT
HR67) differed between training periods, which were separated by 4 weeks, was examined. Among the twenty-seven participants, only sixteen successfully completed all three 21-m SRTs during preseason training without injury. There were statistically significant differences in 21-m SRT performance (
F (2, 15) = 13.59, p = 0.0002,
Figure 5A for SRT
Distance;
F (2, 15) = 10.83, p = 0.0003,
Figure 5B for SRT
HR67). A post hoc test using Bonferroni correction demonstrated that SRT
Distance at the 10
th week (3504 ± 458 m) was significantly higher than that of the 2
nd week (mean difference = 485.6 m, 95% CI of difference 222.6 m to 748.7 m,
p = 0.0005) and than that of the 6
th week (mean difference = 485.6 m, 95% CI of difference 222.6 m to 748.7 m,
p = 0.0005). Moreover, SRT
HR67th had significantly decreased at the 6
th week (mean difference -5.0 bpm, 95% CI -9.1 bpm to -0.93 bpm,
p = 0.0143) and at the 10
th week (mean difference -6.7 bpm, 95% CI -10.8 bpm to -2.6 bpm,
p = 0.0014) compared to that of the 2
nd week (177.9 ± 5.48 bpm). Moreover, there was a significant negative correlation between SRT
HR67 and SRT
Distance during the preseason training period (
r = -0.311,
p < 0.05,
Figure 5C).
DISCUSSION
The aim of the present study was to examine the reliability and the validity of the 21-m SRT, which is widely used by various soccer teams from youth to professional in South Korea, and to evaluate the practicality of 21-m SRT performance measured during the preseason training period in a youth male soccer team. The present findings reveal that the 21-m SRT test yields highly consistent results for test-retest bias and that the maximal distance covered during a 21-m SRT is highly correlated to soccer players’ maximal oxygen consumption, which is a representative indicator of aerobic capacity. As for its practicality, 21-m SRT performance (SRTDistance and SRTHR67) had a high sensitivity, which would allow coaches to efficiently identify longitudinal changes in physical capacity during the preseason training camp.
The 21-m SRT performance exhibited during preseason training could provide valuable feedback to the coach both on the efficacy of the training program and the responsiveness of each individual athlete to the training program [
13]. Therefore, it is important to ensure that any changes in performance reflected in a field test following training are “real”. Which is to say that such changes in performance are a reflection of altered physical capacity rather than the results of variation between or within players [
14]. In addition, performance on the test should reflect the physical performance required in a real match in the sport [
15]. Such issues are addressed by determining the reliability and the validity of the 21-m SRT [
16,
17].
As for the reliability, the findings indicating a correlation between the 21-m SRT test and retest (r = 0.86) suggest a significant linear relationship, and these results are similar to previous reports examining the 20-m multi-stage shuttle-run test [
18,
19]. In addition, the test and retest reliability showed that the result of 95% Limit of Agreement was 146 ± 494.1 m covered in the 21-m SRT (± 23.6 shuttle). By adopting the Bland-Altman plot for the test and retest results, it is possible to provide the absolute differences in performance. The result of 95% Limit of Agreement was slightly higher than those in previous studies examining the 20-m multi-stage shuttle-run test, but it is difficult to argue whether there is test and retest reliability based on a comparison of these results because characteristics of participants were different among studies [
18,
19].
The validity of a field test has been commonly determined by using correlation analysis to assess the relationship between performance on a field test and physical performance during the actual event. In the present study, the validity of the 21-m SRT was examined using a correlation coefficient between 21-m SRT
Distance and maximal oxygen consumption levels, which are the most commonly used variables to reflect individual aerobic capacity [
20]. Interestingly, a moderate correlation (r = 0.465) between 21-m SRT
Distance and maximal oxygen consumption was found in the present study. Although the majority of energy provision is derived from the aerobic capacity during a soccer match, numerous actions, such as frequent high-intensity intermittent running or changing directions during a soccer match, require a player to increase their energy demands from anaerobic metabolism [
4]. Therefore, 21-m SRT performance might be more suitable for evaluating soccer-specific fitness.
The current results reveal that 10 weeks of preseason training for the youth soccer players significantly improved their aerobic capacity (mean difference 3.1 ± 5.8 ml・min・ kg-1). As aerobic capacity increased, 21-m SRT performance (SRTDistance and SRTHR67) changed at the same time. There was a significant improvement in 21-m SRTDistance (mean difference 485.6 m) over the course of the entire training period that was considerably larger than the reproducibility of the test-retest. From the viewpoint of practicality, SRT performance data from the monthly evaluations was sensitive to changes over the course of each month and could, therefore, provide valuable feedback to coaches. Moreover, SRTs can be implemented for a low cost (no treadmill, no metabolic cart) and rapidly. Interestingly, there was significant decrease in SRTHR67 and it was significantly correlated to SRTDistance during the entire training period. Based on these results, it could be recommended that coaches apply the submaximal version of the SRT test (67 shuttle repetitions and the monitoring of heart rate), as it would be useful for efficiently measuring subtle changes in soccer-specific fitness.
The present study examined the test-retest reliability of the 21-m SRT using correlation coefficients and Limit of Agreement and assessed the criterion-related validity with the correlation coefficients between maximal oxygen consumption and SRT performance. In addition, a 21-m SRT for youth soccer players was applied during preseason training to examine whether it could measure changes of SRT performance in the same way that players’ aerobic performance improves during the preseason training period. However, this study has several limitations. The current study reported relatively low correlation coefficients between VO2max and SRTDistance. This is probably because in addition to the aerobic fitness levels measured by VO2max, muscle strength and power may also improve throughout the preseason training. Therefore, future studies should examine whether SRT performance indicators such as SRTDistance and SRTHR67 are related to match-performance indices, such as number of sprints or amount of high-intensity running, that are supported by the anaerobic energy system. In addition, changes in physiological responses such as glucose, lactate, and creatine kinase levels during preseason training could be explored in future studies.
These results reveal that the 21-m SRT, which is widely used in the field, is a reliable and valid training tool. It can be applied in a practical way to examine the level of aerobic capacity of youth soccer players and the efficacy of the training program in an efficient manner using performance indicators such as SRTDistance and SRTHR67. Further studies need to examine whether the 21-m SRT performance results predict a soccer player’s key performance indicators or actual match performance by adopting an electronic performance and tracking system.
ACKNOWLEDGEMENTS
The author declares no conflicts of interest related to the work in this manuscript. The work was supported by Incheon National University Research Grant in 2021.
Figure 1.
Figure 2.
The 21-m shuttle run test.
Figure 3.
The relationship of shuttle-run test performance between test and retest (A) and the Bland-Altman plot for test and retest (B).
Figure 4.
The relationship between 21-m shuttle run test performance (m) and maximal oxygen consumption (ml·min·kg-1). Note: X is shuttle-run test performance (m) and Y is estimated VO2max.
Figure 5.
Shuttle-run test performance during the preseason training period for distance (A) and heart rate (B) immediately after 67th repetition; relationship between distance covered (m) and heart rate immediately after 67th repetition during preseason training (C).
Table 1.
Characteristics of participants.
Variables |
Participants (27 males) |
95% confidence intervals |
Age (yrs.) |
15.9 ± 0.7 |
15.6 to 16.1 |
Height (cm) |
176.1 ± 5.9 |
173.8 to 178.5 |
Weight (kg) |
67.1 ± 6.3 |
64.6 to 69.6 |
Muscle mass (kg) |
32.3 ± 3.6 |
30.9 to 33.7 |
Body fat (%) |
15.5 ± 2.2 |
14.6 to 16.4 |
REFERENCES
1. Chaouachi A, Manzi V, Wong DP, Chaalali A, Laurencelle L, Chamari K, Castagna C. Intermittent endurance and repeated sprint ability in soccer players. J Strength Cond Res 2010;24:2663-9.
2. Castagna C, Impellizzeri FM, Chamari K, Carlomagno D, Rampinini E. Aerobic fitness and Yo-Yo continuous and intermittent tests performances in soccer players: a correlation study. J Strength Cond Res 2006;20:320-5.
4. Krustrup P, Mohr M, Nybo L, Jensen JM, Nielsen JJ, Bangsbo J. The Yo-Yo IR2 test: physiological response, reliability, and application to elite soccer. Med Sci Sport Exer 2006;38:1666-73.
5. Bangsbo J, Iaia FM, Krustrup P. The Yo-Yo intermittent recovery test: a useful tool for evaluation of physical performance in intermittent sports. Sports Med 2008;38:37-51.
6. Stølen T, Chamari K, Castagna C, Wisløff U. Physiology of soccer. Sports Med 2005;35:501-36.
7. Lee Y, Yun Y. Shuttle run test for soccer players. Korea Football Institute. 2005.
8. Li M, Kim YT. Development of patch-type sensor module for wireless monitoring of heart rate and movement index. Actuator A Phys 2012;173:277-83.
9. Lerman J, Bruce RA, Sivarajan E, Pettet GE, Trimble S. Low-level dynamic exercises for earlier cardiac rehabilitation: aerobic and hemodynamic responses. Arch Phys Med Rehab 1976;57:355-60.
10. Borg GA. Psychophysical bases of perceived exertion. Med Sci Sports Exerc 1982;14:377-81.
11. Aspenes ST, Nilsen TIL, Skaug EA, Berthussen GF, Ellingsen Ø, Vattel L, Wisløff U. Peak oxygen uptake and cardiovascular risk factors in 4631 healthy women and men. Med Sci Sports Exerc 2011;43:1465-73.
12. Brown JD, Mahon AD, Plank DM. Attainment of maximal exercise criteria in boys and men. J Sports Med Phys Fit 2002;42:135-40.
13. MacDougall JD, Wenger HA, Green HJ. Physiological testing of the high-performance athlete. Med Sci Sports Exerc 1993;25:305.
14. Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med 1998;26:217-38.
15. Hopkins WG, Hawley JA, Burke LM. Design and analysis of research on sport performance enhancement. Med Sci Sports Exerc 1999;31:472-85.
16. Hopkins WG. Measures of reliability in sports medicine and science. Sports Med 2000;30:1-15.
17. Boddington MK, Lambert MI, Gibson ASC, Noakes TD. Reliability of a 5-m multiple shuttle test. J Sport Sci 2001;19:223-8.
19. Aziz AR, Chia MYH, Teh KC. Measured maximal oxygen uptake in a multi-stage shuttle test and treadmill-run test in trained athletes. J Sports Med Phys Fit 2005;45:306-14.
20. Howley ET, Bassett DR, Welch HG. Criteria for maximal oxygen uptake: review and commentary. Med Sci Sports Exerc 1995;27:1292-301.