Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Filter by Categories
Case Report
Clinical Images
Research Article
Review Article
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Filter by Categories
Case Report
Clinical Images
Research Article
Review Article
View/Download PDF

Translate this page into:

Research Article
2025
:4;
100519
doi:
10.1016/j.jorep.2024.100519

Assessment of interobserver reliability and intraobserver repeatability of letournel and judet classification for acetabular fractures

Hospital and Rehabilitation Centre for the Disabled Children(HRDC), Banepa, Nepal
B and B Hospital, Gwarko, Lalitpur, Nepal

⁎Corresponding author: Rajan Bhusal. bhusalrajann55@gmail.com

Disclaimer:
This article was originally published by Reed Elsevier India Pvt. Ltd. and was migrated to Scientific Scholar after the change of Publisher.

Abstract

Abstract

Acetabular fractures account for 1–2% of all fractures and pose significant challenges for orthopedic surgeons due to complex anatomy and risks of long-term functional impairment. The Letournel and Judet (L-J) classification system, while popular for its simplicity and association with surgical outcomes, raises concerns about interobserver reliability and intraobserver repeatability across different populations.

To assess the interobserver reliability and intraobserver repeatability of the L-J classification for acetabular fractures and evaluate the impact of CT scans on classification reliability.

This prospective observational study was conducted at B & B Hospital, Gwarko, Lalitpur, Nepal, over one year. A total of 45 skeletally mature patients with confirmed acetabular fractures were recruited. Six experienced pelvic surgeons were divided into three groups and independently classified each fracture using the L-J system based on plain radiographs, Judet views, and CT scans.

The mean age of participants was 36.75 years, with 86 % male representation. Fracture side distribution showed 46 % on the left and 54 % on the right. Interobserver reliability, assessed using Cohen's kappa coefficient, showed substantial agreement (k = 0.77) for most fracture types. Intraobserver repeatability also demonstrated substantial consistency among individual assessors over time. The evaluation of CT scans revealed insights into the reliability of the L-J classification system.

This study enhances the understanding of the L-J classification's reliability for acetabular fractures, providing crucial information for its effective implementation in clinical practice.

Keywords

Acetabular fractures
L-J classification
Interobserver reliability
Intraobserver repeatability
Orthopaedic surgery
CT scans
Fracture assessment
1

1 Introduction

Acetabular fractures, accounting for 1–2% of all fractures, pose a significant challenge for orthopaedic surgeons due 1 to their complex anatomy and potential for long-term functional limitations.2,3 Accurate classification is crucial for guiding treatment decisions and prognostication. Among various classification systems, the Letournel and Judet (L-J) classification remains widely used due to its simplicity, reproducibility, and correlation with surgical approach and outcomes.4

However, the reliability of any classification system hinges on its consistency in application. Both interobserver reliability, reflecting agreement between different assessors, and intraobserver repeatability, signifying consistency within a single assessor over time, are crucial for ensuring confidence in its clinical utility.5

Despite the widespread adoption of the L-J classification, concerns persist regarding its interobserver reliability and intraobserver repeatability.6 The inherent complexity of acetabular fractures, coupled with the subjective nature of certain L-J fracture subtypes, can lead to discrepancies in classification.7 Furthermore, limited studies have comprehensively evaluated the reliability of the L-J classification, particularly in diverse populations and with varying levels of orthopaedic experience.8

Therefore, a thorough assessment of both interobserver reliability and intraobserver repeatability of the L-J classification for acetabular fractures is warranted. This study aims to address this gap by investigating the agreement between independent orthopaedic surgeons and the consistency of individual surgeons in classifying acetabular fractures using the L-J system. By employing robust methodologies and analyzing data from a representative sample of patients, we seek to provide valuable insights into the reliability of this widely used classification system and inform its effective implementation in clinical practice.

2

2 Methods and materials

In a prospective observational study conducted at B & B Hospital, Gwarko, Lalitpur, Nepal, we evaluated the interobserver reliability and intraobserver repeatability of the Letournel and Judet classification for acetabular fractures while also investigating the impact of CT scans on classification reliability. Over a one-year period, we recruited 45 skeletally mature patients with confirmed acetabular fractures on plain radiographs. Exclusions included polytrauma, associated fractures elsewhere, incomplete imaging, and age under 18.

AP and Judet view x-rays and CT scans of 45 patients with pelvic fractures were collected and randomly assigned numbers by the senior treating surgeon. These were already classified during surgery by the senior treating surgeon. Along with X-rays and CT scans, each observer was also provided with diagrams of the LJ classification system. Six observers with varying degrees of experience in pelvic and acetabulum fracture surgery were randomly selected for the study and divided into three groups. The first group consisted of two senior surgeons with seven years of experience; the second group consisted of two surgeons with three years of experience; and the last group had two surgeons with one year of experience. Each reviewer was not allowed to communicate with others and was asked to review solely based on X-rays first, then CT scans were provided later as a reference. After one month, the same X-rays and CT scans were provided with another random number for review again. The reviewers were blinded by their previous classification. In this way, interobserver reliability was assessed by comparing the reviews of all three reviewers, and intra-observer reliability was assessed by comparing reviews of the same X-rays and CT scans by the same observer over a span of 1 month.

Data collected included demographics, fracture type by Letournel and Judet classification on each modality (radiographs, Judet view, and CT scan), and surgeon classification for each modality. All data were entered into Microsoft Excel and analyzed using SPSS version 24.

Cohen's kappa coefficient was employed to assess the agreement level between observers and different imaging modalities. Kappa values were interpreted as follows: less than 0.00 (poor agreement), 0.01–0.20 (slight agreement), 0.21–0.40 (fair agreement), 0.41–0.60 (moderate agreement), 0.61–0.80 (substantial agreement), and greater than 0.80 (almost perfect agreement).

Power analysis, conducted using a two-proportion z-test with an alpha level of 0.05 and a desired power of 80 %, informed the sample size calculation. We further assessed inter-observer and intra-observer reliability using Cohen's kappa coefficient with 95 % confidence intervals. Finally, the effect of the CT scan on the reliability of fracture classification was evaluated by comparing the kappa values for classification based on plain radiographs and Judet view with those based on CT scans.ElementaryAssociated✓Anterior wall✓Anterior column✓Posterior wall✓Posterior column✓Transverse✓Posterior column with posterior wall✓Transverse with posterior wall✓T-shaped✓Anterior column posterior hemi transverse✓Associated Both-column

3

3 Results

A total of 45 skeletally mature patients with confirmed acetabular fractures were recruited over a one-year period. The mean age of participants was 36.75 years, with 86 % being male. Side involvement distribution showed 46 % affecting the left side and 54 % impacting the right side.

The data presented in Table 1 illustrates the interobserver reliability, measured by kappa (k) values, for two diagnostic modalities across three different groups of experience levels during two sessions. For the group with the most experience (>7 years), there was little difference in reliability when using plain radiographs alone between Session 1 (k = 0.73) and Session 2 (k = 0.71). However, combining plain radiographs with CT scans significantly improved reliability in Session 2 (k = 0.84) compared to Session 1 (k = 0.73). The experienced groups (>3 years and >1 year) showed a similar trend, with marginal improvements in k values from Session 1 to Session 2 when using plain radiographs alone, and more notable increases when adding CT scans. The >3 years group increased from k = 0.62 to k = 0.71, and the >1 year group from k = 0.68 to k = 0.71 in the second session when using both modalities, indicating that the addition of CT scans generally enhances interobserver reliability, particularly in more complex or challenging cases.

Table 1 Interobserver reliability (K values) for session one and two.
Groups Plain Radiographs Only Plain radiograph and CT
Most Experienced >7 years 2
Session 1 0.73 0.73
Session 2 0.71 0.84
Experienced >3 years 2
Session 1 0.61 0.62
Session 2 0.64 0.71
Experienced >1 years 2
Session 1 0.61 0.68
Session 2 0.66 0.71

Table 3 summarizes intraobserver reliability across different experience levels, using kappa (k) values for plain radiographs alone versus a combination of plain radiographs and CT scans. In the most experienced group (>7 years), k values indicate substantial to almost perfect reliability, decreasing slightly with the addition of CT scans (from k = 0.73 to k = 0.71 for Observer 1 and k = 0.86 to k = 0.72 for Observer 2). For the groups with >3 years and >1 year of experience, reliability remains substantial with both modalities, though there's a marginal drop when CT scans are used (from k = 0.71 to k = 0.68 for Observer 1 in the >1 year group).(see Table 2)

Table 2 Intraobserver reliability.
GROUPS PLAIN RADIOGRAPHS ONLY PLAIN RADIOGRAPH AND CT
Most Experienced >7 years 1
Observer 1 0.73 0.71
Observer 2 0.86 0.72
Experienced >3 years 2
Observer 1 0.71 0.72
Observer 2 0.72 0.68
Experienced >1 years 2
Observer 1 0.71 0.68
Observer 2 0.74 0.71
Table 3 Percent Agreement of the Observations, Based on the forty-five Radiographs, with the Surgical Diagnosis.
Surgical Diagnosis No of cases Number of Observations Per cent Agreement
First session Both sessions
ABC 8 138 65 68
AC 4 96 86 89
ACPHT 4 121 52 56
PC 3 79 86 87
PW + PC 4 97 78 82
T - TYPE 6 115 71 73
TRANSVERSE 5 139 94 96
TRANSVERSE WITH POST. WALL 5 115 84 86
AW 2 65 88 92
PW 4 118 96 98
TOTAL 45 1083 86 83

Table 3 reports the percentage agreement between radiographic observations and surgical diagnoses across two sessions involving forty-five radiographs. The data, encompassing 1083 observations, reveals varied levels of agreement across different diagnoses. For instance, agreement for ABC increased slightly from 65 % to 68 % across sessions, while more substantial improvements were seen in AC, from 86 % to 89 %. Conversely, the agreement for ACPHT was lower, moving from 52 % to 56 %. High consistency was observed in PW, with agreement percentages at 96 % and 98 %, respectively. Notably, the overall agreement across all cases decreased slightly from 86 % in the first session to 83 % in both sessions combined, indicating potential issues with observer consistency or interpretation accuracy over time.

4

4 Discussion

Open reduction and internal fixation of displaced acetabular fractures is the preferred method of treatment to preserve the hip joint.9 However, the main challenge in treating these fractures lies in the limited understanding of their anatomical and pathological nature, which complicates the selection of a surgical approach for accurate reduction. This often results in unpredictable outcomes.10 The work of Letournel has been pivotal in enhancing our understanding of these fractures. He developed a classification system and a more effective management algorithm, which have become essential tools in guiding surgical treatment. Letournel's classification system is now the most widely used method for assessing and comparing clinical reports.8

This study evaluated the interobserver reliability and intraobserver repeatability of the Letournel and Judet (L-J) classification for acetabular fractures, examining the impact of CT scans on classification consistency among orthopaedic surgeons.Our findings align with previous studies asserting the reliability of the L-J classification system in clinical settings, emphasizing its widespread acceptance and utility in fracture diagnosis.11

Interobserver reliability was quantified using kappa values, which reflected substantial agreement among observers. For the most experienced surgeons (>7 years), the interobserver kappa values were relatively stable when using only plain radiographs across two sessions (k = 0.73 and k = 0.71). The stability of interobserver kappa values among the most experienced surgeons using plain radiographs might be attributed to their extensive expertise and practice, which enhance their ability to consistently interpret radiographic features. Standardized training and familiarity with diagnostic criteria further reduce variability in assessments. Additionally, experienced surgeons exhibit confidence in decision-making and effective communication, leading to substantial and stable agreement reflected in kappa values across sessions.12 However, the addition of CT imaging in the second session significantly enhanced the kappa value (k = 0.84), suggesting that CT scans may facilitate a clearer and more consistent interpretation of complex fractures.13 This enhancement was similarly observed in less experienced groups, indicating that the integration of CT imaging might reduce the subjectivity and variability inherent in radiographic fracture classification.8

Intraobserver reliability was also significant, although slight decreases in kappa values were noted with the addition of CT scans for some observers Plain radiographs only (k = 0.86) and with CT (k = 0.72) for observer two and similar findings in a less experienced group of more than one year and in the groups of experience more than three years similar findings have been noted. This decrease may be attributed to the increased complexity and detail provided by CT imaging, which could introduce a level of interpretation variability not present with plain radiographs alone.8 Despite this, the overall substantial kappa values indicate a strong consistency in individual observers' ability to classify fractures using both imaging modalities over time.14

Percentage agreement between radiographic observations and surgical diagnoses also provided insight into the practical efficacy of the L-J classification. High agreement levels in specific fracture types, such as PW, which reached up to 98 % in the second session, underscore the accuracy of radiographic assessment in clear-cut cases. However, the overall slight decline in agreement from the first to both sessions combined (86 %–83 %) highlights potential challenges in maintaining consistency across more ambiguous or complex fracture types, which may necessitate additional training or revised classification guidelines to improve.15

4.1

4.1 Strengths and limitations

To the best of our knowledge, this is the first study conducted in the Nepalese context evaluating the reliability of the Letournel and Judet classification for acetabular fractures. As a developing country, economic implications play a vital role in service delivery. This study provides valuable insights into the reliability of a widely used classification system, which could inform clinical practice and training programs in similar settings.

The study's strengths include the use of a prospective design, the inclusion of a representative sample of patients, and the rigorous assessment of both interobserver reliability and intraobserver repeatability. The inclusion of experienced surgeons and the comparison of classifications using plain radiographs and CT scans add robustness to the findings.

However, the study also has limitations. The sample size of 45 patients, while adequate for initial reliability assessment, may limit the generalizability of the findings. Additionally, the study was conducted in a single hospital setting, which may not fully represent the variability in clinical practice across different institutions. The potential for observer bias, despite efforts to blind observers, cannot be entirely eliminated. Lastly, the study did not explore the impact of additional training or standardized guidelines on improving classification reliability, which could be an area for future research.

In conclusion, this study contributes to the understanding of the reliability of the L-J classification for acetabular fractures, offering essential information for its effective implementation in clinical practice. The findings highlight the importance of CT imaging in enhancing classification consistency and suggest areas for further investigation to optimize fracture assessment and treatment outcomes.

Ethics statement and conflict of interest disclosures

Human subjects: Consent was obtained or waived by all participants in this study. B&B Institutional Review Committee - B&B IRC issued approval B&BIRC-22-16. Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue. Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following.

CRediT authorship contribution statement

Deependra Yadav: Concept and design, Acquisition, analysis, or interpretation of data, Drafting of the manuscript, All authors have reviewed the final version to be published and agreed to be accountable for all aspects of the work. Bibek Banskota: Concept and design, Acquisition, analysis, or interpretation of data, Drafting of the manuscript, Critical review of the manuscript for important intellectual content, All authors have reviewed the final version to be published and agreed to be accountable for all aspects of the work. Rajendra Aryal: Concept and design, Acquisition, analysis, or interpretation of data, Drafting of the manuscript, Critical review of the manuscript for important intellectual content, All authors have reviewed the final version to be published and agreed to be accountable for all aspects of the work. Nitesh raj Pandey: Concept and design, Acquisition, analysis, or interpretation of data, Drafting of the manuscript. Ansul raj Bhandari: Concept and design, Acquisition, analysis, or interpretation of data, Drafting of the manuscript, Critical review of the manuscript for important intellectual content, All authors have reviewed the final version to be published and agreed to be accountable for all aspects of the work. Rajan Bhusal: Concept and design, Acquisition, analysis, or interpretation of data, Drafting of the manuscript, Critical review of the manuscript for important intellectual content, All authors have reviewed the final version to be published and agreed to be accountable for all aspects of the work. Ashok Kumar Banskota: Concept and design, Acquisition, analysis, or interpretation of data, Drafting of the manuscript, Critical review of the manuscript for important intellectual content, Supervision, All authors have reviewed the final version to be published and agreed to be accountable for all aspects of the work.

Funding statement

Payment/services info: All authors have declared that no financial support was received from any organization for the submitted work. Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work. Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work.

References

  1. , , , , , . Can the use of a free mobile phone inclinometer application improve the accuracy of coronal cup position during total hip arthroplasty? J Orthop Reports 2024 May
    [Google Scholar]
  2. , , , , . Fractures of the acetabulum in patients aged 60 years and older. J Bone Joint Surg Br. 2010 Feb;92-B(2):250-257.
    [Google Scholar]
  3. , , , , . Current concepts: managing acetabular fractures in the elderly population. Eur J Orthop Surg Traumatol. 2021 Jul 27;31(5):807-816.
    [Google Scholar]
  4. , , . Classifications in brief: Letournel classification for acetabular fractures. Clin Orthop Relat Res. 2014 Jan;472(1):35-38.
    [Google Scholar]
  5. , , . Measurement of observer agreement. Radiology. 2003 Aug;228(2):303-308.
    [Google Scholar]
  6. , , , et al . Interobserver and intraobserver reliabilities of three-dimensional postoperative evaluation software in total hip arthroplasty. Adv Orthop. 2021;2021:1-20.
    [Google Scholar]
  7. , , , , , , . Interobserver and intraobserver agreement for Letournel acetabular fracture classification system using 3-dimensional printed solid models. World J Orthoped. 2021 Feb 18;12(2):82-93.
    [Google Scholar]
  8. , , , . Letournel classification for acetabular fractures. Assessment of interobserver and intraobserver reliability. J Bone Joint Surg Am. 2003 Sep;85(9):1704-1709.
    [Google Scholar]
  9. , , , , . The management of osteoporotic acetabular fractures: current methods and future developments. Surgery (St Louis). 2021 Oct;19(5):e289-e297.
    [Google Scholar]
  10. , , , et al . Treatment modalities and outcomes following acetabular fractures in the elderly: a systematic review. Eur J Orthop Surg Traumatol. 2022 May 2;32(4):649-659.
    [Google Scholar]
  11. , , , . Assessment of interobserver reliability for the letournel and judet classification. Acta Ortopédica Bras. 2024;32(1)
    [Google Scholar]
  12. , , , et al . Inter-rater and intra-rater reliability in the radiographic diagnosis of growth arrest in paediatric physeal fractures. Indian J Orthop. 2021 Jul 17;55(S2):445-451.
    [Google Scholar]
  13. , , , , , . Evaluation of Letournel and Judet classification of acetabular fracture with Plain Radiographs and three-dimensional computerized tomographic scan. J Orthop Surg. 2000 Jun 4;8(1):33-37.
    [Google Scholar]
  14. , , , et al . Intra- and inter-observer reliability assessment of widely used classifications and the “Ten-segment classification” of tibial plateau fractures. Knee. 2022 Mar;35:149-156.
    [Google Scholar]
  15. , , , , . Interobserver agreement for Letournel acetabular fracture classification with multidetector CT: are standard Judet radiographs necessary? Radiology. 2006 Nov;241(2):386-391.
    [Google Scholar]
Show Sections