Registry
Outcomes
Comments
American College of Surgeons National Surgical Quality Improvement Program
Operative morbidity and mortality
Developed risk models for specific complications [21]
The Society of Thoracic Surgeons, National Database
Morbidity and mortality following cardiac surgery
Has been credited with improving outcomes following cardiac surgery [35]
New York State Cardiac Surgery Reporting System
Risk-adjusted outcomes following coronary artery bypass surgery
Decreases in risk-adjusted mortality, cessation of cardiac surgery by low-volume, high-mortality surgeons, several hospital-specific quality improvement programmes have been initiated [36]
SWEDEHEART
ST-elevation myocardial infarction
Decrease in short- and long-term mortality, data entered to a web-based interface [37]
The Danish Knee Arthroplasty Register
Quality outcomes including implant survival
Large epidemiological studies performed to study trends as well as risk factors for poor clinical outcome [38]
Swedish rheumatology registries
Long-term safety and cost
Longitudinal studies address issues not well evaluated in controlled clinical trials [39]
French registries in rheumatoid arthritis and autoimmune diseases
Nationwide study to investigate the safety of biological agents
Higher risk of tuberculosis, Legionella pneumophila, lymphoma [40]
The VASCUNET Registry
Compared vascular surgical practice
Significant variations in practice [41]
20-year cohort study on total knee arthroplasty
Perioperative nerve injury
Nerve injury not associated with regional anaesthesia [42]
Registry of ultrasound-guided regional anaesthesia shoulder surgery
Neurologic
Low incidence of neurologic symptoms, none permanent
Respiratory (single-centre study)
Incidence of dyspnoea (7–10 %), hoarseness (22–31 %) [43]
Clinical registry of peripheral nerve blockade
Neurologic
Neurologic symptoms, 0.09 at 6 months [44]
LAST (single-centre study)
Registry of shoulder surgery in sitting position with interscalene nerve block
Postoperative stroke (single-centre study)
One ischemic stroke at 24 h [45]
Pediatric Regional Anesthesia Network (PRAN)
Neurologic (multicentre study)
Low rate of complications [46]
Multicenter Perioperative Outcomes Group Research Consortium (MPOG)
Epidural hematoma requiring laminectomy
One event per 22,189 placements to 1 event per 4330 placements (95 % CI) [47]
Challenges in Managing a Clinical Registry
There are no formal requirements for the conduct of managing a clinical registry although there are operational documents referenced in peer-reviewed articles. An example is a 2010 editorial [23], that references (citation number [15] of the editorial) the Australian Commission on Safety and Quality in Health Care, Operating principles and Technical standards for Australian clinical quality registries. The registry imperative is evolving and perhaps this is indicated by the comprehensive policy document published in 2011 by the American Heart Association, in the journal Circulation [24]. This is in contrast to the long-standing existence of documents that clearly outline how to design, execute and report the results of a RCT [45, 46].
Registries aim to have complete, or almost complete, capture of all eligible procedures, thereby minimizing selection and enrolment bias [23]. Capturing a complete, or near complete, patient population with sequential enrolment is the goal. Registries operate as “business as usual”, with no cherry picking of good results and include both good and bad outcomes. Other challenges include providing timely feedback to collaborators, privacy issues, management of a large dataset, and access to individuals with appropriate statistical or epidemiological expertise, funding and intellectual rights in the case of multicentre involvement .
Data Elements, Definitions and Quality Control
The data elements that registries collect need to be carefully considered and should be epidemiologically sound, meaning that the data should be simple, objective and reproducible. Examples of appropriate data to collect include patient demographics, surgical characteristics and anaesthetic type and dosage, other practice patterns and clinical effectiveness outcomes. The data elements need not be static, but rather change according to the important clinical questions that need to be addressed. The dataset for a registry should be simple and only data that are required to address the question or issue of interest should be collected. Logistically the data should be simple enough that physicians can efficiently enter information in a database in the context of a busy clinical practice.
For ARAC , data were recorded relating to the performance and effectiveness of PNB , adverse effects and complications. These data included a unique patient code, date of procedure, operation type, needle bevel type, local anaesthetic and dose, level of sedation and block success. PNB type was recorded: interscalene, periclavicular, axillary, distal humeral/forearm, femoral/fascia iliaca, sciatic, other peripheral lower limb nerves and trunk blocks. The technology used to locate plexus/nerves was recorded: ultrasound alone, nerve stimulator alone, ultrasound and nerve stimulator and other. The definitions used for this project were available online at www.regional.anaesthesia.org.au. The timing of follow-up for potential neurologic complications was either at 7–10 days or 6 weeks postoperatively, depending on practice location and time period. Patients were not considered to be uncontactable by phone until four attempts had been made at different times and using alternative phone numbers, including a mobile number if available. To detect potential neurologic complications patients were asked a standardized set of questions: Do you have any numbness? Do you have any tingling? Do you have any abnormal sensations? Do you have any pain? Do you have any weakness? These questions were asked in relation to the operative limb, and if the patient responded with “yes” to any of the questions, then further queries were made taking into account the anatomy relevant to the surgery and the PNB . Symptoms that were immediately adjacent to the wound, consistent with normal tissue healing or the initial trauma were not considered relevant in terms of anaesthesia being a causal factor. Symptoms that clearly were not related to the PNB were not considered significant. For patients with ambiguous symptoms or complaints, repeat contact was made with the patient. Triggers for referral to a neurologist were new onset of motor and/or sensory deficit; non-resolving paraesthesia; pain; allodynia; or dysaesthesia and any concern expressed by the surgical team regarding the potential for a PNB-related neurologic deficit. Assessment by the neurologist included history, examination, documentation and investigation. Investigations included electrodiagnostic tests [nerve conduction studies and/or an electromyogram], imaging [computed tomography, magnetic resonance imaging] and blood tests.
Data quality control was enhanced by the following methods:
- 1.
Valid outcome definitions—for key data items, explicit definitions were given and were available online, and their existence and importance were communicated to collaborators.
- 2.
Timing of data collection—the practitioner performing the procedure collected the initial data close to the point of care in theatre. The early postoperative data were collected directly from the patients on the wards or by phone.
- 3.
Training of data collectors—this was undertaken to communicate the goals of the project and familiarize personnel with the required methods of data collection.
- 4.
Electronic database—this was utilized throughout the project and for key data; drop-down menus were utilized.
- 5.
Standardized data collection form—standardized data collection forms were generated for postoperative follow-up and included the neurologic questionnaire.
- 6.
Missing data or unrealistic data—this was dealt with in a proactive manner taking into account the resources available. Because missing follow-up data was a threat to the validity of the key outcome, neurologic complications, this was a priority in monthly reports and other communications. Regular spot checks were made and queries sent back to local hospital collaborators. During analysis, the database was screened for erroneous and unrealistic data. Depending on the data type, the following methods were utilized: (A) Obviously erroneous non-essential data or combinations of data were eliminated (e.g. unrealistic combinations of height and weight), (B) Statistical techniques that were less sensitive to outliers were utilized for summary statistics and (C) Key outcomes such as major complications were confirmed with site collaborators.
When ARAC was completed, there was no other large-scale investigation into the safety of ultrasound-guided PNB [47]. The web-based interface utilized in ARAC facilitated ease of data entry, multicentre collaboration and collection of data from a large patient cohort. This project set up the foundation to develop a larger, more comprehensive clinical registry.
Development of an International Registry of Regional Anesthesia
To further develop the registry a comprehensive new online interface (www.anesthesiaregistry.org) and secure remote database were created. The new online interface had features that enhanced its quality including improved security, ease of use and functionality, improved reporting, rules enforcement, audit trail of changes to data and improved data quality control (for example, context specific drop-down menus and criteria based entry). Because the new interface was more complex, specific training was implemented for data collectors and collaborators so as to familiarize them with the new interface at www.anaesthesiaregistry.org. A broader range of outcomes was incorporated including clinical effectiveness outcomes, patient-rated outcomes, wrong-site block and respiratory complications. Development of the registry included expanding the patient cohort available for analysis and refinement of outcomes measuring clinical effectiveness. Additional patient and block related fields and patient-rated outcomes were included in the new online interface, introduced into practice on June 1st 2011.