Abstract
This study aimed to compare the disinfectant ability of chlorhexidine (CHX) gel and sodium hypochlorite (NaOCl). Systematic searches were conducted from inception until December 8th, 2022 (MEDLINE/PubMed, Cochrane Library, Web of Science, Scopus, Embase, and Grey Literature databases). Only randomized clinical trials were included. The revised Cochrane risk of bias tools for randomized trials were used to assess the quality of studies. Meta-analyses were performed. The overall quality of evidence was assessed through the Grading of Recommendations Assessment, Development, and Evaluation tool. Six studies were included. Five had a low risk of bias and 1 had some concerns. Three studies assessed bacterial reduction. Two were included in the meta-analysis for bacterial reduction (mean difference, 75.03 [confidence interval, CI, −271.15, 421.22], p = 0.67; I2 = 74%); and 3 in the meta-analysis for cultivable bacteria after chemomechanical preparation (odds ratio, 1.03 [CI, 0.20, 5.31], P = 0.98; I2 = 49%). Five studies assessed endotoxin reduction. Three were included in a meta-analysis (mean difference, 20.59 [CI, −36.41, 77.59], p = 0.48; I2 = 74%). There seems to be no difference in the disinfectant ability of CHX gel and NaOCl, but further research is necessary.
-
Keywords: Bacteria; Chlorhexidine; Endotoxin; Sodium hypochlorite; Systematic review
INTRODUCTION
The main purpose of root canal treatment in necrotic cases is to reduce the infectious content load to subcritical levels compatible with the healing process [
1,
2]. The greatest challenge in achieving this purpose is the association of the complexity of the root canal morphology with the limited range of action of the instruments during root canal preparation [
3,
4,
5]. These limitations can imply bacterial maintenance and its sub-products within the root canal, which can lead to treatment failure [
5,
6].
In order to ensure maximum reduction of the infectious content load, several substances have been tested as irrigants to be used during chemomechanical preparation [
7,
8,
9]. Among these, the most used are sodium hypochlorite (NaOCl) and chlorhexidine (CHX) digluconate. NaOCl is a time/volume/concentration dependent substance that possesses antibacterial properties, fat and organic tissue dissolution capabilities [
10,
11,
12,
13,
14]. Regarding NaOCl antibacterial mechanism of action, its effectiveness is based on its high pH, influenced by the release of hydroxyl ions, interfering in the cytoplasmic membrane integrity, causing an irreversible enzymatic inhibition, biosynthetic alteration in cellular metabolism and phospholipid degradation which can be observed in lipidic peroxidation [
10]. An amino acid chlorination reaction occurs, forming chloramines, that interfere with cellular metabolism. In addition, an oxidation promotes an irreversible bacterial enzymatic inhibition replacing hydrogen with chlorine, causing this inactivation, which can be observed in the reaction of chlorine with amino groups and an irreversible oxidation of sulfhydryl groups of bacterial enzymes, like cysteine [
10].
CHX, usually used in a liquid formulation, is a cationic bisbiguanide that presents an antifungal effect, and is a potent bacteriostatic in low concentrations (0.2%) and bactericidal in higher concentrations (2%) [
15]. The primary characteristic of this substance is its capacity to adhere to dentin and deliver a sustained antimicrobial effect (substantivity) [
15,
16]. Nevertheless, the substantivity of CHX has yet to be proven in clinical conditions [
17]. Its antibacterial activity occurs when its cationic molecule binds to the extracellular complexes and negatively charged bacterial cell walls, altering the osmotic equilibrium of the bacterial cells [
16]. This reaction increases the permeability of the cell wall, allowing the CHX molecule to penetrate into the bacteria [
15]. The use of this substance during chemomechanical preparation is based on the concept that CHX may be less toxic to the periapical tissues when compared to NaOCl [
18]. However, this premise presents divergent results in the literature [
19,
20]. On the other hand, CHX does not present the ability to dissolve necrotic tissue remnants or to disrupt biofilm structures [
14,
21]. Nevertheless, regarding infectious content reduction, it demonstrates satisfactory results [
22,
23].
Some authors proposed CHX on its gel formulation to be used as an intracanal dressing alone or combined with calcium hydroxide [
24,
25,
26]. Additionally, the use of CHX on its gel formulation during chemomechanical preparation has been proposed. In these situations, its usage presupposes that, despite presenting the same properties as the liquid formulation, the gel formulation would promote a reduction of the smear layer formation due to its rheological action, presenting a greater lubricant activity, reducing the friction between the instrument and the dentin surface, facilitating the removal of organic tissues and reducing the incidence of instrument fracture [
16,
27].
Previous
in vitro studies investigating the disinfection capacity of CHX gel compared to liquid CHX and NaOCl have shown that CHX gel takes a longer time to eliminate bacteria [
28,
29]. However, these results are based on methodologies that directly immersed single-species biofilm membranes on tubes containing the investigated solutions, which does not necessarily reflect the conditions of clinical practices [
28,
29]. Additionally, previous systematic reviews evaluating the capacity of NaOCl and CHX on the reduction of the infectious content already exist, none of these studies specifically evaluate CHX in its gel form, which could potentially overestimate the disinfectant effectiveness of this formulation, when compared to the liquid form [
30,
31,
32,
33]. When liquid CHX is used during chemomechanical preparation, the root canal is constantly flooded by the solution, exerting its effects constantly during treatment. However, when using CHX gel, the working method involves the use of a small amount of CHX gel during instrumentation, followed by irrigation with an inert solution. Based on this, it is possible to hypothesize that the short time of action exerted by CHX gel would not generate the desired decontamination effects. Additionally, it is important to emphasize that CHX in its gel form is viscous, therefore, it may not be appropriately delivered through the entire root canal, which could also hamper its disinfection capability.
Since the reduction of the infectious content (bacterial and endotoxins) is mandatory to achieve success during endodontic therapies, it is necessary to evaluate, prior to clinical application, the available evidence regarding the performance of CHX gel on such aspects. Hence, a systematic review that only evaluates the capacity of CHX gel, when compared to NaOCl, on bacterial and endotoxin reduction is necessary. For this reason, the current systematic review aimed to answer the following question: “Is CHX gel as effective as NaOCl in disinfecting the root canal system?”
MATERIALS AND METHODS
Protocol and registration
This systematic review followed the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA)recommendation (
http://wwwprisma-statement.org) and was registered on the PROSPERO database under the number CRD42020211315 [
34].
Search strategy
The search was performed independently by 2 examiners (T.W. and M.V.R.S.) in the following electronic databases: MEDLINE/PubMed, Cochrane Library, Web of Science, Scopus, Embase, and Grey Literature Reports. The search was conducted from inception up to December 8th, 2022, without language and year restriction. The electronic search strategy was developed using the most cited descriptors in previous publications on this theme combining Medical Subject Heading terms and text words (tw.). For each database, the following terms were combined: “Root canal”, “Root canal therapy”, “Root canal treatment”, “Endodont*”, “Chlorhexidine”, “CHX”, “Chlorhexidine gel”, “CHX gel”, “Irrigant”, “Root canal irrigant”, “Sodium hypochlorite”, “NaOCl”, “Microb*”, “Microbial consortia”, “Disinfection”, “Bacteria” “Bacterial reduction”, “Microorganism”, “Endotoxin”, “Lipopolysaccharide”, “LPS”, “Lipoteichoic acid”, “LTA”. The Boolean operators ‘AND’ and ‘OR’ were applied to combine the terms and create a search strategy.
The search strategies for each database and the following findings are summarized in
Supplementary Table 1. An additional screening of the references of the selected studies was performed, and the related articles were searched in the PubMed database. All articles selected were imported into the Mendeley© (Mendeley Ltd., London, United Kingdom) reference manager to catalogue the references and facilitate the exclusion of duplicates.
Eligibility criteria
The eligibility criteria were based on the PICOS strategy (PRISMA-P 2015), as follows [
34,
35,
36]:
• Population (P): Adult patients subjected to root canal treatment or retreatment presenting symptomatic or asymptomatic apical periodontitis;
• Intervention (I): Root canal treatment using CHX gel as an adjunct substance during root canal preparation;
• Comparison (C): Root canal preparation using liquid NaOCl;
• Outcome (O): Primary: bacterial and/or endotoxin reduction;
Secondary: periapical healing.
• Study design (S): Only randomized clinical trials (RCTs).
Study selection
The first stage consisted of excluding the duplicated studies, considering only once, and examining the retrieved titles and abstracts of the selected studies by 2 independent authors (T.W. and M.V.R.S.). When it was not possible to judge the studies by title and abstract, the full text was accessed and read for the final decision. The second stage consisted of reading the potentially eligible studies' full texts based on the eligibility criteria through the PICOS strategy. Disagreements on study inclusion were solved by a consensus with a third author (E.J.N.L.S.)
Data extraction
Two authors (T.W. and M.V.R.S.) independently collected the data from the included studies. Disagreements were solved by a third author (E.J.N.L.S.). The following data were extracted from the included studies: author(s), year of publication, assessed outcome, sample size (per group), teeth evaluated, intervention, irrigants, concentration, volume, method of endotoxin collection, method of endotoxin measurement, method of bacterial collection, method of bacterial measurement, moments of evaluation, outcomes, main findings. In cases of missing data, the authors were contacted 3 times by e-mail.
Quality assessment
The methodological risk assessment of bias for each study was performed by 2 independent authors (T.W. and M.V.R.S.), and, in case of disagreement, it was resolved by a third author (E.J.N.L.S.).
The qualitative analysis of the randomized studies was performed using the Cochrane risk of bias tool for RCTs (Cochrane Risk of Bias 2 - RoB2): ‘Bias Risk Assessment of Randomized Controlled Studies’ – Cochrane Handbook 6.0 [
37]. The following domains were considered: randomization process; deviations from intended interventions; missing outcome data; measurement of the outcome; selection of the reported results.
Each included study was judged as ‘high’ risk of bias for negative domain response (red), ‘low’ risk of bias for positive domain response (green), and risk of ‘some concerns’ bias (yellow) when the response was not clear. When the study was judged as ‘some concerns’, the authors were contacted by email at least 3 times for more information and allowed to be classified as ‘low’ (green) or ‘high’ (red) risk of bias. Once this information was not possible to be acquired, the articles remained with some ‘some concerns’ bias risks. Overall quality was based on the scores in individual domains. When it was verified a low risk of bias for all domains, the overall quality was of low risk of bias. When at least 1 domain was of some concerns risk, the overall quality was some concerns risk of bias. Also, the assessment of at least 1 domain as high risk or 3 or more domains as some concerns risk resulted in an overall quality of high risk of bias.
Quantitative analysis
Meta-analysis was performed on the included studies that provided data regarding bacterial reduction, samples presenting cultivable bacteria after chemomechanical preparation, and endotoxin reduction, using RevMan software (version 5.3, The Cochrane Collaboration). The mean difference was used to assess bacterial reduction and endotoxin reduction (by entering means and standard deviations for continuous data), and odds ratio was used to assess the presence of cultivable bacteria after chemomechanical preparation (by entering the number of positive samples in each of the intervention groups for dichotomous data) [
38]. In case of missing data, the authors were contacted to provide additional information. The statistical heterogeneity was assessed using the T
2, Cochran Q test and
I2 statistics. An
I2 statistic below 30% was considered as not important, between 30% and 60% was considered as moderate heterogeneity, between 50% and 90% as substantial heterogeneity, and over 75% was considered as considerable heterogeneity [
38,
39]. If possible, sensitivity analysis was performed excluding studies presenting ‘some concerns’ or ‘high’ risk of bias and studies that performed root canal treatments or retreatments. Publication bias will be visually assessed by the generation of funnel plots only when 10 or more studies are included in a meta-analysis [
40].
Strength of evidence
The strength of the evidence of the included studies was assessed using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) tool (GRADEpro GDT: GRADEpro Guideline Development Tool [Software]). McMaster University, 2015 (developed by Evidence Prime, Inc.), available from gradepro.org:
https://gdt.gradepro.org/app/handbook/handbook.html#h.rkkjpmwb6m6z [
41]. The GRADE tool has 5 domains that can be downgraded and reduce the quality of the evidence. The following domains were considered to assess the strength of the evidence: risk of bias; inconsistency; indirectness; imprecision; other considerations.
RESULTS
Study selection
Initial screening of databases resulted in 2.765 studies identified, where 1.305 were excluded as they were duplicates, as presented in
Figure 1. After title and abstract reading, 1.451 records were excluded and 9 studies matched the inclusion criteria [
23,
42,
43,
44,
45,
46,
47,
48,
49].
Figure 1Flow diagram of the systematic search according to Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) guidelines.
After full-text reading, 3 studies were excluded [
23,
42,
43]. One study for not presenting the data after chemomechanical preparation; 1 study for using liquid CHX instead of CHX gel; and 1 study for not comparing the results with a NaOCl group [
23,
42,
43]. Therefore, 6 studies were included for analysis in the present systematic review [
44,
45,
46,
47,
48,
49].
Data extraction
Table 1 presents the characteristics and main findings of the included studies.
Table 1Characteristics and main findings of the included studies
Author(s) (year of publication) |
Assessed outcome |
Sample size (per group) |
Teeth evaluated/diagnosis |
Intervention |
Irrigants/concentration/protocol |
Method of endotoxin collection |
Method of endotoxin measurement |
Method of bacterial collection |
Method of bacterial measurement |
Moments of evaluation |
Outcomes |
Main findings |
Barbosa-Ribeiro et al. (2016) [49] |
Bacterial and endotoxin (LTA) reduction |
20 (CHX gel – n = 10; NaOCl – n = 10) |
Uniradicular teeth with a single root canal/symptomatic or asymptomatic apical periodontitis |
Non-surgical retreatment |
CHX gel: 2%/1 mL before each instrument and 5 mL saline solution rinse afterward with EndoVac System; NaOCl: 6%/1 mL before the use of each instrument and 5 mL rinse afterward with EndoVac System |
Sterile paper point |
Enzyme-linked immunosorbent assay |
Sterile paper point |
CFU technique |
S1: Before; S2: and after chemomechanical preparation; S3: After 30 days of intracanal medication (Ca(OH)2 + 2% CHX gel) |
S1: All samples presented cultivable bacteria and LTA; S2: 2% CHX gel reduced significantly more bacteria (99.3%–92.1%) and LTA (26.9%–22.6%) than 6% NaOCl; S3: Intracanal medication significantly decreased cultivable bacteria (99.5%) and LTA (38.6%), without differences between groups |
Reduction of cultivable bacteria was greater than the reduction of LTA in all phases of endodontic retreatment; intracanal medication favored a greater bacterial and LTA removal |
Gomes et al. (2009) [45] |
Endotoxin (LPS) reduction |
54 (CHX gel – n = 27; NaOCl – n = 27) |
Uniradicular teeth with a single root canal/asymptomatic apical periodontitis |
Non-surgical root canal treatment |
CHX gel: 2% /1 mL CHX gel + 4 mL of sterile saline solution before each instrument; NaOCl: 2.5%/5 mL following each instrument used |
Sterile/apyrogenic paper point |
LAL method, a modified LAL and a synthetic color-producing substrate to detect endotoxin chromogenically |
- |
- |
S1: Before; S2: and after chemomechanical preparation |
S1: Endotoxin was present in all samples; S2: Endotoxin reduction per group: 2,5% NaOCl – 57.98%; 2% CHX gel – 47.126% |
Both substances were not effective in completely removing endotoxins from primarily infected root canals; NaOCl presented a significantly higher reduction when compared to CHX gel |
Marinho et al. (2014) [47] |
Endotoxin (LPS) reduction |
30 (CHX gel – n: 10; NaOCl – n: 10; Saline solution – n: 10) |
Uniradicular teeth with a single root canal/asymptomatic apical periodontitis |
Non-surgical root canal treatment |
CHX gel: 2%/1 mL CHX gel + 5 mL of sterile saline solution following each instrument used; NaOCl: 2.5%/5 mL following each instrument used; Saline Solution (SS): 5 mL following each instrument used |
Sterile/apyrogenic paper point |
Turbidimetric kinetic limulus amoebocyte lysate (LAL) assay |
- |
- |
S1: Before; S2: and after chemo-mechanical preparation; S3: After 3 minutes of 17% EDTA; S4: After 30 days of intracanal medication (Ca(OH)2 + saline solution) |
S1: Endotoxins were present in all samples; S2: Reduction occurred in all groups without differences: 2,5% NaOCl – 99.65%; 2% CHX gel – 94.27%; SS – 96.79%; S3: 17% EDTA did not significantly decrease endotoxins; S4: Intracanal medication significantly reduced residual endotoxins compared to S3 (2,5% NaOCl – 90%; 2% CHX gel – 88.8%; SS: 85.7%), but without differences compared to S2 |
No differences were found among substances used during root canal preparation; the use of intracanal medication for 30 days contributed for improvement of the endotoxin reduction |
Marinho et al. (2015) [48] |
Endotoxin (LPS) reduction |
30 (CHX gel – n: 10; NaOCl – n: 10; Saline solution – n: 10) |
Uniradicular teeth with a single root canal/asymptomatic apical periodontitis |
Non-surgical root canal treatment |
CHX gel: 2% / 1 mL CHX gel + 5 mL of sterile saline solution following each instrument used; NaOCl: 2.5%/5 mL following each instrument used; Saline Solution (SS): 5 mL following each instrument used |
Sterile/apyrogenic paper point |
Turbidimetric kinetic LAL assay |
- |
- |
S1: Before; S2: and after chemo-mechanical preparation; S3: After 3 minutes of 17% EDTA; S4: After 30 days of intracanal medication (Ca(OH)2 + saline solution); S5: Before root canal obturation |
S1: Endotoxin was present in all samples; S2: Significant higher reduction was achieved with 2,5% NaOCl when compared to 2% CHX gel and SS; S3: 17% EDTA significantly improved endotoxin reduction in 2% CHX gel and SS groups, without differences between them; S4: Intracanal medication for 30 days significantly reduced endotoxins; S5: No differences were found between 2,5% NaOCl and 2% CHX gel groups, only when compared to SS group |
The greatest endotoxin reduction occurred after chemomechanical preparation; intracanal medication enhanced endotoxin reduction |
Vianna et al. (2006) [44] |
Bacterial reduction |
32 (CHX gel – n = 16; NaOCl – n = 16) |
Uniradicular teeth with a single root canal/asymptomatic apical periodontitis |
Non-surgical root canal treatment |
CHX gel: 2%/1 mL CHX gel + 4 mL of sterile saline solution after each instrument; NaOCl: 2.5%/5 mL following each instrument used |
- |
- |
Sterile paper points |
|
S1: Before; S2: and after chemomechanical preparation |
RTQ-PCR results: |
NaOCl has presented a higher capacity to kill microorganisms and to remove cells from the root canal |
|
S1: Bacterial loads of both groups were comparable; S2: Bacterial reduction was significantly different between groups, irrespective of the detection system (SYBR Green/TaqMan): NaOCl group -99.99%/99.63%; CHX gel group - 96.62%/96.60%; |
CFU results: |
|
S1: Microorganisms were detected in all samples; S2: Mean bacterial reduction was similar in both groups: NaOCl group -99.93%; CHX gel group – 99.69% |
Xavier et al. (2013) [46] |
Endotoxin (LPS) and bacterial reduction |
48 (CHX gel – n = 12; CHX gel + calcium hydroxide dressing – n = 12; NaOCl – n = 12; NaOCl + calcium hydroxide dressing – n = 12) |
Uniradicular teeth with a single root canal/asymptomatic apical periodontitis |
Non-surgical root canal treatment |
CHX gel: 2%/1 mL CHX gel + 4 mL of sterile saline solution before each instrument; NaOCl: 1%/5 mL following each instrument used; |
Sterile/apyrogenic paper points |
Kinetic chromogenic LAL assay |
Sterile/apyrogenic paper points |
CFU technique |
1-visit groups: |
Endotoxins: |
1- and 2-visit root canal treatment protocols were effective in reducing bacteria and endotoxins, but did not completely eliminate them; 2-visit treatment was more effective in reducing endotoxins than 1-visit treatment. |
|
S1: Before; S2: and after chemomechanical preparation |
|
Detected in all samples; 1- and 2-visit treatment significantly reduced endotoxins: 1% NaOCl: 86.33%;/98.01%; 2% CHX gel: 84.77%/96.81%; 2-visit treatment reduced more endotoxins than 1-visit |
2-visit groups: |
Bacteria: |
|
S1: Before chemomechanical preparation; S2: after calcium hydroxide removal |
|
Detected in all samples; 1- and 2-visit treatment significantly reduced bacteria, without differences: 1% NaOCl: 99.97%/99.90%; 2% CHX gel: 99.75%/96.62% |
Regarding the assessed outcomes, 1 study assessed bacterial reduction only; 3 studies assessed endotoxin reduction only; and 2 studies assessed bacterial and endotoxin reduction [
44,
45,
46,
47,
48,
49]. Of the studies that evaluated endotoxin reduction, only 1 study assessed lipoteichoic acid (LTA) reduction; and 4 studies assessed lipopolysaccharide (LPS) reduction [
45,
46,
47,
48,
49]. None of the included studies evaluated periapical healing.
In relation to the group of teeth evaluated, all studies included only uniradicular teeth with a single root canal [
44,
45,
46,
47,
48,
49]. Most of the studies included only patients with a diagnosis of asymptomatic apical periodontitis; and only 1 study included patients presenting a diagnosis of symptomatic and asymptomatic apical periodontitis [
44,
45,
46,
47,
48,
49]. As for the interventions, 1 study performed non-surgical root canal retreatment; and 5 studies [
44,
45,
46,
47,
48,
49] performed non-surgical root canal treatments.
Regarding bacterial assessment, 2 studies reported using sterile paper points for bacterial collection; and 1 study reported using sterile/apyrogenic paper points [
44,
45,
49]. Two studies reported using the colony forming unit (CFU) technique for bacterial measurement; and 1 study CFU technique and real-time quantitative-polymerase chain reaction using 2 different assay chemistries (SYBR Green PCR Master Mix, and TaqMan PCR Master Mix; Applied Biosystems, Waltham, MA, USA) [
44,
46,
49].
As for endotoxin assessment, 1 study reported using sterile paper points for endotoxin collection; and 4 studies reported using sterile/apyrogenic paper points [
44,
45,
46,
47,
48,
49]. One study reported using the enzyme-linked immunosorbent assay (ELISA) for endotoxin measurement; 1 study reported using a limulus amoebocyte lysate (LAL) method, a modified LAL and a synthetic color-producing substrate to detect endotoxin chromogenically; 2 studies reported a turbidimetric kinetic LAL assay; and 1 study a kinetic chromogenic LAL assay for endotoxin measurement [
45,
46,
47,
48,
49].
After chemo-mechanical preparation, 1 study reported a significantly higher bacterial and endotoxin reduction for the CHX gel group when compared to the NaOCl group; 2 studies reported a significantly higher endotoxin reduction for the NaOCl group; 1 study reported a significantly higher bacterial reduction for the NaOCl group; 2 studies reported no statistical differences between substances for endotoxin reduction; and 1 study reported no statistical differences between substances for bacterial reduction [
44,
45,
46,
47,
48,
49].
Quality assessment
Risk of bias in the included studies is summarized in
Figure 2 [
50]. From the 6 included studies, 5 studies were considered as presenting a low risk of bias, with all domains classified as low risk of bias [
44,
45,
47,
48,
49]. Only 1 study was considered as presenting some concerns risk of bias, with 1 domain (randomization) classified as some concerns risk [
46].
Figure 2Quality assessment of the included studies according to the Cochrane Collaboration common scheme for bias and RoB 2 tool.
Quantitative analysis
Meta-analysis was performed on 2 studies for bacterial reduction (
Figure 3A); 3 studies for the presence of cultivable bacteria after chemomechanical preparation (
Figure 3B); and 3 studies for endotoxin reduction (
Figure 3D) [
44,
45,
46,
48,
49]. Additional data regarding the values of endotoxin reduction from 2 studies, and additional data regarding samples with cultivable bacteria after chemomechanical preparation from 1 study were obtained through the corresponding author of these studies [
45,
47,
49]. Authors from another study were contacted for additional data regarding endotoxin reduction and although a response was obtained, no additional data was received and for this reason, the study was not included in the quantitative analysis of endotoxin reduction [
46]. Sample sobreposition was observed in 2 studies and, for this reason, only the latter was included in the quantitative analysis [
47,
48]. Additionally, since only 6 studies were included in the meta-analyses, no funnel plot was generated to detect publication bias.
Figure 3
Meta-analysis results. (A) Forest plot of bacterial reduction after chemomechanical preparation with chlorhexidine gel and sodium hypochlorite; (B) Forest plot of cultivable bacteria after chemomechanical preparation with chlorhexidine gel and sodium hypochlorite; (C) Forest plot of cultivable bacteria after sensitivity analysis that excluded values from Xavier et al. [46]; (D) Forest plot of endotoxin reduction after chemomechanical preparation with chlorhexidine gel and sodium hypochlorite; (E) Forest plot of endotoxin reduction after sensitivity analysis that considered only studies that performed root canal treatments.
CHX, chlorhexidine; NaOCl, sodium hypochlorite; SD, standard deviation; CI, confidence interval.
The authors used random-effects meta-analysis to produce the overall summaries due to the high heterogeneity. In relation to the bacterial reduction (
Figure 3A), the forest plot indicates that the data are considerably heterogeneous (
I2 = 74%) and that there were no statistically significant differences (
p = 0.67; CI, 75.03 [−271.15, 421.22]) among the irrigants. For the presence of cultivable bacteria after chemomechanical preparation (
Figure 3B), the forest plot indicates that the data presented moderate heterogeneity (
I2 = 49%), and the overall effect also demonstrated no statistically significant differences among irrigants (
p = 0.98; CI, 1.03 [0.20, 5.31]). A sensitivity analysis was performed by removing the study of Xavier
et al. [
46]. Results (
Figure 3C) indicate an overall high heterogeneity (
I2 = 74%) and the overall effect did not demonstrate statistically significant differences (
p = 0.85; CI, 0.73 [0.03, 20.67]). Regarding endotoxin reduction (
Figure 3D), the forest plot indicates that data were considerably heterogeneous (
I2 = 74%). Also, the overall effect demonstrated no statistically significant differences among irrigants (
p = 0.48; CI, 20.59 [−36.41, 77.59). A sensitivity analysis was performed by considering only studies that performed root canal treatments (
Figure 3E). Again, results indicate a high heterogeneity (
I2 = 82%) and an overall effect that do not indicate statistically significant differences among irrigants (
p = 0.31; CI, 55.15 [−50.34, 160.65]).
Strength of evidence
GRADE results are presented in
Table 2.
Table 2Assessment of quality of evidence of the included studies
No. of studies (study design) |
Risk of bias |
Inconsistency |
Indirectness |
Imprecision |
Other considerations |
Overall certainty of evidence |
6 randomized trials |
Not serious |
Serious*
|
Not serious |
Very serious†
|
None |
⨁◯◯◯ |
VERY LOW |
The GRADE tool demonstrated a very low quality of evidence for the included studies [
44,
45,
46,
47,
48,
49]. The studies received the “not serious” classification for risk of bias and indirectness, “serious” classification for inconsistency, and “very serious” classification for imprecision. Other considerations domain did not influence the quality of evidence.
DISCUSSION
This is the first systematic review that sought to encompass only studies that investigated the disinfectant effectiveness of CHX on its gel formulation compared to NaOCl. So far, previous systematic reviews evaluating the disinfecting effectiveness of NaOCl and CHX comprise both liquid and gel formulations in the same analyses, which prevents direct comparison of results [
30,
31,
32,
33]. Therefore, it is not possible to determine whether the CHX gel could exert the same disinfectant effectiveness compared to NaOCl.
In this systematic review, both bacterial reduction and cultivable bacteria after chemomechanical preparation were evaluated, and no statistical differences were observed in both methods (
p = 0.67 and
p = 0.98, respectively). Additionally, 1 sensitivity analysis was performed for cultivable bacteria, excluding the study by Xavier
et al. [
46], since this had a “some concerns” risk of bias. Again, sensitivity analysis also pointed to no statistical differences (
p = 0.85). Although slight differences can be observed in the methodology adopted by the included studies, these results suggest that both substances can successfully reduce the bacterial content of the root canal during chemomechanical preparation [
44,
46,
49].
As for the detoxification (endotoxins –LPS or LTA - removal) activity of both substances, previous studies have shown limited efficacy for both CHX and NaOCl [
51,
52,
53,
54,
55]. Only 1 study demonstrated that NaOCl in higher concentrations (5.25%) was able to induce loss of detection of lipid A peaks and no detection of LPS bands in an
in vitro model, suggesting a concentration-dependent detoxification activity [
55]. However, based on the included studies, the available evidence suggests that the major content of endotoxin removal occurs through the mechanical debridement of the root canal, irrespective of the irrigant solution used (
p = 0.48) [
44,
45,
46,
47,
48,
49].
Nevertheless, these findings present major limitations. A moderate to high heterogeneity was observed (37%–82%). This may be related to the small number of studies included in the meta-analyses or to clinical diversities that are not possible to be determined through the information presented by the studies [
38]. Additionally, another important limitation is that none of the included studies had presented a sample size calculation [
44,
45,
46,
47,
48,
49]. Sample size calculation ensures that the sample size is adequate for the study, otherwise, it may be not possible to detect true differences in outcomes between investigated groups (type II error), or wrongly conclude that 1 intervention is more effective than the other when, in fact, it is not (type I error) [
56]. Thus, increasing the heterogeneity shown by the presented forest plots.
All studies performed their evaluations only in uniradicular teeth with a single root canal [
44,
45,
46,
47,
48,
49]. It is well known that the anatomic complexity of the root canal system associated with the biofilms’ organization and its defensive capacity against chemical solutions are important factors that can predict treatments failure [
57,
58]. Also, CHX does not present the capacity to dissolve necrotic tissue remnants or to disrupt biofilm structures [
8,
14,
21,
59]. Therefore, its disinfectant ability may be impaired in complex anatomies, such as isthmus, flattened root canals and apical ramifications. Although mechanical debridement can significantly reduce the infectious content from the root canal, the instruments action is limited, especially in complex anatomies, regardless of the instrument used [
5,
60]. Thus, the present findings may overestimate the true effectiveness of the solution, especially for having evaluated teeth with little anatomical complexities.
Second, none of the included studies reported for retention time of irrigants inside the root canal during chemomechanical preparation. This fact, associated with the low volumes of irrigants used among the included studies, can be considered a limitation, since it is reported that a longer exposure time and a higher volume of NaOCl during chemomechanical procedures can promote a significantly greater bacterial elimination [
11,
44,
45,
46,
47,
48,
49,
61].
In addition, none of the studies evaluated the periapical healing of the tested treatment protocols. Periapical healing is directly related to the long-term success of root canal therapy and, thereby, can be considered as the true clinical outcome. Since, so far, no study has verified periapical healing when using CHX gel, it is not possible to determine whether the use of this substance can influence or not the long-term success of the therapy.
It is important to emphasize that 5 studies had a low risk of bias, and only 1 study had some concerns due to bias arising from the randomization process [
44,
45,
46,
47,
48,
49]. In this study, the authors stated that a randomization was performed, but did not describe the randomization and nor the allocation concealment method [
46].
As for the overall quality of evidence, the classification provided by the GRADE tool was of very low quality. The domain ‘risk of bias’ received the not serious classification, because none of the included studies had a high risk of bias [
62]. The domain ‘inconsistency’ received a serious classification, since a substantial heterogeneity was verified among the included studies, as presented in the meta-analysis results [
63]. The domain ‘indirectness’ received the not serious classification, since no included studies performed indirect comparisons or presented indirect results [
64]. The domain ‘imprecision’ received a very serious classification, because the optimal information size (pooled sample size of 300) was not met and confidence intervals were under 0.75 or above 1.25 [
65]. Regarding the domain ‘other considerations’, none of the domains’ criteria (publication bias, large effect, plausible confounding and dose-response gradient) were observed in the included studies [
66].
This systematic review confirms the need for well-conducted research, with a great need for studies evaluating the disinfectant ability of CHX gel on teeth presenting anatomical complexities and long-term studies evaluating the periapical healing of teeth subjected to root canal treatment where CHX gel is used during chemomechanical preparation, prior to its application in clinical practice. So far, although the results of the present systematic review suggest no differences in the disinfectant ability of CHX gel and NaOCl, this suggestion is based on studies presenting important limitations and in a very low quality of evidence. Thus, the use of CHX gel during clinical practice should not be recommended in the absence of better-quality information.
CONCLUSION
This study aimed to verify the capacity of CHX gel compared to NaOCl on bacteria and endotoxins reduction and, based on the findings of this systematic review, there seem to be no differences in the disinfectant ability of both substances. However, these findings must be cautiously interpreted since are based on limited studies with very low certainty of evidence.
ARTICLE INFORMATION
-
Conflict of Interest: No potential conflict of interest relevant to this article was reported.
-
Author Contributions:
Conceptualization: Weissheimer T, Só MVR.
Data curation: Weissheimer T, Pinto KP, da Silva EJNL, Só MVR.
Formal analysis: Weissheimer T, Pinto KP.
Investigation: Weissheimer T, Pinto KP.
Methodology: Weissheimer T, Pinto KP.
Project administration: da Rosa RA, Só MVR.
Supervision: Só MVR.
Writing - original draft: Weissheimer T.
Writing - review & editing: Hashizume LN.
SUPPLEMENTARY MATERIAL
REFERENCES
- 1. Siqueira JF Jr, Rôças IN. Clinical implications and microbiology of bacterial persistence after treatment procedures. J Endod 2008;34:1291-1301.e3. ArticlePubMed
- 2. Machado FP, Khoury RD, Toia CC, Flores Orozco EI, de Oliveira FE, de Oliveira LD, et al. Primary versus post-treatment apical periodontitis: microbial composition, lipopolysaccharides and lipoteichoic acid levels, signs and symptoms. Clin Oral Investig 2020;24:3169-3179.PubMed
- 3. Mazzi-Chaves JF, Silva-Sousa YTC, Leoni GB, Silva-Sousa AC, Estrela L, Estrela C, et al. Micro-computed tomographic assessment of the variability and morphological features of root canal system and their ramifications. J Appl Oral Sci 2020;28:e20190393. ArticlePubMedPMC
- 4. Almeida BM, Provenzano JC, Marceliano-Alves MF, Rôças IN, Siqueira JF Jr. Matching the dimensions of currently available instruments with the apical diameters of mandibular molar mesial root canals obtained by micro–computed tomography. J Endod 2019;45:756-760. ArticlePubMed
- 5. Siqueira Junior JF, Rôças IDN, Marceliano-Alves MF, Pérez AR, Ricucci D. Unprepared root canal surface areas: causes, clinical implications, and therapeutic strategies. Braz Oral Res 2018;32:e65. PubMed
- 6. Siqueira JF Jr, Pérez AR, Marceliano-Alves MF, Provenzano JC, Silva SG, Pires FR, et al. What happens to unprepared root canal walls: a correlative analysis using micro-computed tomography and histology/scanning electron microscopy. Int Endod J 2018;51:501-508. PubMed
- 7. Del Carpio-Perochena AE, Bramante CM, Duarte MAH, Cavenago BC, Villas-Boas MH, Graeff MS, et al. Biofilm dissolution and cleaning ability of different irrigant solutions on intraorally infected dentin. J Endod 2011;37:1134-1138. ArticlePubMed
- 8. Ordinola-Zapata R, Bramante CM, Cavenago B, Graeff MSZ, Gomes de Moraes I, Marciano M, et al. Antimicrobial effect of endodontic solutions used as final irrigants on a dentine biofilm model. Int Endod J 2012;45:162-168. ArticlePubMed
- 9. Ordinola-Zapata R, Bramante CM, Garcia RB, de Andrade FB, Bernardineli N, de Moraes IG, et al. The antimicrobial effect of new and conventional endodontic irrigants on intra-orally infected dentin. Acta Odontol Scand 2013;71:424-431. ArticlePubMed
- 10. Estrela C, Estrela CRA, Barbin EL, Spanó JCE, Marchesan MA, Pécora JD. Mechanism of action of sodium hypochlorite. Braz Dent J 2002;13:113-117. PubMed
- 11. Petridis X, Busanello FH, So MVR, Dijkstra RJB, Sharma PK, van der Sluis LWM. Factors affecting the chemical efficacy of 2% sodium hypochlorite against oral steady-state dual-species biofilms: exposure time and volume application. Int Endod J 2019;52:1182-1195. ArticlePubMedPMCPDF
- 12. Petridis X, Busanello FH, So MVR, Dijkstra RJB, Sharma PK, van der Sluis LWM. Chemical efficacy of several NaOCl concentrations on biofilms of different architecture: new insights on NaOCl working mechanisms. Int Endod J 2019;52:1773-1788. ArticlePubMedPMCPDF
- 13. Zehnder M. Root canal irrigants. J Endod 2006;32:389-398. ArticlePubMed
- 14. Busanello FH, Petridis X, So MVR, Dijkstra RJB, Sharma PK, van der Sluis LWM. Chemical biofilm removal capacity of endodontic irrigants as a function of biofilm structure: optical coherence tomography, confocal microscopy and viscoelasticity determination as integrated assessment tools. Int Endod J 2019;52:461-474. PubMed
- 15. Mohammadi Z, Abbott PV. The properties and applications of chlorhexidine in endodontics. Int Endod J 2009;42:288-302. ArticlePubMed
- 16. Gomes BPFA, Vianna ME, Zaia AA, Almeida JFA, Souza-Filho FJ, Ferraz CCR. Chlorhexidine in endodontics. Braz Dent J 2013;24:89-102. ArticlePubMed
- 17. Boutsioukis C, Arias-Moliz MT, Chávez de Paz LE. A critical analysis of research methods and experimental models to study irrigants and irrigation systems. Int Endod J 2022;55(Supplement 2):295-329. ArticlePubMedPMCPDF
- 18. Basrani B, Lemonie C. Chlorhexidine gluconate. Aust Endod J 2005;31:48-52. PubMed
- 19. Prado M, Silva EJNL, Duque TM, Zaia AA, Ferraz CCR, Almeida JFA, et al. Antimicrobial and cytotoxic effects of phosphoric acid solution compared to other root canal irrigants. J Appl Oral Sci 2015;23:158-163. ArticlePubMedPMC
- 20. Khanifam P, Pullisaar H, Risheim H. Local facial atrophy and permanent anesthesia of right upper lip following subcutaneous extrusion of chlorhexidine digluconate. Oral and Maxillofacial Surgery Cases 2019;5:100087.Article
- 21. Okino LA, Siqueira EL, Santos M, Bombana AC, Figueiredo JAP. Dissolution of pulp tissue by aqueous solution of chlorhexidine digluconate and chlorhexidine digluconate gel. Int Endod J 2004;37:38-41. ArticlePubMed
- 22. Siqueira JF Jr, Rôças IN, Paiva SSM, Guimarães-Pinto T, Magalhães KM, Lima KC. Bacteriologic investigation of the effects of sodium hypochlorite and chlorhexidine during the endodontic treatment of teeth with apical periodontitis. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 2007;104:122-130. PubMed
- 23. Sousa ELR, Martinho FC, Nascimento GG, Leite FRM, Gomes BPFA. Quantification of endotoxins in infected root canals and acute apical abscess exudates: monitoring the effectiveness of root canal procedures in the reduction of endotoxins. J Endod 2014;40:177-181. ArticlePubMed
- 24. Freire LG, Carvalho CN, Ferrari PHP, Siqueira EL, Gavini G. Influence of dentin on pH of 2% chlorhexidine gel and calcium hydroxide alone or in combination. Dent Traumatol 2010;26:276-280. ArticlePubMed
- 25. Signoretti FGC, Gomes BPFA, Montagner F, Barrichello Tosello F, Jacinto RC. Influence of 2% chlorhexidine gel on calcium hydroxide ionic dissociation and its ability of reducing endotoxin. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 2011;111:653-658. ArticlePubMed
- 26. Ordinola-Zapata R, Bramante CM, Minotti PG, Cavenago BC, Garcia RB, Bernardineli N, et al. Antimicrobial activity of triantibiotic paste, 2% chlorhexidine gel, and calcium hydroxide on an intraoral-infected dentin biofilm model. J Endod 2013;39:115-118. PubMed
- 27. Fiorillo L. Chlorhexidine gel use in the oral district: a systematic review. Gels 2019;5:1-16. ArticlePubMedPMC
- 28. Sena NT, Gomes BPFA, Vianna ME, Berber VB, Zaia AA, Ferraz CC, et al.
In vitro antimicrobial activity of sodium hypochlorite and chlorhexidine against selected single-species biofilms. Int Endod J 2006;39:878-885. PubMed
- 29. Gomes BP, Ferraz CC, Vianna ME, Berber VB, Teixeira FB, Souza-Filho FJ. In vitro antimicrobial activity of several concentrations of sodium hypochlorite and chlorhexidine gluconate in the elimination of Enterococcus faecalis. Int Endod J 2001;34:424-428. PubMed
- 30. Gonçalves LS, Rodrigues RCV, Andrade Junior CV, Soares RG, Vettore MV. The effect of sodium hypochlorite and chlorhexidine as irrigant solutions for root canal disinfection: a systematic review of clinical trials. J Endod 2016;42:527-532. PubMed
- 31. Neelakantan P, Herrera DR, Pecorari VGA, Gomes BPFA. Endotoxin levels after chemomechanical preparation of root canals with sodium hypochlorite or chlorhexidine: a systematic review of clinical trials and meta-analysis. Int Endod J 2019;52:19-27. ArticlePubMedPDF
- 32. Ruksakiet K, Hanák L, Farkas N, Hegyi P, Sadaeng W, Czumbel LM, et al. Antimicrobial efficacy of chlorhexidine and sodium hypochlorite in root canal disinfection: a systematic review and meta-analysis of randomized controlled trials. J Endod 2020;46:1032-1041.e7. ArticlePubMed
- 33. Fedorowicz Z, Nasser M, Sequeira-Byron P, de Souza RF, Carter B, Heft M. Irrigants for non-surgical root canal treatment in mature permanent teeth. Cochrane Database Syst Rev 2012;(9):CD008948. Article
- 34. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann T, Mulrow CD, et al. Mapping of reporting guidance for systematic reviews and meta-analyses generated a comprehensive item bank for future reporting guidelines. J Clin Epidemiol 2020;118:60-68. PubMed
- 35. Maia LC, Antonio AG. Systematic reviews in dental research. A guideline. J Clin Pediatr Dent 2012;37:117-124. ArticlePubMedPDF
- 36. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015;4:1. PubMedPMC
- 37. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019;366:l4898. ArticlePubMed
- 38. Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Pge MJ, et al. Cochrane handbook for systematic reviews of interventions version 6.2. updated February, 2022]. February 20, 2023]. Available from: www.training.cochrane.org/handbook.
- 39. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003;327:557-560. PubMedPMC
- 40. Page MJ, Higgins JPT, Sterne JAC. Assessing risk of bias due to missing results in a synthesis. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA, editors. Cochrane handbook for systematic reviews of interventions version 6.2. UK, Chichester: John Wiley & Sons; 2021.
- 41. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol 2011;64:383-394. ArticlePubMed
- 42. Provenzano JC, Rôças IN, Tavares LFD, Neves BC, Siqueira JF Jr. Short-chain fatty acids in infected root canals of teeth with apical periodontitis before and after treatment. J Endod 2015;41:831-835. ArticlePubMed
- 43. Barbosa-Ribeiro M, Arruda-Vasconcelos R, de-Jesus-Soares A, Zaia AA, Ferraz CCR, de Almeida JF, et al. Effectiveness of calcium hydroxide-based intracanal medication on infectious/inflammatory contents in teeth with post-treatment apical periodontitis. Clin Oral Investig 2019;23:2759-2766.ArticlePubMedPDF
- 44. Vianna ME, Horz HP, Gomes BPFA, Conrads G.
In vivo evaluation of microbial reduction after chemo-mechanical preparation of human root canals containing necrotic pulp tissue. Int Endod J 2006;39:484-492. PubMed
- 45. Gomes BPFA, Martinho FC, Vianna ME. Comparison of 2.5% sodium hypochlorite and 2% chlorhexidine gel on oral bacterial lipopolysaccharide reduction from primarily infected root canals. J Endod 2009;35:1350-1353. ArticlePubMed
- 46. Xavier ACC, Martinho FC, Chung A, Oliveira LD, Jorge AOC, Valera MC, et al. One-visit versus two-visit root canal treatment: effectiveness in the removal of endotoxins and cultivable bacteria. J Endod 2013;39:959-964. ArticlePubMed
- 47. Marinho ACS, Martinho FC, Zaia AA, Ferraz CC, Gomes BPFA. Monitoring the effectiveness of root canal procedures on endotoxin levels found in teeth with chronic apical periodontitis. J Appl Oral Sci 2014;22:490-495. ArticlePubMedPMC
- 48. Marinho ACS, Martinho FC, Leite FRM, Nascimento GG, Gomes BPFA. Proinflammatory activity of primarily infected endodontic content against macrophages after different phases of the root canal therapy. J Endod 2015;41:817-823. PubMed
- 49. Barbosa-Ribeiro M, De-Jesus-Soares A, Zaia AA, Ferraz CCR, Almeida JFA, Gomes BPFA. Quantification of lipoteichoic acid contents and cultivable bacteria at the different phases of the endodontic retreatment. J Endod 2016;42:552-556. ArticlePubMed
- 50. McGuinness LA, Higgins JPT. Risk-of-bias VISualization (robvis): an R package and Shiny web app for visualizing risk-of-bias assessments. Res Synth Methods 2021;12:55-61. ArticlePubMedPDF
- 51. Buck RA, Cai J, Eleazer PD, Staat RH, Hurst HE. Detoxification of endotoxin by endodontic irrigants and calcium hydroxide. J Endod 2001;27:325-327. ArticlePubMed
- 52. Tanomaru JMG, Leonardo MR, Tanomaru Filho M, Bonetti Filho I, Silva LAB. Effect of different irrigation solutions and calcium hydroxide on bacterial LPS. Int Endod J 2003;36:733-739. PubMed
- 53. Silva LAB, Leonardo MR, Assed S, Tanomaru Filho M. Histological study of the effect of some irrigating solutions on bacterial endotoxin in dogs. Braz Dent J 2004;15:109-114. ArticlePubMed
- 54. de Oliveira LD, Jorge AOC, Carvalho CAT, Koga-Ito CY, Valera MC.
In vitro effects of endodontic irrigants on endotoxins in root canals. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 2007;104:135-142. PubMed
- 55. Marinho ACS, To TT, Darveau RP, Gomes BPFA. Detection and function of lipopolysaccharide and its purified lipid A after treatment with auxiliary chemical substances and calcium hydroxide dressings used in root canal treatment. Int Endod J 2018;51:1118-1129. ArticlePubMedPDF
- 56. Akobeng AK. Understanding type I and type II errors, statistical power and sample size. Acta Paediatr 2016;105:605-609. PubMed
- 57. Tronstad L, Sunde PT. The evolving new understanding of endodontic infections. Endod Topics 2003;6:57-77.Article
- 58. Neelakantan P, Romero M, Vera J, Daood U, Khan AU, Yan A, et al. Biofilms in endodontics—current status and future directions. Int J Mol Sci 2017;18:1748-1769. ArticlePubMedPMC
- 59. Arias-Moliz MT, Ordinola-Zapata R, Baca P, Ruiz-Linares M, García García E, Hungaro Duarte MA, et al. Antimicrobial activity of chlorhexidine, peracetic acid and sodium hypochlorite/etidronate irrigant solutions against Enterococcus faecalis biofilms. Int Endod J 2015;48:1188-1193. ArticlePubMed
- 60. Byström A, Sundqvist G. Bacteriologic evaluation of the efficacy of mechanical root canal instrumentation in endodontic therapy. Scand J Dent Res 1981;89:321-328. PubMed
- 61. Gazzaneo I, Vieira GCS, Pérez AR, Alves FRF, Gonçalves LS, Mdala I, et al. Root canal disinfection by single- and multiple-instrument systems: Effects of sodium hypochlorite volume, concentration, and retention time. J Endod 2019;45:736-741. ArticlePubMed
- 62. Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, et al. GRADE guidelines: 4. Rating the quality of evidence--study limitations (risk of bias). J Clin Epidemiol 2011;64:407-415. ArticlePubMed
- 63. Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, et al. GRADE guidelines 6. Rating the quality of evidence--imprecision. J Clin Epidemiol 2011;64:1283-1293. ArticlePubMed
- 64. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 7. Rating the quality of evidence--inconsistency. J Clin Epidemiol 2011;64:1294-1302. PubMed
- 65. Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 8. Rating the quality of evidence--indirectness. J Clin Epidemiol 2011;64:1303-1310. ArticlePubMed
- 66. Guyatt GH, Oxman AD, Sultan S, Glasziou P, Akl EA, Alonso-Coello P, et al. GRADE guidelines: 9. Rating up the quality of evidence. J Clin Epidemiol 2011;64:1311-1316. ArticlePubMed