|Year : 2021 | Volume
| Issue : 6 | Page : 938-942
COVID 19 scoping: A systemic review and meta-analysis
Harisha Dewan1, Mohammed Nishan2, Shan Sainudeen3, Sanskriti4, Kunal Jha5, Ashish Mahobia6, Rahul V C Tiwari7
1 Department of Prosthetic Dental Sciences, College of Dentistry, Jazan University, Jazan, KSA
2 Department of Oral Medicine and Radiology, Government Dental College, Kozhikode, Kerala, India
3 Department of Restorative Dentistry, College of Dentistry, King Khalid University, Abha, KSA
4 BDS, Indraprastha Dental College, Ghaziabad, Uttar Pradesh, India
5 Department of Public Health Dentistry, Kalinga Institute of Dental Sciences, KIIT University, Bhubneswar, Odisha, India
6 Department of Ophthalmology, SBH Eye Hospital, Raipur, Chhattisgarh, India
7 PhD Research Scholar, Narsinbhai Patel Dental College and Hospital, Sankalchand Patel University, Visnagar, Gujarat, India
|Date of Submission||14-May-2021|
|Date of Decision||18-May-2021|
|Date of Acceptance||21-May-2021|
|Date of Web Publication||10-Nov-2021|
Rahul V C Tiwari
Department of OMFS, Narsinbhai Patel Dental College and Hospital, Sankalchand Patel University, Visnagar - 384 315, Gujarat
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Introduction: The world has faced the pandemic of COVID-19 in the march of 2020 and still it continues to effect in 2021. Hence, in the present study we aim to evaluate the gulps in the research so that certain recommendations can be made for the future research. We conducted a scoping review of the COVID meta-analysis. Materials and Methods: Online data was collected from the search engines of EBSCO, PubMed, Google Scholar, and Scopus. The searched terms were COVID-19, CORONA, SARS-CoV-2, clinical features, Wuhan, etc. The study articles were collected that from January 2020 to February 2021. Based on the PRISMA guidelines, the meta-analysis was performed. Results: In the present study, we finalized 316 articles. On February 2020, the first article was published. We observed a spike in the meta-analysis later on. Most of the meta-analysis were issued in the virology and infection magazines. As expected, the majority studies were from Wuhan. The other countries that published the meta-analysis were the USA, the UK, and Italy. The studies included in each meta-analysis were nearly 25 and the subjects were approximately 16 thousand. However, we noticed a poor quality in majority of these meta-analysis and <10% of all the meta-analysis showed higher confidence. Conclusion: A poor quality of the meta-analysis has predominated the data and very few are of high quality. All the journal editors and the reviewing team should verify and thoroughly organize the protocol so that only high quality meta-analysis are encouraged.
Keywords: COVID-19, scope, systemic review and meta-analysis
|How to cite this article:|
Dewan H, Nishan M, Sainudeen S, Sanskriti, Jha K, Mahobia A, Tiwari RV. COVID 19 scoping: A systemic review and meta-analysis. J Pharm Bioall Sci 2021;13, Suppl S2:938-42
|How to cite this URL:|
Dewan H, Nishan M, Sainudeen S, Sanskriti, Jha K, Mahobia A, Tiwari RV. COVID 19 scoping: A systemic review and meta-analysis. J Pharm Bioall Sci [serial online] 2021 [cited 2022 Jun 27];13, Suppl S2:938-42. Available from: https://www.jpbsonline.org/text.asp?2021/13/6/938/330120
| Introduction|| |
The world went into a state of stand still after the declaration of the pandemic COVID-19. There has been no specific therapy and treatment for the COVID-19 disease. Only recently the vaccine has been given in some countries. However, till date, there has been no specific data on the clinical course and the prognosis of the disease.,,,,, In all the available studies, there were only reports of the cases observed that were admitted into the hospital, or in the centers of the specific region care centers.,,,,,,,, There has been a surge of the articles about the COVID-19 that are available online and in print.,,,, In the indexed search engines, there have been reports of over 200 articles per day for various types of the journals. Many organizations including the government and the private are issuing grants that encourage the research. Furthermore, the publishers are issuing the open access to the articles on these research and the related topics. All the research institutes and the committee are giving priority to the COVID-19 related topics. The publishing companies are also publishing the COVID-19 topics at the quickly through the quick review process.,,,, The chief motive of all these encouragements was the gain of the knowledge and the COVID-19 proof of the evidence. The meta-analysis is tool that helps to generate good quality evidence based practice. There have been many meta-analysis that are published regarding the COVID-19. There have been questions about the quality and the standard that is being maintained by the recent published meta-analysis.,,, It is noticed that the quick review process, less time for the peer reviews, demand for the early data release have led to the lower quality of the meta-analysis articles that are being published. Hence, to enumerate the number of the meta-analysis and their quality check being published, the present study was conducted. We performed a scoping review of the meta-analysis that was COVID-19 related and published.
To carry out a scoping review of the meta-analyses published regarding coronavirus disease 2019, evaluating their main characteristics, publication trends, and methodological quality.
| Materials and Methods|| |
We conducted the search for the data from the online sources like the “EMBASE,” “PubMed,” “Scopus,” and other sources. The study was conducted by two reviewers independently. The PRISMA ScR guidelines were followed. The articles were collected from January 2020 to February 2021. The search words are META ANALYSIS, COVID, COVID-19, SARS, CoV2, PANDEMIC. The disputes between the reviewers were cleared by consent.
The articles were screened for the abstract and the title for the initial screening. Later, the entire text was studied by one reviewer and then was cross checked by the other reviewer. The present study was organized according to the PICOS. The inclusion criteria were COVID-19, meta-analysis of the epidemiological studies, case reports, and other type of the studies such as the systemic reviews that were with the meta-analysis, comparison of the COVID-19 with other respiratory type of diseases.
The following article types were excluded: Incomplete information, meta-analysis done before December 2019, meta-analysis other than corona, research design that did not fit the meta-analysis protocol.
The study design that was considered in the present review was organized according to the title, author, country, date of publishing, the number of the articles in the study, the number of the patients included, the search engine used, the registration of the study, and the protocol followed.
Also the quality of the studies that were included for the present scoping review was analyzed by AMSTAR 2.0. After the trail assessment, to check the quality of the articles in the meta-analysis, the authors performed the data extraction and the stratification of the studies were done.
| Results|| |
Out of 1307 meta-analyses, 316 were considered eligible. The flow chart is depicted in [Figure 1]. On February 26, 2020 the first meta-analysis was published. We observed that nearly two meta-analysis were published in 24 h as showed in [Figure 2].
Majority of the studies were exclusive for the COVID-19 related only. There were a total of 38 countries participating in the meta-analysis. As expected, the majority studies were from Wuhan. The other countries that published the meta-analysis were the USA, the UK, and Italy. There were few studies that compared the COVID to the other viral respiratory symptoms. An average of 15,200 patients and 22 articles were included in each meta-analysis. Majority of the studies were given in the virology related journals. Almost equal distribution of the meta-analysis was seen among the journals with nearly one meta-analysis per each. For the medical journals the highest number was seen in the clinical and medicine journals, followed by others like gastroenterology [Figure 3].
|Figure 3: Distribution of the meta-analysis as per the subject area, journal and the country, (a) subject area, (b) journal (c) country|
Click here to view
When we searched for the registration <20% of the meta-analysis were registered in the PROSPERO. There were a variety of the type of the studies such as the randomized controlled trials, research studies, and majority were observational studies. Among the various data search engines, the most frequent were Medline and PubMed that were nearly in 99% of the studies.
In all these meta-analyses, the major area of the focus was clinical features, outcome, epidemiology, and medical managements.
When we analyzed for the quality of the meta-analysis study articles for the quality, a meager 32 articles had a higher confidence levels that constituted <10% of all the meta-analysis. More than half of the articles were with low confidence as shown in [Figure 4].
|Figure 4: (a) The distribution of the meta-analysis as per the quality (b) assessment of the criteria for the included meta-analysis|
Click here to view
| Discussion|| |
Evidence-based studies are required for the policymaking. Meta-analysis is highly trusted for the quality of the output they give. Most of the meta-analysis follow several principles based on the PROSPERO guidelines. After the world had to face the pandemic of the COVID-19, the need for the meta-analysis increased that were required to deduce the steps to be taken by the countries to follow. The meta-analysis quality depends on the articles that are included for the analysis along with the number and the methodology followed. Hence, in the present study, we intended to evaluate the quality of the meta-analysis studies done for the COVID-19 by a scoping review.
The prerequisite for any meta-analysis are the studies that are included for the review. The output of the meta-analysis depends on the quality and the number of the articles. If the included studies are of a poor quality then the meta-analysis will also be of bad quality. If a good quality of the meta-analysis is desired, then the a well planned with robust methodology is required.,
There have been some meta-analysis that have been reported as of low quality and had flaws.,,,, These might have been due to the poor quality of the studies that are included for the meta-analysis.
An average of 15,200 patients and 22 articles were included in each meta-analysis. The majority of the studies had such large number of the subjects as most of them were epidemiological that were published in the initial stages of the pandemic. When the quality was assessed, we obtained only 10% to be good quality. Furthermore, we noted that there were zero meta-analysis on the randomized controlled trial (RCT) alone without any other study included. Most of the studies that are published are observational and for the analysis of the risk factors. The RCTs that include the case and the control type of the studies were seldom done in the COVID-19.
The meta-analysis that was studied in the present study was mostly from china. These are followed by the USA, the UK, and Italy. These are also the most effected countries. However, these are also the countries that had been publishing the meta analysis prior to the pandemic., There is no proof of the correlation. Majority of studies are published in the virology, followed by infectious diseases and clinical researches. They evaluated the epidemiology and the prognosis. PROSPERO is the most common registering platform for the meta-analysis and is also evident in the present system., There is a high amount of the criticism about the number of the meta-analysis being published about the COVID-19 and also their mass publications.,, It is learned from the previous studies that meta-analysis can lead to contradicting output., The surge in the number of the meta-analysis that are on the COVID-19 have been shown to be of poor quality. This might lead to low applicable findings. This is significant for the policy makers and government agencies for the health program execution. The assumption that meta-analysis give high level of evidence is no more followed.,,, This was clearly evident in our quality assessment of the meta-analysis'.
From the present scoping review we can suggest that:
- The policy makers should not blindly follow the meta-analysis for the decision making
- The authors should maintain a high quality study and refrain from poorly designed studies for the meta-analysis
- The meta-analysis should be registered and should follow a strict protocol for the meta-analysis
- The publishers should encourage experienced peer review accurately and not compromise on the quality of the meta-analysis.
| Conclusion|| |
Production of the poor quality of the articles and the meta-analysis has been on rise for the COVID-19 articles. This surge in the meta-analysis is expected to raise. It is suggested that proper evaluation of the meta-analysis be done so that appropriate policies are made from the data given by these meta-analysis.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Lou J, Tian SJ, Niu SM, Kang XQ, Lian HX, Zhang LX, et al.
Coronavirus disease 2019: A bibliometric analysis and review. Eur Rev Med Pharmacol Sci 2020;24:3411-21.
Škorić L, Glasnović A, Petrak J. A publishing pandemic during the COVID-19 pandemic: How challenging can it become? Croat Med J 2020;61:79-81.
Kambhampati SB, Vaishya R, Vaish A. Unprecedented surge in publications related to COVID-19 in the first three months of pandemic: A bibliometric analytic report. J Clin Orthop Trauma 2020;11:S304-6.
Gale RP. Conquest of COVID-19. Publish it to death? Br J Haematol 2020;190:358-60.
Zhang H, Shao F, Gu J, Li L, Wang Y. Ethics committee reviews of applications for research studies at 1 hospital in China during the 2019 novel coronavirus epidemic. JAMA 2020;323:1844-6.
Smith MJ, Upshur RE, Emanuel EJ. Publication ethics during public health emergencies such as the COVID-19 pandemic. Am J Public Health 2020;110:e1-2.
Treweek S, Jüni P, Li T, Collin J, Briel M, Chan AW, et al.
COVID-19 randomised trial protocols: Rapid publication without barriers. Trials 2020;21:327.
Peyrin-Biroulet L. Will the quality of research remain the same during the COVID-19 pandemic? Clin Gastroenterol Hepatol 2020;18:2142.
Shah SS, Kulkarni N, Mahant S. Rapid publication, knowledge sharing, and our responsibility during the COVID-19 pandemic. J Hosp Med 2020;15:261.
Alexander PE, Debono VB, Mammen MJ, Iorio A, Aryal K, Deng D, et al.
COVID-19 coronavirus research has overall low methodological quality thus far: Case in point for chloroquine/hydroxychloroquine. J Clin Epidemiol 2020;123:120-6.
Shea BJ, Reeves BC, Wells G, Thuku M, Hamel C, Moran J, et al.
AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 2017;358:j4008.
Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al.
PRISMA Extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Ann Intern Med 2018;169:467-73.
Sun P, Qie S, Liu Z, Ren J, Li K, Xi J. Clinical characteristics of hospitalized patients with SARS-CoV-2 infection: A single arm meta-analysis. J Med Virol 2020;92:612-7.
Mulrow CD. Rationale for systematic reviews. BMJ 1994;309:597-9.
Ioannidis JP. Why most published research findings are false. PLoS Med 2005;2:e124.
Guo FR. A flaw on a meta-analysis of smoking and the severity of COVID-19: The association should have been endorsed. J Public Health (Oxf) 2020;42:653-4.
Santamaría-Gadea A, de Los Santos G, Alobid I, Mullol J, Mariño-Sánchez F. Errors and biases in meta-analysis of the prevalence of olfactory dysfunction in patients with COVID-19. Otolaryngol Head Neck Surg 2021;164:455-6.
Fontelo P, Liu F. A review of recent publication trends from top publishing countries. Syst Rev 2018;7:147.
Ioannidis JP, Chang CQ, Lam TK, Schully SD, Khoury MJ. The geometric increase in meta-analyses from China in the genomic era. PLoS One 2013;8:e65602.
Shokraneh F, Russell-Rose T. Lessons from COVID-19 to future evidence synthesis efforts: First living search strategy and out of date scientific publishing and indexing industry (submitted). J Clin Epidemiol 2020;123:171-3.
Gurevitch J, Koricheva J, Nakagawa S, Stewart G. Meta-analysis and the science of research synthesis. Nature 2018;555:175-82.
Ioannidis JP. The mass production of redundant, misleading, and conflicted systematic reviews and meta-analyses. Milbank Q 2016;94:485-514.
Chevret S, Ferguson ND, Bellomo R. Are systematic reviews and meta analyses still useful research? No. Intensive Care Med 2018;44:515-7.
Lippi G, Henry BM. Active smoking is not associated with severity of coronavirus disease 2019 (COVID-19). Eur J Intern Med 2020;75:107-8.
Guo FR. Active smoking is associated with severity of coronavirus disease 2019 (COVID-19): An update of a meta-analysis. Tob Induc Dis 2020;18:37.
Simons D, Shahab L, Brown J, Perski O. The association of smoking status with SARS-CoV-2 infection, hospitalization and mortality from COVID-19: A living rapid evidence review with Bayesian meta-analyses (version 7). Addiction 2021;116:1319-68.
Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. Evid Based Med 2016;21:125-7.
Patsopoulos NA, Analatos AA, Ioannidis JP. Relative citation impact of various study designs in the health sciences. JAMA 2005;293:2362-6.
Agoramoorthy G, Hsu MJ, Shieh P. Queries on the COVID-19 quick publishing ethics. Bioethics 2020;34:633-4.
Annane D, Jaeschke R, Guyatt G. Are systematic reviews and meta-analyses still useful research? Yes. Intensive Care Med 2018;44:512-4.
[Figure 1], [Figure 2], [Figure 3], [Figure 4]