BACKGROUND: Understanding the long-term effects of coronavirus disease 2019 (COVID-19) on cognitive function is essential for monitoring the cognitive decline in the elderly population. This study aims to assess the current cognitive status and the longitudinal cognitive decline in elderly patients recovered from COVID-19. METHODS: This cross-sectional study recruited 1539 COVID-19 inpatients aged over 60 years who were discharged from three COVID-19-designated hospitals in Wuhan, China, from February 10 to April 10, 2020. In total, 466 uninfected spouses of COVID-19 patients were selected as controls. The current cognitive status was assessed using a Chinese version of the Telephone Interview of Cognitive Status-40 (TICS-40) and the longitudinal cognitive decline was assessed using an Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE). Cognitive assessments were performed 6 months after patient discharge. RESULTS: Compared with controls, COVID-19 patients had lower TICS-40 scores and higher IQCODE scores [TICS-40 median (IQR): 29 (25 to 32) vs. 30 (26 to 33), p < 0.001; IQCODE median (IQR): 3.19 (3.00 to 3.63) vs. 3.06 (3.00 to 3.38), p < 0.001]. Severe COVID-19 patients had lower TICS-40 scores and higher IQCODE scores than non-severe COVID-19 patients [TICS-40 median (IQR): 24 (18 to 28) vs. 30 (26 to 33), p < 0.001; IQCODE median (IQR): 3.63 (3.13 to 4.31) vs. 3.13 (3.00 to 3.56), p < 0.001] and controls [TICS-40 median (IQR): 24 (18 to 28) vs. 30 (26 to 33), p < 0.001; IQCODE median (IQR) 3.63 (3.13 to 4.31) vs. 3.06 (3.00 to 3.38), p < 0.001]. Severe COVID-19 patients had a higher proportion of cases with current cognitive impairment and longitudinal cognitive decline than non-severe COVID-19 patients [dementia: 25 (10.50 %) vs. 9 (0.69 %), p < 0.001; Mild cognitive impairment (MCI): 60 (25.21 %) vs. 63 (4.84 %), p < 0.001] and controls [dementia: 25 (10.50 %) vs. 0 (0 %), p < 0.001; MCI: 60 (25.21 %) vs. 20 (4.29 %), p < 0.001)]. COVID-19 severity, delirium and COPD were risk factors of current cognitive impairment. Low education level, severe COVID-19, delirium, hypertension and COPD were risk factors of longitudinal cognitive decline. CONCLUSIONS: Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection is associated with an increased risk of long-term cognitive decline in elderly population. COVID-19 patients, especially severe patients, should be intensively monitored for post-infection cognitive decline.