Information concerning the development of neutralizing antibodies and their duration will be critical to establishing herd immunity for COVID-19. We sought to evaluate SARS-CoV-2 spike protein receptor-binding domain (RBD)-specific antibodies, their duration, and capacity for SARS-CoV-2 neutralization in volunteers while the pandemic spread within our community starting in March 2020. Those participants with the highest starting titers had the longest-lasting response, up to 12 months post-diagnosis. SARS-CoV-2 neutralization capacity was correlated with anti-RBD antibody levels. The majority of our participants with confirmed COVID-19 diagnosis had very mild or asymptomatic infections. We also detected low and largely non-neutralizing anti-RBD IgG titers in a few participants with no known COVID-19 diagnosis. Finally, we found that antibody responses induced by vaccination were significantly higher than those induced by natural infection. Thus, our study suggests that vaccination is still critical even for those naturally infected or diagnosed with COVID-19.