Vaccination is one of the most effective ways to stop the spread of COVID-19. Understanding factors associated with intention to receive COVID-19 vaccines is the key to a successful vaccination programme. This cross-sectional study explored the rate of vaccination intention and identified its predictors using the health belief model (HBM) in the general population in Hong Kong during the pandemic. Data were collected between December 2020 and January 2021 via telephone surveys. Hierarchical logistic regression analysis was used to identify factors associated with intention to receive COVID-19 vaccines. A total of 1255 adults (>18 years, 53% female) completed the telephone survey. Overall, 42% indicated an intention to vaccinate, 31.5% showed vaccine hesitancy, and 26.5% reported refusal to receive any COVID-19 vaccines. Individuals who were men, older in age, working, with past experiences of other pandemics, less concerned with the vaccine safety, with poorer knowledge about COVID-19, and having greater levels of perceived susceptibility, self-efficacy, cues to action, and acceptance of governmental preventive measures related to COVID-19 were significantly more likely to report an intention to vaccinate. The low intention among the Hong Kong population reflects the importance of developing effective vaccination promotion campaigns with the predictors identified in this study.