Vaccination against SARS-CoV-2 is considered as the most important preventive strategy against COVID-19, but its efficacy in patients with hematological malignancies is largely unknown. We investigated the development of neutralizing antibodies (NAbs) against SARS-CoV-2 in patients with Waldenstrom Macroglobulinemia (WM), Chronic Lymphocytic Leukemia (CLL) and Non-Hodgkin Lymphoma (NHL). After the first dose of the vaccine, on D22, WM/CLL/NHL patients had lower NAb titers compared to controls: the median NAb inhibition titer was 17% (range 0-91%, IQR 8-27%) for WM/CLL/NHL patients versus 32% (range 2-98%, IQR 19-48%) for controls (P < 0.001). Only 8 (14%) patients versus 114 (54%) controls developed NAb titers >/= 30% on D22 (p < 0.001). Our data indicate that the first dose of both BNT162b2 and AZD1222 leads to lower production of NAbs against SARS-CoV-2 in patients with WM/CLL/NHL compared to controls of similar age and gender and without malignant disease. Even though the response rates were not optimal, vaccination is still considered essential and if possible should be performed before treatment initiation. These patients with suboptimal responses should be considered to be prioritized for booster doses.