For the same reason, some leading business groups, including the U.S. Chamber of Commerce and the Associated General Contractors of America, have withdrawn support for the infrastructure spending bill, though Mr. Obama cited the Chamber as a supporter in his remarks.