Packed meetings with people who were “not going to face accountability” are disrupting defence reforms, the former head of the armed forces said.