Labour anxiety and accusations after big shift in Muslim vote to Greens