Olympic athletes struggle with ‘brutal’ weather