The Pittsburgh Penguins lost a challenging 5-3 game to the New York Rangers on Sunday evening at the PPG Paints Arena.