"Late in the evening" refers to a time later in the evening, typically during the later hours of the night, closer to midnight.

Example

1. Late in the evening, the city lights started to illuminate the skyline.
2. The party went on late in the evening, with guests dancing and socializing.
3. The concert didn't start until late in the evening, so we had dinner beforehand.