you eat, how much you eat, how often you eat it, and your individual health needs all matter more than whether the clock says 8 PM, 11 PM, or midnight.
If a banana at 11 PM satisfies your hunger and fits comfortably into your diet, there’s generally no reason to fear it simply because it’s late at night.