Was an issue back in 2021 from a post it seems, same thing again.
Link to Original issue - #1546 (Video is exactly what happens today)
Long story short, closing Reaper notes and reopening them makes the notes disappear. A current workaround that is very annoying is to select in the drop down for different notes to a different one and back. Not sure why it doesn't show by default.