Wordpress speed issues

Hi, sometimes I run sites using wordpress and I'm struggling with speed. I use some caching plugins and seems to do a good job getting good numbers on lighthouse but then when I visit the site, it seems slow to load. What's the point to get high lighthouse speed if then the site is still slow? And even if it gets faster later, as a first visitor seems an eternity putting that visitor off.