I hear ya cas, I have passed on shots for the very same reason. I have taken electrical tape, burned a pin hole in it and stuck it on my classes where the hole lines up with my sights. It really crisps things up a lot, still difficult in low light but doable when the stars align.
Three years ago I got my biggest buck ever.
I was pretty happy, but I took it with a modern gun, only the second one in over sixty years, So I did feel a little bad cuz my muzzleloaders were warm at home.
Glad to still be able to enjoy the outdoors though, that hasn't changed!