@kmar123 I do about the same as you and I've often heard the same from friends, coworkers, etc. (None of whom work out regularly or consistently)
Like you, I take rest days, and on my heavy flow days IF I work out, it's pretty low energy. I prefer active recovery days for the most part...