@countrygurl32 I sometimes workout twice a day (weights 2x, weights+ yoga, weights + swimming) but usually have a just walking day the day after to stretch my muscles and work them without demanding too much from them. This could be a doing too much problem.
If you're fatigued, take a "rest"...