Hi Leahar....don't feel bad for feeling tired. Even if you aren't sick, that's normal! I usually choose something quiet to do every 3rd day or so when travelling. It's just as nice to grab some tasty treats, some magazines or newspapers and tuck yourself in for an afternoon.
Or, a day trip on a bus? Where you can be around others? I've found thesis ones to be ok;
Madrid Tours, Madrid Sightseeing Tours & Things to Do in Madrid | Viator.com