@1stbrownhorse No, this is not too much. In fact, resting anywhere from 3-5 minutes between heavy sets is more than acceptable. Strenth athletes do this as well.
You are not getting dirty looks because of the time you rest, you're getting dirty looks because you're on your phone. People
love to play screen police especially towards young women, there is this weird noral high some people ride policing young women off their phones. I've noticed it as well in my gym before. The guys never get the same kind of energy from their fellow men either.
I say stay on your phone during your rest. You're not harming anyone and it wouldn't impact anyone differently if you stared straight in the air instead. I'm on my phone between sets too, because I log the weight and stats in my notes app and I can always tell when I'm getting a judgy look because someone is convinced I'm committing the crime of texting. Or worse, scrolling Instagram. If anyone ever comes up to me and says something about it, I'm dead set on telling them to fuck straight off.