If you have "time to kill" during sets you are doing something wrong.
There should only be enough time to catch breath (sometimes its hard just to do this), drink some water, add plates and concentrate on next set.
In my gym there's a bunch of morons that dont even break a sweat, chatting around and browsing phones between sets...