It seems like a needlessly divisive conversation, every time it comes up. My guess is that 99% of all the people who complain that they see people driving pickups not hauling anything are themselves usually driving a 5 passenger car as the sole occupant.
That's a pretty straightforward calculation that leads to unsurprising results. An F150 with just two passengers burns less fuel per person than a Honda Fit carrying one passenger.