I've noticed a tendency of people outside of finance to exaggerate the salaries inside of finance.

You're right: $1m/year is very rare overall even for the world of finance. And I assure you someone with that salary on Wall Street is working 80 hours a week at minimum and has been for quite some time.