Optimism Bias: Why You Underestimate Risk and Overestimate Returns
80% of people think they will live longer than average. 90% of entrepreneurs think their business will succeed (but 90% fail). Most investors think their portfolio will beat the market — even though most do not. Optimism bias makes us systematically underestimate the probability of negative outcomes and overestimate our ability to handle them.
Optimism bias — also called unrealistic optimism — is the tendency to believe that negative events are less likely to happen to us than to others, and that we are more likely to experience positive outcomes than objective probability suggests. The bias was extensively documented by psychologist Tali Sharot, whose research showed that people consistently underestimate their risk of divorce, illness, job loss, and financial hardship. In investing, optimism bias causes investors to underestimate downside risk, overestimate expected returns, and fail to prepare for worst-case scenarios. While a moderate degree of optimism is beneficial for mental health and entrepreneurship, unchecked optimism in investing leads to dangerously concentrated portfolios, excessive leverage, and catastrophic losses when the inevitable negative event occurs.
The 2008 financial crisis provides a vivid example of optimism bias at work. In 2006-2007, homebuyers believed that housing prices would continue rising indefinitely — despite historical data showing that housing, like all assets, goes through cycles. They took out adjustable-rate mortgages with no down payment because they were optimistic that rising prices and income would make the payments manageable. Banks were equally optimistic, packaging subprime mortgages into complex securities that they believed were safe because "housing has never declined nationally." When prices fell, the entire system collapsed. The optimism bias affected everyone from individual homebuyers to the CEOs of the world's largest banks. Each believed that the rules of probability did not apply to them — that they would get out before the crash, or that their portfolio was hedged, or that the government would bail them out. History shows that optimism bias is most dangerous precisely when everyone shares it.
How Optimism Bias Affects Investing
Overestimation of expected returns is the most direct effect. Investors project historical returns forward without adjusting for the current valuation environment, expecting 10% annual returns from a market that is trading at historically high multiples. They underestimate the probability of a lost decade (like 2000-2010 when the S&P 500 returned 0% annually) because such outcomes are rare and unpleasant to contemplate. This leads to insufficient savings — if you expect 10% returns but actually get 5%, you will have far less than you planned for retirement. Underestimation of risk is equally dangerous: investors underestimate the probability of job loss, health crisis, or family emergency that could force them to sell investments at the worst time. They fail to maintain adequate emergency funds, forcing them to sell stocks during market downturns when they lose their job — precisely the worst time to sell. This is why financial planners recommend 3-6 months of emergency expenses, even though most people optimistically believe they will not need it.
Optimism bias also drives excessive concentration in employer stock. Employees often believe their company will outperform — after all, they work there and see the day-to-day successes. They hold large portions of their 401K in their employer's stock, ignoring the basic principle that their job and their retirement should not both depend on the same company. When Enron collapsed, employees lost both their jobs and their life savings. Similarly, optimism bias leads entrepreneurs and small business owners to invest too heavily in their own businesses, ignoring the statistical reality that most small businesses fail. The bias also causes traders to underestimate the probability of a "black swan" event — a rare, unpredictable event with severe consequences — and therefore take insufficient precautions like stop-losses, hedging, or position limits. The optimistic brain says "it will not happen to me," but in a market of millions of participants, "it" happens to someone every day.
How to Overcome Optimism Bias
The most effective strategy is to conduct a "pre-mortem" before every major investment decision. Imagine that it is five years in the future and your investment has failed catastrophically. Write down exactly what went wrong. This exercise forces you to confront worst-case scenarios that your optimistic brain would rather ignore. Another technique is to use base rates rather than personal experience. When evaluating a startup investment, look at the base rate of startup success. When evaluating your portfolio's expected return, look at what similar portfolios have returned historically rather than projecting from recent years. Use a margin of safety in your planning — plan for 5% returns rather than 10%, 15% savings rate rather than 10%, and 6 months of emergency fund rather than 3. The most successful investors — including Warren Buffett and Charlie Munger — are not optimistic; they are conservative, always preparing for the worst while hoping for the best.
FAQs
Is optimism bias always bad for investors?
Moderate optimism can be beneficial. Optimistic entrepreneurs are more likely to start businesses and innovate. Optimistic investors are more likely to stay invested during market downturns, which is essential for long-term success. The problem arises when optimism becomes unrealistic — when it blinds you to risk, causes you to skip due diligence, or leads you to take exposures you do not fully understand. The key is to distinguish between "strategic optimism" (believing that long-term investing works even through short-term pain) and "tactical overconfidence" (believing you can time the market or pick stocks that will beat the odds). The first is supported by evidence; the second is not.
How does optimism bias affect retirement planning?
Optimism bias leads retirees and pre-retirees to underestimate how long they will live, how much healthcare will cost, and how likely a market downturn is in early retirement. People routinely underestimate their life expectancy, leading them to save too little and risk outliving their assets. They underestimate the probability of needing long-term care, which can cost $100,000+ per year. They underestimate sequence-of-returns risk — the danger of a market crash in the first few years of retirement — because they optimistically assume their retirement will coincide with bull markets. The cure is to plan conservatively: assume you will live to 95, budget for healthcare costs based on actual data rather than hopes, and stress-test your retirement plan against historical worst-case scenarios like 1966 (the worst year to retire in modern history).
How can I tell if I am too optimistic about my investments?
Warning signs include: you consistently expect higher returns than historical averages suggest; you have not stress-tested your portfolio against a 2008-style crash; you hold large positions in your employer's stock or a single sector you are excited about; you have not calculated the impact of a 10-year bear market on your retirement plan; you believe "this time is different" justifies higher valuations; and you find yourself dismissing pessimistic scenarios as "too negative." If any of these apply, you may be suffering from optimism bias. The corrective is to run the numbers on pessimistic scenarios and ask yourself honestly whether your financial plan would survive them. If the answer is no, you need to adjust your plan to account for the risks you have been ignoring.