Which Retirement Accounts to Tap First at $5M+

What Is the Best Way to Withdraw from Retirement Accounts at $5M+?

The best way to withdraw from retirement accounts at the $5M+ level is not a single method but a sequenced, tax-optimized strategy that accounts for your specific account mix, time horizon, and marginal rate exposure. Get the sequence right and you can realistically save seven figures in lifetime taxes. Get it wrong and the IRS becomes your largest beneficiary.

Most retirement withdrawal advice is written for someone with a $600,000 401(k) and a 30-year horizon. That is not you. At FatFIRE scale, the variables that matter most are Roth conversion timing, RMD management, state tax domicile, and the interplay between your taxable accounts and tax-deferred balances. Standard 60/40 guidance ignores someone holding a concentrated position, private equity distributions, or a real estate portfolio generating passive income on top of retirement account withdrawals.

This article covers the strategies that actually move the needle at your level.

Understanding the Tax Structure of Retirement Account Withdrawals

Before optimizing sequence, you need a clear map of how each account type is taxed on the way out.

Traditional 401(k) and IRA withdrawals are taxed as ordinary income. Every dollar you pull hits your marginal rate, which at $5M+ is likely 37% federal plus your state rate. Roth IRA qualified withdrawals are tax-free. Taxable brokerage accounts generate capital gains, qualified dividends, and sometimes return of basis, all taxed at preferential rates compared to ordinary income.

The practical implication: the order in which you draw from these accounts determines your effective tax rate for decades. According to Fidelity's research on tax-smart withdrawal strategies, a sequenced approach, taxable accounts first, then tax-deferred, then Roth, can meaningfully extend portfolio longevity compared to proportional withdrawals across all account types.

One structural change worth noting: SECURE 2.0 eliminated RMDs for Roth 401(k) accounts starting in 2024, per Congressional Research Service analysis of the legislation. If you hold a large Roth 401(k) balance, you no longer face mandatory distributions from that account, which changes the sequencing calculus significantly.

Your optimal Roth vs 401(k) allocation during accumulation directly shapes how much flexibility you have in distribution. If you are still in accumulation, this matters now.

What Is the Most Tax-Efficient Order to Withdraw from Retirement Accounts?

The conventional sequence is: taxable accounts first, tax-deferred second, Roth last. The logic is sound, you let tax-advantaged accounts compound longer while spending down assets that generate annual taxable events anyway.

At the FatFIRE level, though, this default sequence often needs modification. If your tax-deferred accounts are large enough that future RMDs will push you into the 37% bracket regardless, blindly deferring Roth conversions costs you more than it saves.

The smarter framework is bracket management. Each year, you ask: what is the highest bracket I can fill without triggering material additional tax friction? Then you pull from tax-deferred accounts up to that ceiling, convert the remainder to Roth, and cover remaining expenses from taxable accounts or Roth.

For a FatFIRE retiree with $3M in a traditional IRA and $2M in taxable accounts, the gap between age 60 and 73 (when RMDs begin under current law) is the conversion window. T. Rowe Price analysis shows that systematic Roth conversions during this window can reduce lifetime tax liability by hundreds of thousands of dollars for high-net-worth retirees.

Non-retirement investment accounts play a supporting role here: they provide liquidity to cover living expenses while you convert tax-deferred balances, avoiding the need to pull from Roth accounts prematurely.

What Is the Best Withdrawal Strategy for a $5 Million Retirement Portfolio?

The 4% rule is a starting point, not a destination. The original Trinity Study by Cooley, Hubbard, and Walz found that a 4% withdrawal rate sustained a 30-year portfolio in most historical scenarios. That research was published in 1998, used a 50/50 stock/bond portfolio, and assumed a 30-year horizon.

If you retire at 50, you are planning for 40 to 50 years. Research by Wade Pfau and others suggests the historically safe withdrawal rate drops to approximately 3.0–3.3% for 50-year periods. On a $5M portfolio, that means roughly $150,000–$165,000 in annual withdrawals, not $200,000. Morningstar's 2023 research on safe withdrawal rates suggested approximately 3.8% for new retirees even at standard horizons, given current market valuations and lower expected forward returns.

The practical implication: at FatFIRE scale, you almost certainly need supplemental income sources beyond pure portfolio withdrawals. Real estate distributions, private equity income, or a partial annuity are not optional luxuries, they are structural necessities for a 50-year retirement.

Use dynamic spending calculators to model how variable withdrawal rates respond to sequence-of-returns risk. The guardrails approach, setting a spending floor and ceiling as a percentage of portfolio value, outperforms fixed withdrawal rates in most Monte Carlo simulations for long retirements.

These figures assume a diversified portfolio. Alternative assets, real estate income, and Social Security all reduce the required withdrawal rate from investable accounts.

How Roth Conversion Ladders Work for Early Retirees with Large Portfolios

The Roth conversion ladder is the highest-leverage tax planning tool available to FatFIRE retirees who have significant tax-deferred balances and a gap between retirement age and RMD onset.

The mechanics: you convert a portion of your traditional IRA or 401(k) to a Roth IRA each year, paying ordinary income tax on the converted amount. After a five-year seasoning period, those converted funds can be withdrawn tax-free and penalty-free, even before age 59½. This is distinct from backdoor Roth IRA strategies, which address contribution limits during accumulation.

For a FatFIRE retiree in the 22% or 24% bracket during early retirement (before Social Security, before RMDs), converting $200,000–$500,000 annually into a Roth at those rates is dramatically cheaper than taking the same distributions at 37% once RMDs force the issue. The IRS requires that each conversion satisfy its own five-year clock, so sequencing matters.

The math is stark. Converting $300,000 per year at 24% costs $72,000 in federal tax. Taking that same $300,000 as a forced RMD at 37% costs $111,000. Do that for ten years and the difference is $390,000 in federal tax alone, before accounting for state taxes and the compounding benefit of the Roth balance growing tax-free.

IRS Publication 590-B governs the rules for IRA distributions, including the five-year holding requirements and qualified distribution definitions. Your tax attorney should be modeling this annually, not reactively.

What Are the RMD Rules for High-Net-Worth Individuals with Multiple Retirement Accounts?

The SECURE 2.0 Act raised the required minimum distribution starting age to 73, with a further increase to 75 scheduled. For a FatFIRE retiree who stopped working at 55, that is up to 20 years of Roth conversion runway before RMDs force distributions.

The required minimum distribution rules aggregate across traditional IRAs, you calculate the total RMD across all IRAs and can satisfy it by withdrawing from any combination of them. 401(k) accounts are calculated and satisfied separately, per account.

For large balances, the RMD math gets uncomfortable quickly. A $4M traditional IRA at age 73 generates an RMD of roughly $155,000 (using the IRS Uniform Lifetime Table divisor of approximately 26.5). At 80, the same balance, assuming modest growth net of withdrawals, could generate $200,000+ in mandatory taxable income. Stack that on top of Social Security, investment income, and rental income, and you are looking at sustained exposure to the 37% bracket plus the 3.8% net investment income tax.

This is precisely why the Roth conversion window between retirement and RMD onset is so valuable. Every dollar converted before 73 is a dollar that will never generate a forced RMD.

One additional SECURE 2.0 change: the penalty for missing an RMD dropped from 50% to 25% (and to 10% if corrected promptly). Still painful, but the previous 50% penalty was one of the harshest in the tax code.

How to Use Qualified Charitable Distributions to Reduce RMD Tax Liability

Qualified Charitable Distributions are one of the most tax-efficient tools available to philanthropically inclined FatFIRE retirees, and they are consistently underused.

Under IRS rules, taxpayers age 70½ or older can direct up to $105,000 annually (2024 limit, now inflation-indexed under SECURE 2.0) from an IRA directly to a qualified charity. The QCD counts toward your RMD requirement but is excluded from your adjusted gross income entirely.

That AGI exclusion is more powerful than it looks. A standard charitable deduction reduces taxable income after AGI is calculated. A QCD reduces AGI itself, which cascades into lower Medicare IRMAA surcharges, reduced taxation of Social Security benefits, and reduced exposure to the 3.8% net investment income tax. For a retiree with $300,000 in annual income, a $105,000 QCD can save materially more than the face value of the deduction.

For FatFIRE retirees with significant charitable intent, the QCD is almost always superior to writing a check and taking an itemized deduction. The only scenario where the deduction wins is if you are contributing appreciated securities to a donor-advised fund, in that case, you avoid capital gains on the appreciation and get the deduction. Both strategies have their place; they serve different asset types.

If your charitable giving exceeds $105,000 annually, a Donor-Advised Fund funded with appreciated securities handles the overflow efficiently. You get an immediate deduction in the contribution year and can distribute to charities over time.

Early Retirement Withdrawals: Accessing Funds Before Age 59½

Retiring at 45 or 50 creates a structural problem: your assets are largely locked in accounts that impose a 10% penalty for early withdrawal. The IRS provides several exceptions, and FatFIRE retirees typically use a combination of them.

Rule 72(t) / SEPP: Under IRC Section 72(t), you can take substantially equal periodic payments from an IRA or 401(k) before age 59½ without the 10% penalty, provided you follow one of three IRS-approved calculation methods (RMD method, fixed amortization, or fixed annuitization) and continue the payments for at least five years or until age 59½, whichever is longer. The constraint is inflexibility, modifying the payment schedule triggers retroactive penalties. SEPP works best as a bridge for a defined income need, not as a primary withdrawal vehicle.

Roth conversion ladder: As covered above, conversions seasoned for five years can be withdrawn penalty-free before 59½. This requires planning five years in advance, which means starting conversions at or before retirement if you want access in your early 50s.

Taxable accounts as the bridge: For most FatFIRE retirees, the cleanest solution is holding enough in non-retirement investment accounts to cover the gap years entirely. Taxable accounts have no age restrictions, generate preferential capital gains rates, and provide flexibility that retirement accounts cannot. If you have $5M+ in total assets, the question is usually how much to keep outside retirement accounts, not whether to trigger penalties.

HSA withdrawals in retirement add another tax-free layer for medical expenses, which tend to increase significantly in later retirement years. An HSA funded aggressively during working years can cover a meaningful portion of healthcare costs without touching retirement accounts.

State Income Tax Arbitrage: The $30,000–$40,000 Annual Decision

This is the strategy that mass-market retirement content ignores entirely, and it is directly relevant to anyone withdrawing $300,000+ annually from tax-deferred accounts.

Nine states have no income tax: Florida, Texas, Nevada, Wyoming, Washington, South Dakota, Alaska, Tennessee, and New Hampshire. Several others exempt pension and retirement income specifically. California's top rate is 13.3%. New York's is 10.9%.

For a FatFIRE retiree executing $400,000 in annual Roth conversions from California, the state tax bill on those conversions alone is $53,200. The same conversions from Florida: $0. Over a ten-year conversion window, that differential is $532,000 in state taxes, before accounting for the ongoing state tax savings on RMDs and investment income.

Establishing domicile in a no-income-tax state before beginning large Roth conversions or RMDs is a legally straightforward strategy with material financial impact. The requirements vary by state, but generally involve physical presence, a primary residence, driver's license, voter registration, and demonstrable intent to remain. California in particular is aggressive about auditing former residents who claim to have relocated, so the move needs to be genuine and well-documented.

This is not a strategy for everyone. Quality of life, family proximity, and healthcare access all factor in. But for a FatFIRE retiree with flexibility on domicile, the tax math deserves serious analysis before you begin the conversion window.

Charitable Remainder Trusts and Other Advanced Withdrawal Structures

For FatFIRE individuals with highly appreciated assets in taxable accounts, a Charitable Remainder Trust can function as a tax-efficient income vehicle that also satisfies philanthropic goals.

Under IRC Section 664, a CRT allows you to contribute appreciated assets, concentrated stock, real estate, or other appreciated property, receive an income stream for life or a term of years, take a partial charitable deduction, and avoid immediate capital gains tax on the contribution. The trust sells the asset, reinvests the proceeds, and pays you an income stream. The remainder passes to charity at the end of the trust term.

The mechanics work particularly well for FatFIRE retirees who hold a large concentrated position they want to diversify but cannot sell without triggering a substantial capital gains bill. The CRT provides diversification, income, a charitable deduction, and deferred capital gains recognition, simultaneously.

CRTs are irrevocable, which is the primary constraint. Once assets are contributed, you cannot retrieve the principal. The income stream is also partially taxable depending on the trust's earnings composition. These structures require an estate attorney and a tax advisor working together, and the setup costs are non-trivial. For positions above $500,000 in unrealized gains, the economics typically justify the complexity.

For high net worth investment strategies that span both accumulation and distribution, CRTs sit at the intersection of withdrawal planning, tax optimization, and estate planning in a way that few other vehicles can match.

Building a Tax-Efficient Retirement Income Portfolio

The goal in distribution is not to minimize this year's tax bill. It is to minimize the present value of all future tax bills while maintaining the income and liquidity you need.

Building a retirement income portfolio at FatFIRE scale typically involves coordinating five or more income sources: taxable account withdrawals, Roth distributions, tax-deferred withdrawals (including RMDs), real estate or private equity distributions, and Social Security. Each source has different tax treatment, different timing constraints, and different flexibility.

The sequencing framework that works for most FatFIRE retirees:

1. Pre-RMD years (retirement to age 73): Cover living expenses from taxable accounts and Roth conversions. Maximize the conversion window. Delay Social Security if possible to maximize the inflation-adjusted benefit.
2. RMD onset (age 73+): RMDs become a forced income floor. Layer Social Security on top. Use QCDs to offset RMD income if you have charitable intent. Draw from Roth accounts to manage bracket exposure.
3. Late retirement: Roth accounts provide tax-free income and no RMD pressure. Taxable accounts benefit from step-up in basis at death, making them efficient for estate transfer.

Age-based asset allocation guidance matters here too. The conventional glide path toward bonds as you age makes less sense for a FatFIRE retiree with a 40-year horizon and substantial non-portfolio income. A higher equity allocation may be appropriate if your income floor is covered by other sources.

Common Withdrawal Mistakes That Cost FatFIRE Retirees the Most

The mistakes at this level are not the obvious ones. Nobody with a $5M portfolio forgets to take their RMD. The expensive errors are subtler.

Deferring Roth conversions too long. Every year you delay conversions in the pre-RMD window is a year of compounding that will eventually be taxed at ordinary income rates. The window closes at 73. Many FatFIRE retirees wait until their late 60s to start, leaving years of conversion capacity unused.

Ignoring IRMAA thresholds. Medicare's Income-Related Monthly Adjustment Amount adds surcharges to Part B and Part D premiums for higher-income retirees. In 2024, IRMAA kicks in at $103,000 for single filers and $206,000 for married filers. Large Roth conversions can push you into higher IRMAA tiers. This does not mean avoiding conversions, it means modeling the IRMAA cost against the long-term conversion benefit.

Treating the 4% rule as a ceiling rather than a floor. For a $10M portfolio with substantial non-portfolio income, a 4% withdrawal rate may be unnecessarily conservative. The goal is optimizing for lifetime utility, not maximizing the probability of dying with the most money.

Withdrawing from Roth accounts early in retirement. Roth accounts are your most valuable long-term asset because they compound tax-free indefinitely. Spending them down in your 60s to avoid touching tax-deferred accounts is often the wrong trade, particularly if you have not yet exhausted the conversion window.

Review your tax implications when you stop earning before finalizing any withdrawal sequence. The transition from W-2 income to portfolio income changes your tax profile substantially, and the first few years of retirement are often the best opportunity to execute large conversions at lower marginal rates.

References

• IRS, "Publication 590-B: Distributions from Individual Retirement Arrangements (IRAs)" (2024).
• IRS, "IRC Section 72(t), Exceptions to the 10% Additional Tax on Early Distributions" (2024).
• IRS, "SECURE 2.0 Act Changes Affecting Retirement Plans" (2023).
• IRS, "Qualified Charitable Distributions (QCDs) from IRAs" (2024).
• Congressional Research Service, "The SECURE 2.0 Act of 2022 (P.L. 117-328): Overview and Analysis" (2023).
• Fidelity Investments, "Retirement Income Planning: Tax-Smart Withdrawal Strategies" (2024).
• Morningstar, "The State of Retirement Income: Safe Withdrawal Rates" (2023).
• Journal of Financial Planning, "Retirement Savings: Choosing a Withdrawal Rate That Is Sustainable" (Cooley, Hubbard, and Walz, 1998).
• T. Rowe Price, "Roth IRA Conversions: Tax Planning Strategies for Retirement" (2024).
• Vanguard, "How America Saves 2024" (2024).