What Is the Downside of Buying Gold?

Straight answer
Gold’s main downsides are that it produces no income, it has historically trailed productive assets like stocks over long horizons, and owning physical metal carries real costs: dealer premiums of roughly 3–8%, ongoing storage and insurance, and higher taxes (the IRS treats physical gold as a collectible, so long-term gains can be taxed up to 28%). It can also be volatile in the short term, and aggressive “rare coin” sales tactics can quietly inflate what you pay.
Gold has a place in many portfolios, but a fair assessment means naming the costs, not just the appeal. Here is the full picture of what you give up and what you pay when you buy gold.
Gold pays you nothing while you hold it
A share of stock can pay a dividend. A bond pays interest. A rental property collects rent. Gold does none of that. It sits in a safe or a vault and produces no cash flow at all. The only way physical gold makes you money is if you sell it for more than you paid, after costs. That single fact shapes most of the downsides below, because there is no income stream to offset fees, taxes, or a price that moves against you.
It has trailed productive assets over long horizons
Over multi-decade stretches, broad stock indexes have generally outpaced gold, because companies reinvest profits and compound. Gold has no earnings to compound; its price reflects supply, demand, and sentiment rather than growing productivity. This is the opportunity cost of holding gold: money parked in metal is money not invested in assets that have historically grown faster. Gold can outperform during specific windows, but treating it as a long-term growth engine misreads what it is. We lay the comparison out in full in Gold vs Stocks.
Storage and insurance quietly eat returns
Physical gold has to live somewhere safe. Your realistic options each carry a cost:
- Home storage — a quality safe is an upfront cost, and home insurance often caps coverage on precious metals, so you may need a rider.
- Bank safe deposit box — an annual rental fee, and contents are generally not FDIC-insured.
- Third-party vault — secure and insured, but typically billed as a yearly percentage of value.
None of these is large on its own, but because gold pays no income, every dollar of storage and insurance is a direct drag on your eventual return.
Gold is taxed more heavily than most stocks
This is the downside most buyers overlook. The IRS classifies physical gold and silver as collectibles. That means long-term gains (on metal held over a year) can be taxed at a maximum rate of 28% — higher than the long-term capital-gains rates that typically apply to stocks. A few more reporting points worth knowing:
- Pay a dealer more than $10,000 in cash for a purchase and the dealer is generally required to file Form 8300 with the IRS.
- Certain bullion sales back to a dealer can trigger a 1099-B, depending on the product and quantity.
Exact treatment depends on your situation, so confirm specifics with a tax professional. The general point stands: gold’s tax bill is usually steeper than a comparable stock gain.
Premiums and spreads mean you start underwater
You rarely buy gold at the “spot” price you see quoted. Dealers charge a premium over spot — commonly around 3–8% on widely traded coins and bars — to cover minting, handling, and margin. When you sell, you usually receive slightly below spot. That round trip is a built-in cost: the gold price has to rise enough just to get you back to even before you see any profit.
| Component | Typical |
|---|---|
| Spot price | $2,000 (illustrative) |
| Dealer premium (3–8%) | +$60 to +$160 |
| Storage / insurance (yearly) | ~0.5%–1% of value |
| Sell-back spread | −1% to −3% below spot |
| Approx. break-even | Spot must rise ~5%–10% first |
These are illustrative round numbers, not a quote — real premiums and spreads vary by dealer, product, and market conditions. The takeaway is the shape, not the exact figures: you typically start a few percent behind.
Short-term volatility with nothing to cushion it
Gold is often described as a calm asset, but its price can swing meaningfully over months. With stocks, a dividend can soften a drawdown. With gold, there is no cash flow to cushion a falling price — you simply hold an asset worth less than you paid until, and if, it recovers. For anyone who may need the money on a fixed timeline, that lack of a floor matters.
High-pressure “collectible coin” sales tactics
A normal downside becomes a genuinely bad deal when a seller steers you from low-premium bullion into “rare,” “graded,” or “collectible” coins carrying premiums of 20–30% or more over their metal value. Those premiums often do not hold up on resale. This is a sales problem layered on top of an investment, and it is where buyers lose the most.
- A salesperson pushes “rare” or “collectible” coins instead of standard bullion.
- The premium over spot is well above the normal 3–8% range and isn’t clearly explained.
- You can’t get a plain, written buy-back price before you purchase.
- Urgency or scare tactics are used to rush your decision.
- Storage, insurance, and tax treatment are glossed over or never mentioned.
So is the downside a dealbreaker?
Not necessarily. Many people hold a modest allocation of gold for diversification, accepting these costs in exchange for an asset that often moves differently from stocks. The point is to go in clear-eyed: know that it pays nothing, costs more to tax and store than stocks, and starts a few percent behind. For how these tradeoffs fit a full investing decision, see our main gold investing guide.
Does gold pay any interest or dividends?
No. Gold produces no income while you hold it. Unlike stocks or bonds, there is no dividend or interest payment — your only return comes from selling it for more than you paid, after premiums, storage, and taxes.
Why is gold taxed at up to 28%?
The IRS classifies physical gold and silver as collectibles, and long-term gains on collectibles are capped at a 28% rate — higher than the long-term capital-gains rates that usually apply to stocks. Your actual rate depends on your income, so check with a tax professional.
How much does the dealer premium really cost me?
On common bullion coins you’ll often pay roughly 3–8% over the spot price to buy, and receive slightly below spot when you sell. Combined, that means the gold price typically has to rise several percent before you break even.