High home prices may have you wondering if you can use your 401(k) to buy a home. Here’s what you need to know about dipping into your retirement savings, including the advantages and potential downsides.

You can use your 401(k) to purchase a home. The money could help you make a sizeable down payment or buy discount points to lower your mortgage interest rate.

However, accessing your savings before retirement can cost you. You’ll likely pay income taxes and an early withdrawal fee — not to mention missing out on potential investment growth.

In most cases, you can access your account through the plan administrator. It may be easier to start with HR if you don’t know who runs your 401(k).

The plan administrator should outline instructions and rules for withdrawing from your 401(k). However, there are also general IRS requirements you’ll need to know.

Taking money from your 401(k) before you reach age 59 ½ is generally considered an early withdrawal. You’ll pay income taxes — which is required for any traditional 401(k) distribution — but you’ll also owe a 10% penalty.

The IRS has exceptions to the early distribution tax, for example, if you have a permanent disability or experience loss from a disaster. However, drawing from your 401(k) for a home purchase is not one of the IRS-listed exceptions to an early withdrawal fee.

There is an exception for some home buyers, though. It’s called a 401(k) loan.

Some employers offer 401(k) loans that you can use toward a home purchase. Unlike a withdrawal, you’ll repay the loan with interest, typically through payroll deductions. But because you’re borrowing the money from yourself, you’re also paying interest to yourself. Repaying a loan with interest can always feel like a headache, but the bright side is you’ll end up pocketing the interest instead of a lender.

A 401(k) loan is not subject to income taxes or the 10% early withdrawal fee as long as you pay it back.

You may be able to borrow up to 50% of your vested 401(k) balance or $50,000, whichever is less. Check your employer’s plan for details.

Not all employers provide 401(k) loans. If offered, make sure you understand interest rates and repayment terms before applying.

Read more: How much house can you afford? Use the Yahoo Finance home affordability calculator.

Tapping into your 401(k) can make it easier to afford a home, but there are serious drawbacks to consider.

• Quick process: If the 401(k) funds are deposited directly into your bank account, you may be able to get money from your 401(k) within five to seven business days.

• No impact on credit: You’re tapping into your own savings, so you don’t have to worry about a credit check or a ding to your credit report.

• Potentially low or no rates: You don’t have to repay a 401(k) withdrawal to purchase a home. And interest rates on 401(k) loans can be lower than those for other types. Plus, interest goes back into your retirement account.

• Taxes and penalties: Early withdrawals are subject to a 10% penalty on top of income taxes. Loans are not subject to these penalties as long as you remain an employee and repay the balance.

• Could limit future contributions: Repaying a 401(k) loan could make it harder to continue making contributions, especially since loan payments typically come out of your paycheck.

• Deferred growth: When you dip into your retirement savings, you have less money invested, reducing its growth potential.

Dig deeper: What it means to be house poor and how to avoid it

It’s generally a good idea to let your retirement savings sit to take advantage of potential market growth over the long term. However, there may be circumstances where you consider using your savings for a home.

For example, if you’re close to scraping together enough for a 20% down payment, taking out money from your 401(k) may be worth it. A 20% down payment will help you avoid paying for private mortgage insurance (PMI), and larger down payments typically result in lower mortgage interest rates.

Still, what you save in interest may not be worth deferred market growth. Consider talking to a financial advisor before taking this step.

You have options if you don’t want to use your 401(k) for a home purchase. Here are alternatives to consider.

• Withdraw from your IRA: First-time home buyers can use up to $10,000 from their traditional IRA to buy a home without a penalty. If you have a Roth IRA, you can withdraw your contributions, but not earnings, at any time without paying a penalty or income taxes.

• Shop for a low-down-payment loan: If you prefer to let your retirement savings sit, you can explore conventional loans with minimum down payment requirements as low as 3%. Some government-backed mortgages, like USDA and VA loans, don’t require a down payment.

• Explore down-payment assistance programs: Some banks, nonprofits, and other organizations may offer down payment assistance through grants and forgivable or deferred loans.

Read more: Best low- and no-down-payment mortgage lenders

You may be able to borrow from your retirement savings if your employer offers 401(k) loans. These loans aren’t subject to income tax or the 10% early withdrawal fee, but you’ll repay the loan with interest. If your employer doesn’t allow 401(k) loans, you still have the option to withdraw from your 401(k). But if you’re withdrawing before age 59 ½, you’ll pay the penalty unless you meet one of the IRS exceptions.

The IRS allows you to borrow up to $50,000 or 50% of your vested balance, whichever is lower. If you have less than $10,000 in your 401(k), you may be able to borrow the full amount if your employer allows it.

The IRS requires 401(k) loans to be repaid within five years. However, loans for home purchases can have a longer repayment period. Your employer may have additional terms and requirements. Make sure you know the details of your plan before you apply.