Can my husband and I withdraw money from our individual IRAs for a first time home purchase without penalty?

We would like to withdraw money from two individual IRA accounts to purchase our first home, but wonder if we file jointly will we have to pay an earned income penalty on one of them.