Wells Fargo said late Tuesday it was shrinking its home-mortgage business, aiming to serve its own bank customers as well as people in "minority communities."