A Catholic bishop who came under intense criticism after his plans to retire in a $2.3 million home in California's Silicon Valley became public, now says he will finish his days in a rectory.