Did you guys scrape the Ancestry.com pages that list their databases, or pull in an RSS feed, or do they have an API, or what? Same question for the FamilySearch catalog -- scraping? API?
Both of them have non-published APIs that their websites use. In the case of FamilySearch, the API can only be used for their digital collections. We have to use scraping for the collections in the catalog.