Around 13k companies get incorporated in the UK every week. I wanted that list for a few sectors, every Monday, in a spreadsheet, without the ones I'd already seen. Turned out to be more annoying than expected, so here's what I ended up with.
The free way
Companies House has an advanced search where you can filter on incorporation date, SIC code and location, and download the results as CSV. For a one-off list that's honestly all you need.
Stuff I ran into doing it every week though:
A download is capped at 5,000 rows. A full week is way more, so you end up doing one day at a time.
The CSV isn't quoted. Addresses and SIC lists have commas in them, so a normal CSV parser shifts columns. I had to parse it with an anchored regex per line.
A big chunk of new companies are dormant (SIC 99999).…