Well 5 days into the downloading process and I have about 20,000 files left to download. I havedownloaded so far a total of 175,000 files totalling about 28GB of data. So by midday tomorrow it should be all done.

I have downloaded and parsed a number of other sets of support files:

  1. Monthly index files – these give on a month by month basis the filings by the different companies. Parsing these files has allowed me to populate my company table in the database aswell as a filings table.
  2. In order to assist in screening and peer group analysis the Standard Industry Codes have been downloaded and parsed. An example of a list of companies in a given category can be found here.

 

XBRL data update.