Well 5 days into the downloading process and I have about 20,000 files left to download. I havedownloaded so far a total of 175,000 files totalling about 28GB of data. So by midday tomorrow it should be all done.
I have downloaded and parsed a number of other sets of support files:
- Monthly index files – these give on a month by month basis the filings by the different companies. Parsing these files has allowed me to populate my company table in the database aswell as a filings table.
- In order to assist in screening and peer group analysis the Standard Industry Codes have been downloaded and parsed. An example of a list of companies in a given category can be found here.