Title: My main motivation was that I wanted to be able to drill down and filter across all the available stocks, look at the data for myself, and narrow down on the stocks I am interested based on my own sets of criteria, and make data-driven analysis for my personal investment strategies.<p>I used PostgreSQL as the backend database for ELT data pipelines, and used Citus Data cstore_fdw for columnar compression for the final dataset. All financial data is coming from SEC Edgar, <a href="https:&#x2F;&#x2F;www.sec.gov&#x2F;developer" rel="nofollow">https:&#x2F;&#x2F;www.sec.gov&#x2F;developer</a>. I used Python for downloading most of the data.<p>I also run the data load development locally on my home Ubuntu server that I built 5 years ago. I bought 4TB of M2 disks for best database performance, with PRIME B360M-A motherboard and Intel Chip Coffee Lake S.<p>I built the website simply using WordPress, and I run Apache Superset using gunicorn via Apache Webserver reverse proxy.<p>The registration form I had to build myself with PHP and some JavaScript, because it needed to automatically create a SuperSet user upon registration. Otherwise, I would need to input everyone manually. I used Python again for the data integration.<p>Please don&#x27;t use the database directly as an investment tool, as its in Beta, and the data still needs to undergo heavy data quality checks, please confirm all the numbers yourself, as I provide a link for every company to the SEC filings.
Upvote: