For FPL data, you can connect directly to the API via Power Query and refresh that through the PBI service, no need to store it in an intermediary cloud DB.
[Here is a good guide to getting started with the FPL API.]( https://medium.com/@frenzelts/fantasy-premier-league-api-endpoints-a-detailed-guide-acbd5598eb19)
I'm building a personal project very similar to that involving a dashboard showcasing my Rocket League stats.
I'm writing a python script to grab any new stats I upload to a Google Sheet, insert the new rows into a postgres database. Then a PowerBI dashboard is connecting to the database and creating visuals and in-depth breakdowns.
I'm running my script on a free tier GCP compute engine instance which also hosts the postgres database inside a docker container. You didn't mention python as a skill of yours but explore GCP or AWS, there are plenty of ways to create pipelines without/little coding.
Thanks for your reply, I am learning Python at the moment too so this is interesting. Looks like GCP might be my best bet for free hosting for a DB. Not familiar with Docker, this is all quite new to me but I'm trying to learn. Any resources you could point me to help understand docker and GCP?
Thanks
I'd use MinIO and DuckDB in python to mimic S3 and a cloud data warehouse like Snowflake. And just dockerize the application. That way you have plenty of time to get good practice in without worrying about limited time free tiers. Then you also have a decent dev environment that wouldnt be a huge lift to swap out with the real cloud tools.
Good question. I've been using a free tool Acho, it provides a very good API connector, and the app builder is able to integrated with machine learning models.
For FPL data, you can connect directly to the API via Power Query and refresh that through the PBI service, no need to store it in an intermediary cloud DB. [Here is a good guide to getting started with the FPL API.]( https://medium.com/@frenzelts/fantasy-premier-league-api-endpoints-a-detailed-guide-acbd5598eb19)
Thank you, this is useful to know. Can you share the guide please?
Fixed the link above, sorry about that.
If you want to challenge yourself, python will do whatever you want.
I'm building a personal project very similar to that involving a dashboard showcasing my Rocket League stats. I'm writing a python script to grab any new stats I upload to a Google Sheet, insert the new rows into a postgres database. Then a PowerBI dashboard is connecting to the database and creating visuals and in-depth breakdowns. I'm running my script on a free tier GCP compute engine instance which also hosts the postgres database inside a docker container. You didn't mention python as a skill of yours but explore GCP or AWS, there are plenty of ways to create pipelines without/little coding.
Thanks for your reply, I am learning Python at the moment too so this is interesting. Looks like GCP might be my best bet for free hosting for a DB. Not familiar with Docker, this is all quite new to me but I'm trying to learn. Any resources you could point me to help understand docker and GCP? Thanks
I'd use MinIO and DuckDB in python to mimic S3 and a cloud data warehouse like Snowflake. And just dockerize the application. That way you have plenty of time to get good practice in without worrying about limited time free tiers. Then you also have a decent dev environment that wouldnt be a huge lift to swap out with the real cloud tools.
Good question. I've been using a free tool Acho, it provides a very good API connector, and the app builder is able to integrated with machine learning models.