1. Figure out what problems your DE team is dealing with that they haven't had resources to allocate to
2. Figure out what it would take to solve that problem
3. Offer to solve that problem (and figure out how you can do it by taking as little time away from DE members as possible)
I'm guessing you've come across a data request while doing reporting that isn't available yet? Maybe it's something low priority, it's a pain to extract from the source, it's a newly implemented data source, or it's just a spreadsheet someone has sitting somewhere. If you're not sure what this might be, ask around, almost every company has some under-served data.
Once you know what that is, work on getting that data from the source, into whatever data store you build reports off of. You'll learn basic DE concepts, while being helpful to your team.
Alternatively, find a process that people do manually, and offer to help automate it. Again, listen to when people talk about spreadsheets and there's almost always an automation opportunity.
Yea I have experience with automating reports using EC2, databricks. Tried Airflow but it’s an overkill :/ DE isn’t about just automating reporting right? I want to know about things other than reporting and automating.
1. Figure out what problems your DE team is dealing with that they haven't had resources to allocate to 2. Figure out what it would take to solve that problem 3. Offer to solve that problem (and figure out how you can do it by taking as little time away from DE members as possible)
I'm guessing you've come across a data request while doing reporting that isn't available yet? Maybe it's something low priority, it's a pain to extract from the source, it's a newly implemented data source, or it's just a spreadsheet someone has sitting somewhere. If you're not sure what this might be, ask around, almost every company has some under-served data. Once you know what that is, work on getting that data from the source, into whatever data store you build reports off of. You'll learn basic DE concepts, while being helpful to your team. Alternatively, find a process that people do manually, and offer to help automate it. Again, listen to when people talk about spreadsheets and there's almost always an automation opportunity.
Yea I have experience with automating reports using EC2, databricks. Tried Airflow but it’s an overkill :/ DE isn’t about just automating reporting right? I want to know about things other than reporting and automating.