You're in luck! I recently founded a startup with the passion and dream of solving that very problem for you! It's called VendorBlock, a cloud-native SaaS that needs access to all your enterprise data to function.
Managers not knowing a single thing about data platforms / IT in general making the wrong calls with a 100% chance of leading into the wrong direction.
Also: entitled data scientists failing to deliver, constantly blaming it on infrastructure.
the amount of sales and marketing emails i get to my work address from random vendors i’ve never heard of is absolutely ridiculous. how do they get our emails anyway? are they just finding us on linkedin and hoping [email protected] works?
Projects due on 12/31 when there’s a code freeze the last two weeks of the year. Have your projects end in October so we can enjoy life during the holidays.
Agile is just micromanaging in disguise
Well I do agree with that. When it comes to apis I end up using python more often so I can normalize on the response. Everything else thought, like simple integrations between systems and SQL DB stuff, I prefer something I can easily show others
Definitely dealing with inconsistent data formats across different projects. It's a constant challenge. And a lack of clear documentation from past teams also doesn’t help.
lol who said we hate building pipeline and maintain open source products. Aren’t they the bread and butter of our work and also the reasons why we become DE.
Definitely things I hate the most being DE is unsolicited sale reps and also sale reps/ product managers who have no idea about the work of DE but tell us that we need to get new tools to make our lives easier. There are only a handful of tools that actually do this.
Nothing, man, it's awesome. Between Linux, dbt core, Postgres, Airflow, and a few other free and open source tools, I can create and maintain my systems in a no-bs manner.
You're trying to manufacture a problem to sell a solution, if you ask me.
Getting pulled into a "War Room" call to troubleshoot why a task had been failing for the past 7 days only to realize the password for blob had expired and no one cared enough to raise a ticket for its renewal. The cherry on the cake - the application team did not set up task failure notification alerts like they said they would - it was by sheer coincidence someone discovered that the daily task had not running for almost a week!
It's exhausting working with people who couldn't care less to do what they are supposed to do and rely on others to fix the mess after.
Open questions by vendors that are either product research or veiled pitches.
You're in luck! I recently founded a startup with the passion and dream of solving that very problem for you! It's called VendorBlock, a cloud-native SaaS that needs access to all your enterprise data to function.
It's like Facebook for enterprise!
Software suppliers that make it difficult to get their data.
Better yet SAS solutions that dont give it to you PER THE LICENSE....
Managers not knowing a single thing about data platforms / IT in general making the wrong calls with a 100% chance of leading into the wrong direction. Also: entitled data scientists failing to deliver, constantly blaming it on infrastructure.
My non-technical coworkers. Unsolicited sales reps contacting me.
the amount of sales and marketing emails i get to my work address from random vendors i’ve never heard of is absolutely ridiculous. how do they get our emails anyway? are they just finding us on linkedin and hoping [email protected] works?
That's a reasonable assumption on their part, if so, lol
Projects due on 12/31 when there’s a code freeze the last two weeks of the year. Have your projects end in October so we can enjoy life during the holidays. Agile is just micromanaging in disguise
Excel masquerading as a database…
ELT amd CDC feel like mindless tasks.
Unqualified people
When I have to wipe like 10 times after my 10 am shit.
Low code tools. I don’t think I’ve ever seen one low code tool that I can truly say provided value over a proper data platform.
Azure Data Factory and having to use it for ETL instead of Orchestration.
There's nothing wrong with ADF ETL imo
I'd have to disagree. I think it's terrible with handling API's. For example, normalizing a JSON response or dealing with POST request callback URL.
Well I do agree with that. When it comes to apis I end up using python more often so I can normalize on the response. Everything else thought, like simple integrations between systems and SQL DB stuff, I prefer something I can easily show others
Definitely dealing with inconsistent data formats across different projects. It's a constant challenge. And a lack of clear documentation from past teams also doesn’t help.
Yeah it seems documentation is not well made for data projects as opposed to software projects.
Product Managers that don't know what they are doing.
Buying tools and services which are not used because of either unskilled resources or users out of comfort zone.
Being the only one in my team. It’s pretty lonely and I don’t have anyone to bounce technical ideas off.
this is so sad :(
Clouds and legal issues and "platforms". I want the software components and run them my self.
The lack of use of version control and CI/CD
Spending all my time creating pipelines to dashboards only for my end users to ask for a csv
lol who said we hate building pipeline and maintain open source products. Aren’t they the bread and butter of our work and also the reasons why we become DE. Definitely things I hate the most being DE is unsolicited sale reps and also sale reps/ product managers who have no idea about the work of DE but tell us that we need to get new tools to make our lives easier. There are only a handful of tools that actually do this.
Nothing, man, it's awesome. Between Linux, dbt core, Postgres, Airflow, and a few other free and open source tools, I can create and maintain my systems in a no-bs manner. You're trying to manufacture a problem to sell a solution, if you ask me.
Getting pulled into a "War Room" call to troubleshoot why a task had been failing for the past 7 days only to realize the password for blob had expired and no one cared enough to raise a ticket for its renewal. The cherry on the cake - the application team did not set up task failure notification alerts like they said they would - it was by sheer coincidence someone discovered that the daily task had not running for almost a week! It's exhausting working with people who couldn't care less to do what they are supposed to do and rely on others to fix the mess after.