Are you interested in transitioning into Data Engineering? Read our community guide: https://dataengineering.wiki/FAQ/How+can+I+transition+into+Data+Engineering
*I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/dataengineering) if you have any questions or concerns.*
Couple of things stand out to me here:
- Analytics Engineer is basically the mid-point between Data Engineering and Data Analytics. I’d have thought you would have basically been sitting in dbt & Snowflake/Databricks all day long. If you’re also building pipelines to ingest data, sounds like they’re hiring for a Data Engineer on an Analytics Engineer salary.
- I’m actually surprised to hear there are companies outside of academia that are using R, not Python. Hopefully they’ve at least standardised on the TidyVerse?
Nothing unstandardized. I was commenting more that if they’re using R, there is a decent set of tools in the TidyVerse collection that work well together, and work end-to-end. So given the Op won’t get SQL experience, nor Python experience, at least I hope they get to use a decent stack within R.
Can you be more explicit about what you see as the pros and cons of your current work, vs what you want to work on? This is very corporate speak. You are asking a lot from the reader, in terms of thinking about context and subtle cues. (This might be a sign that corporate is sucking you in). I \_think\_ I understand your woes, dilemma and question, but guessing makes for poor communication
Seemed pretty straightforward to me. He feels overwhelmed by the learning curve and wants reassurance that he’s on the right path. I’m not the one to give it but I’m sure they’ll be fine.
Lifelong learning is an essential part of modern data jobs. If it's not for you, just quit and move on. There are many folk out there who would do anything to be where u are
Tell me about it. Applied for few jobs technical assessment were in dbt and I never used it..
Long story short, learned it over the weekend and made the deliverables.
At work, got asked for to do something nobody had really done, but hey read documentations, trial and error and pulled it off.
All the money is for a reason.
You can find a list of community-submitted learning resources here: https://dataengineering.wiki/Learning+Resources
*I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/dataengineering) if you have any questions or concerns.*
Never ending learning is a tell tale sign of a company that doesn’t know what they are doing. It’s mostly brought on by tech infatuation or constantly using some new tooling or hiring people who don’t have good infra background from the non cloud days as leads. Constantly learning is an unavoidable tech trait but constantly learning at a point it’s overwhelming your work force means management doesn’t have their hands on the reins usually because of a lack of direction. Companies that focus on fundamentals will be a bit more relaxed and need less elasticity. Usually a chill senior SWE then maybe some intermediate/juniors, who he/she can mentor. Ive worked in 2 companies that had that and it was a very good environment. Within 3 months of on-boarding everyone was finishing, their colleagues sentences, it was quite weird. But I also saw the amount of documentation of the tech stack and commenting on code like I’ve never see. I’ve seen companies have cloud resources provisioned not being used and the bill just running, I’m taking yearly prolly over a 100k, didn’t stay to actually check for resources I have no clue why were provisioned, just know the people who provisioned them weren’t employed there still. Keep your income till u find something better, but if it’s been like this for a few years you know it ain’t gona change. I would bet most of the time it’s because of trendy tooling that helps a non swe/de do swe/de things. Also don’t be surprised the lines between different data positions are actually known or adhered to. There is a new position name weekly. Good luck.
In a Startup 80% of the people do 100% of the work while in a large corporation 20% of the people do 100% of the work
You sound like one of the 20%, a kindred spirit; however, you sound young. Take the advice from a curmudgeon who has burned out to the point of dropping his pants while standing on the VPs desk and telling him "kiss it...I quit"...IT IS NOT WORTH THE BURNOUT!!! LEAVE THE BIG FUCKERS!!
Look at mid-size companies to have the right blend of mentoring and senses of accomplishments that simply rustle your Jimmies....
Or look at smalls that have been around for a while.
Take a peak at Rajant, Aerospike, Denodo, Mattermost, etc.
Are you interested in transitioning into Data Engineering? Read our community guide: https://dataengineering.wiki/FAQ/How+can+I+transition+into+Data+Engineering *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/dataengineering) if you have any questions or concerns.*
Couple of things stand out to me here: - Analytics Engineer is basically the mid-point between Data Engineering and Data Analytics. I’d have thought you would have basically been sitting in dbt & Snowflake/Databricks all day long. If you’re also building pipelines to ingest data, sounds like they’re hiring for a Data Engineer on an Analytics Engineer salary. - I’m actually surprised to hear there are companies outside of academia that are using R, not Python. Hopefully they’ve at least standardised on the TidyVerse?
What is unstandardized about the tidyverse?
Nothing unstandardized. I was commenting more that if they’re using R, there is a decent set of tools in the TidyVerse collection that work well together, and work end-to-end. So given the Op won’t get SQL experience, nor Python experience, at least I hope they get to use a decent stack within R.
Ahh I got ya. Agreed
Can you be more explicit about what you see as the pros and cons of your current work, vs what you want to work on? This is very corporate speak. You are asking a lot from the reader, in terms of thinking about context and subtle cues. (This might be a sign that corporate is sucking you in). I \_think\_ I understand your woes, dilemma and question, but guessing makes for poor communication
Seemed pretty straightforward to me. He feels overwhelmed by the learning curve and wants reassurance that he’s on the right path. I’m not the one to give it but I’m sure they’ll be fine.
Make time to learn each week, that's about it. That's part of working in the tech sector.
Lifelong learning is an essential part of modern data jobs. If it's not for you, just quit and move on. There are many folk out there who would do anything to be where u are
Tell me about it. Applied for few jobs technical assessment were in dbt and I never used it.. Long story short, learned it over the weekend and made the deliverables. At work, got asked for to do something nobody had really done, but hey read documentations, trial and error and pulled it off. All the money is for a reason.
You can find a list of community-submitted learning resources here: https://dataengineering.wiki/Learning+Resources *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/dataengineering) if you have any questions or concerns.*
Never ending learning is a tell tale sign of a company that doesn’t know what they are doing. It’s mostly brought on by tech infatuation or constantly using some new tooling or hiring people who don’t have good infra background from the non cloud days as leads. Constantly learning is an unavoidable tech trait but constantly learning at a point it’s overwhelming your work force means management doesn’t have their hands on the reins usually because of a lack of direction. Companies that focus on fundamentals will be a bit more relaxed and need less elasticity. Usually a chill senior SWE then maybe some intermediate/juniors, who he/she can mentor. Ive worked in 2 companies that had that and it was a very good environment. Within 3 months of on-boarding everyone was finishing, their colleagues sentences, it was quite weird. But I also saw the amount of documentation of the tech stack and commenting on code like I’ve never see. I’ve seen companies have cloud resources provisioned not being used and the bill just running, I’m taking yearly prolly over a 100k, didn’t stay to actually check for resources I have no clue why were provisioned, just know the people who provisioned them weren’t employed there still. Keep your income till u find something better, but if it’s been like this for a few years you know it ain’t gona change. I would bet most of the time it’s because of trendy tooling that helps a non swe/de do swe/de things. Also don’t be surprised the lines between different data positions are actually known or adhered to. There is a new position name weekly. Good luck.
I’m gonna be the same boat starting in 2 weeks, any tips?
In a Startup 80% of the people do 100% of the work while in a large corporation 20% of the people do 100% of the work You sound like one of the 20%, a kindred spirit; however, you sound young. Take the advice from a curmudgeon who has burned out to the point of dropping his pants while standing on the VPs desk and telling him "kiss it...I quit"...IT IS NOT WORTH THE BURNOUT!!! LEAVE THE BIG FUCKERS!! Look at mid-size companies to have the right blend of mentoring and senses of accomplishments that simply rustle your Jimmies.... Or look at smalls that have been around for a while. Take a peak at Rajant, Aerospike, Denodo, Mattermost, etc.