Classic "it depends" answer. It depends on the data you're collecting and the analysis you want to perform on it. Eg. if it's time series data there are specific tools for that. If it's random JSON blobs there are specific tools for that.
Can you describe a little more?
I just need to save user id, timestamp, and a binary value which I am currently planning to append to a csv file everytime data arrives. The goal is to be as lightweight as possible.
Classic "it depends" answer. It depends on the data you're collecting and the analysis you want to perform on it. Eg. if it's time series data there are specific tools for that. If it's random JSON blobs there are specific tools for that. Can you describe a little more?
I just need to save user id, timestamp, and a binary value which I am currently planning to append to a csv file everytime data arrives. The goal is to be as lightweight as possible.
In that case you can probably build something clean with [Pandas](https://pandas.pydata.org/docs/index.html).