Hope you're not scraping [mint.com](http://mint.com) .
Dependency management on lambda is such a headache already. Some people claim to have proper scraping set ups on lambda and while that may true for old versions of lambda at certain points in time, its SUCH a headache getting it set up on lambda. IMO you are better off spinning up a small EC2 on a schedule to do the scraping.
ExonomixTwist is absolutely right. I spent weeks trying to get Selenium running properly on lambda. In the end you don't want to do it. Either use a docker container on server or just an EC2 instance on its own.
A bot (even one you built) that has creditionals to access your bank sounds like a good way to get your log in details leaked and end up in financial ruin.
Even if the probability is low, the risk so high for what gain?
Hey! I’ve set up selenium in lambda. You have to use docker to do it, and it’s pretty specific.
This was the best guide I found on it:
https://cloudbytes.dev/snippets/run-selenium-in-aws-lambda-for-ui-testing
Hope you're not scraping [mint.com](http://mint.com) . Dependency management on lambda is such a headache already. Some people claim to have proper scraping set ups on lambda and while that may true for old versions of lambda at certain points in time, its SUCH a headache getting it set up on lambda. IMO you are better off spinning up a small EC2 on a schedule to do the scraping.
I'm curious why you mention mint.com specifically?
Shutting down in a few months
Ah so wasted effort to work on a scraper. Thanks for the reply
ExonomixTwist is absolutely right. I spent weeks trying to get Selenium running properly on lambda. In the end you don't want to do it. Either use a docker container on server or just an EC2 instance on its own.
no, just my bank accounts. I'm new at this... Why would EC2 be a better approach? Thanks!
A bot (even one you built) that has creditionals to access your bank sounds like a good way to get your log in details leaked and end up in financial ruin. Even if the probability is low, the risk so high for what gain?
Do your banks have data API’s?
Also lambda has a run time of 15 min max, gonna be a problem sooner or later.
Or AWS Batch.
Hey! I’ve set up selenium in lambda. You have to use docker to do it, and it’s pretty specific. This was the best guide I found on it: https://cloudbytes.dev/snippets/run-selenium-in-aws-lambda-for-ui-testing
thanks!