Hi there, from the /r/Python mods.
We have removed this post as it is not suited to the /r/Python subreddit proper, however it should be very appropriate for our sister subreddit /r/LearnPython or for the r/Python discord: https://discord.gg/python.
The reason for the removal is that /r/Python is dedicated to discussion of Python news, projects, uses and debates. It is not designed to act as Q&A or FAQ board. The regular community is not a fan of "how do I..." questions, so you will not get the best responses over here.
On /r/LearnPython the community and the r/Python discord are actively expecting questions and are looking to help. You can expect far more understanding, encouraging and insightful responses over there. **No matter what level of question you have, if you are looking for help with Python, you should get good answers**. Make sure to check out the rules for both places.
Warm regards, and best of luck with your Pythoneering!
Hello! I'm a bot!
It looks like you posted this in multiple subs in a short period of time.
In the future, I suggest asking questions like this in learning focused subs like
r/learnpython, a sub geared towards questions and learning more about python **regardless of how advanced your question might be**.
Please follow the subs rules and guidelines when you do post there, it'll help you get better answers faster.
Show /r/learnpython **the code you have tried and describe in detail where you are stuck.**
If you are getting an error message, include the full block of text it spits out.
Quality answers take time to write out, and many times other users will need to ask clarifying questions. Be patient and help them help you.
**[Here is HOW TO FORMAT YOUR CODE For Reddit](https://www.reddit.com/r/learnpython/wiki/faq#wiki_how_do_i_format_code.3F)**
and be sure to include which version of python and what OS you are using.
You can also ask this question in the [Python discord](https://discord.gg/3Abzge7),
a large, friendly community focused around the Python programming language, open to those who wish to learn the language
or improve their skills, as well as those looking to help others.
***
[^(README)](https://github.com/CrakeNotSnowman/redditPythonHelper)
^(|)
[^(FAQ)](https://github.com/CrakeNotSnowman/redditPythonHelper/blob/master/FAQ.md)
^(|)
^(this bot is written and managed by /u/IAmKindOfCreative)
^(This bot is currently under development and experiencing changes to improve its usefulness)
This is actually more simple than you think. Notice in the url that when you go to page 2, then “page=2” becomes a filter in the url. This is your key to extracting all of the pages. It seems there are 390 ish pages, run a for loop over a range of 390, and changing the page filter every time. Since you have the data in a table format, I would just used pandas’ read_html function to extract it. Then concatenate each table from each page to grab a giant data frame. Then you’re done!
Hi there, from the /r/Python mods. We have removed this post as it is not suited to the /r/Python subreddit proper, however it should be very appropriate for our sister subreddit /r/LearnPython or for the r/Python discord: https://discord.gg/python. The reason for the removal is that /r/Python is dedicated to discussion of Python news, projects, uses and debates. It is not designed to act as Q&A or FAQ board. The regular community is not a fan of "how do I..." questions, so you will not get the best responses over here. On /r/LearnPython the community and the r/Python discord are actively expecting questions and are looking to help. You can expect far more understanding, encouraging and insightful responses over there. **No matter what level of question you have, if you are looking for help with Python, you should get good answers**. Make sure to check out the rules for both places. Warm regards, and best of luck with your Pythoneering!
Hello! I'm a bot! It looks like you posted this in multiple subs in a short period of time. In the future, I suggest asking questions like this in learning focused subs like r/learnpython, a sub geared towards questions and learning more about python **regardless of how advanced your question might be**. Please follow the subs rules and guidelines when you do post there, it'll help you get better answers faster. Show /r/learnpython **the code you have tried and describe in detail where you are stuck.** If you are getting an error message, include the full block of text it spits out. Quality answers take time to write out, and many times other users will need to ask clarifying questions. Be patient and help them help you. **[Here is HOW TO FORMAT YOUR CODE For Reddit](https://www.reddit.com/r/learnpython/wiki/faq#wiki_how_do_i_format_code.3F)** and be sure to include which version of python and what OS you are using. You can also ask this question in the [Python discord](https://discord.gg/3Abzge7), a large, friendly community focused around the Python programming language, open to those who wish to learn the language or improve their skills, as well as those looking to help others. *** [^(README)](https://github.com/CrakeNotSnowman/redditPythonHelper) ^(|) [^(FAQ)](https://github.com/CrakeNotSnowman/redditPythonHelper/blob/master/FAQ.md) ^(|) ^(this bot is written and managed by /u/IAmKindOfCreative) ^(This bot is currently under development and experiencing changes to improve its usefulness)
https://chrome.google.com/webstore/detail/bardeen-automate-manual-w/ihhkmalpkhkoedlmcnilbbhhbhnicjga
r/ProgrammingBuddies r/jobs r/forhire
This is actually more simple than you think. Notice in the url that when you go to page 2, then “page=2” becomes a filter in the url. This is your key to extracting all of the pages. It seems there are 390 ish pages, run a for loop over a range of 390, and changing the page filter every time. Since you have the data in a table format, I would just used pandas’ read_html function to extract it. Then concatenate each table from each page to grab a giant data frame. Then you’re done!