Both sides previous revisionPrevious revisionNext revision | Previous revision |
screen_scrapping_the_at_t_home_base [2017/11/21 16:18] – jtkorb | screen_scrapping_the_at_t_home_base [2017/11/23 05:11] (current) – jtkorb |
---|
====== Screen Scraping the AT&T Home Base Unit ====== | ====== Screen Scraping the AT&T Home Base Unit ====== |
| |
| <WRAP round important 60%> |
| Initial Notes \\ |
| Under Construction |
| </WRAP> |
| |
| |
http://192.168.1.1/index.html#login | http://192.168.1.1/index.html#login |
===== Useful-Seeming Websites ===== | ===== Useful-Seeming Websites ===== |
| |
https://kazuar.github.io/scraping-tutorial/ | https://kazuar.github.io/scraping-tutorial/ |
http://docs.python-requests.org/en/master/user/install/ (not used) | http://docs.python-requests.org/en/master/user/install/ (not used) |
http://stanford.edu/~mgorkove/cgi-bin/rpython_tutorials/webscraping_with_lxml.php (not clear needed; could use built-in) | http://stanford.edu/~mgorkove/cgi-bin/rpython_tutorials/webscraping_with_lxml.php (not clear needed; could use built-in) |
https://askubuntu.com/questions/851401/where-to-find-geckodriver-needed-by-selenium-python-package (for help installing Selenium) | https://askubuntu.com/questions/851401/where-to-find-geckodriver-needed-by-selenium-python-package (for help installing Selenium) |
https://github.com/mozilla/geckodriver | https://github.com/mozilla/geckodriver |
https://github.com/mozilla/geckodriver/issues/371 (need virtual display) | https://github.com/mozilla/geckodriver/issues/371 (need virtual display) |
https://groups.google.com/forum/#!topic/selenium-users/eOHZAu2xLkk | https://groups.google.com/forum/#!topic/selenium-users/eOHZAu2xLkk |
https://stackoverflow.com/questions/36122160/how-to-wait-a-page-is-loaded-in-python-selenium (might be needed to wait) | https://stackoverflow.com/questions/36122160/how-to-wait-a-page-is-loaded-in-python-selenium (might be needed to wait) |
https://stackoverflow.com/questions/16114244/get-contents-of-entire-page-using-selenium (driver.page_source) | https://stackoverflow.com/questions/16114244/get-contents-of-entire-page-using-selenium (driver.page_source) |
https://docs.python.org/2/library/xml.etree.elementtree.html#xml.etree.ElementTree.Element.iter | https://docs.python.org/2/library/xml.etree.elementtree.html#xml.etree.ElementTree.Element.iter |