| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| screen_scrapping_the_at_t_home_base [2017/11/21 16:18] – jtkorb | screen_scrapping_the_at_t_home_base [2017/11/23 05:11] (current) – jtkorb |
|---|
| ====== Screen Scraping the AT&T Home Base Unit ====== | ====== Screen Scraping the AT&T Home Base Unit ====== |
| | |
| | <WRAP round important 60%> |
| | Initial Notes \\ |
| | Under Construction |
| | </WRAP> |
| | |
| |
| http://192.168.1.1/index.html#login | http://192.168.1.1/index.html#login |
| ===== Useful-Seeming Websites ===== | ===== Useful-Seeming Websites ===== |
| |
| https://kazuar.github.io/scraping-tutorial/ | https://kazuar.github.io/scraping-tutorial/ |
| http://docs.python-requests.org/en/master/user/install/ (not used) | http://docs.python-requests.org/en/master/user/install/ (not used) |
| http://stanford.edu/~mgorkove/cgi-bin/rpython_tutorials/webscraping_with_lxml.php (not clear needed; could use built-in) | http://stanford.edu/~mgorkove/cgi-bin/rpython_tutorials/webscraping_with_lxml.php (not clear needed; could use built-in) |
| https://askubuntu.com/questions/851401/where-to-find-geckodriver-needed-by-selenium-python-package (for help installing Selenium) | https://askubuntu.com/questions/851401/where-to-find-geckodriver-needed-by-selenium-python-package (for help installing Selenium) |
| https://github.com/mozilla/geckodriver | https://github.com/mozilla/geckodriver |
| https://github.com/mozilla/geckodriver/issues/371 (need virtual display) | https://github.com/mozilla/geckodriver/issues/371 (need virtual display) |
| https://groups.google.com/forum/#!topic/selenium-users/eOHZAu2xLkk | https://groups.google.com/forum/#!topic/selenium-users/eOHZAu2xLkk |
| https://stackoverflow.com/questions/36122160/how-to-wait-a-page-is-loaded-in-python-selenium (might be needed to wait) | https://stackoverflow.com/questions/36122160/how-to-wait-a-page-is-loaded-in-python-selenium (might be needed to wait) |
| https://stackoverflow.com/questions/16114244/get-contents-of-entire-page-using-selenium (driver.page_source) | https://stackoverflow.com/questions/16114244/get-contents-of-entire-page-using-selenium (driver.page_source) |
| https://docs.python.org/2/library/xml.etree.elementtree.html#xml.etree.ElementTree.Element.iter | https://docs.python.org/2/library/xml.etree.elementtree.html#xml.etree.ElementTree.Element.iter |