Tim Korb's Home Page

User Tools

Site Tools

Trace:
screen_scrapping_the_at_t_home_base

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision		Previous revision
screen_scrapping_the_at_t_home_base [2017/11/21 13:22] – created jtkorbscreen_scrapping_the_at_t_home_base [2017/11/23 05:11] (current) – jtkorb
Line 1: Line 1:
 ====== Screen Scraping the AT&T Home Base Unit ====== ====== Screen Scraping the AT&T Home Base Unit ======
 +
 +<WRAP round important 60%>
 +Initial Notes \\
 +Under Construction
 +</WRAP>
 +
  
   http://192.168.1.1/index.html#login   http://192.168.1.1/index.html#login
Line 7: Line 13:
   http://192.168.1.1/index.html#dataUsed   http://192.168.1.1/index.html#dataUsed
   <span class="attBlueColor" data-bind="text:have_used_data">932.11&nbsp;GB</span>   <span class="attBlueColor" data-bind="text:have_used_data">932.11&nbsp;GB</span>
 +  
 +===== Useful-Seeming Websites =====
 +
 +  https://kazuar.github.io/scraping-tutorial/
 +  http://docs.python-requests.org/en/master/user/install/ (not used)
 +  http://stanford.edu/~mgorkove/cgi-bin/rpython_tutorials/webscraping_with_lxml.php (not clear needed; could use built-in)
 +  https://askubuntu.com/questions/851401/where-to-find-geckodriver-needed-by-selenium-python-package (for help installing Selenium)
 +  https://github.com/mozilla/geckodriver
 +  https://github.com/mozilla/geckodriver/issues/371 (need virtual display)
 +  https://groups.google.com/forum/#!topic/selenium-users/eOHZAu2xLkk
 +  https://stackoverflow.com/questions/36122160/how-to-wait-a-page-is-loaded-in-python-selenium (might be needed to wait)
 +  https://stackoverflow.com/questions/16114244/get-contents-of-entire-page-using-selenium (driver.page_source)
 +  https://docs.python.org/2/library/xml.etree.elementtree.html#xml.etree.ElementTree.Element.iter
screen_scrapping_the_at_t_home_base.1511299340.txt.gz · Last modified: 2017/11/21 13:22 by jtkorb