User Tools

Site Tools


screen_scrapping_the_at_t_home_base

Screen Scraping the AT&T Home Base Unit

Initial Notes
Under Construction

http://192.168.1.1/index.html#login
<input data-trans="tooltip_login" id="txtPwd" autocomplete="off" type="password" data-bind="value:password, valueUpdate: 'keypress'" maxlength="32" name="txtPwd" title="Admin login password" class="valid">
<input id="btnLogin" class="btn-1" type="submit" data-trans="submit" value="Submit">

http://192.168.1.1/index.html#dataUsed
<span class="attBlueColor" data-bind="text:have_used_data">932.11&nbsp;GB</span>

Useful-Seeming Websites

https://kazuar.github.io/scraping-tutorial/
http://docs.python-requests.org/en/master/user/install/ (not used)
http://stanford.edu/~mgorkove/cgi-bin/rpython_tutorials/webscraping_with_lxml.php (not clear needed; could use built-in)
https://askubuntu.com/questions/851401/where-to-find-geckodriver-needed-by-selenium-python-package (for help installing Selenium)
https://github.com/mozilla/geckodriver
https://github.com/mozilla/geckodriver/issues/371 (need virtual display)
https://groups.google.com/forum/#!topic/selenium-users/eOHZAu2xLkk
https://stackoverflow.com/questions/36122160/how-to-wait-a-page-is-loaded-in-python-selenium (might be needed to wait)
https://stackoverflow.com/questions/16114244/get-contents-of-entire-page-using-selenium (driver.page_source)
https://docs.python.org/2/library/xml.etree.elementtree.html#xml.etree.ElementTree.Element.iter
screen_scrapping_the_at_t_home_base.txt · Last modified: 2017/11/23 05:11 by jtkorb