Question: I am practicing Selenium in Python and I wanted to fetch all the links on a web page using Selenium.

For example, I want all the links in the `href=` property of all the `<a>` tags on <http://psychoticelites.com/>

I've written a script and it is working. But, it's giving me the object address. I've tried using the `id` tag to get the value, but, it doesn't work.

My current script:

```
from selenium import webdriver
from selenium.webdriver.common.keys import Keys

driver = webdriver.Firefox()
driver.get("http://psychoticelites.com/")

assert "Psychotic" in driver.title

continue_link = driver.find_element_by_tag_name('a')
elem = driver.find_elements_by_xpath("//*[@href]")
#x = str(continue_link)
#print(continue_link)
print(elem)

```

Answer: 
You can import the HTML dom using html dom library in python. You can find it over here and install it using PIP:

<https://pypi.python.org/pypi/htmldom/2.0>

```
from htmldom import htmldom
dom = htmldom.HtmlDom("https://www.github.com/")  
dom = dom.createDom()

```

The above code creates a HtmlDom object.The HtmlDom takes a default parameter, the url of the page. Once the dom object is created, you need to call "createDom" method of **HtmlDom**. This will parse the html data and constructs the parse tree which then can be used for searching and manipulating the html data. The only restriction the library imposes is that the data whether it is html or xml must have a root element.

You can query the elements using the "find" method of HtmlDom object:

```
p_links = dom.find("a")  
for link in p_links:
  print ("URL: " +link.attr("href"))

```

The above code will print all the links/urls present on the web page
Unfortunately, the original link posted by OP is dead...

If you're looking for a way to scrape links on a page, here's how you can scrape all of the "Hot Network Questions" links on this page with [gazpacho](https://github.com/maxhumber/gazpacho):

```py
from gazpacho import Soup

url = "https://stackoverflow.com/q/34759787/3731467"

soup = Soup.get(url)
a_tags = soup.find("div", {"id": "hot-network-questions"}).find("a")

[a.attrs["href"] for a in a_tags]

```