I was trying to retrieve information using the Selenium library in Python, from here.
This is my code, I tried accessing the elements using their XPATHs.
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
# Create a new instance of the Chrome driver
driver = webdriver.Chrome()
# Open the webpage
driver.get("https://tuludictionary.in/dictionary/cgi-bin/web/frame.html")
# Select the 'Tulu' radio button
tulu_radio = driver.find_element(By.XPATH, "/html/body/table/tbody/tr/td[1]/form/input[1]")
tulu_radio.click()
# Select the 'Anywhere' radio button
anywhere_radio = driver.find_element(By.XPATH, "/html/body/table/tbody/tr/td[1]/form/input[6]")
anywhere_radio.click()
# Input "AA" in the text box
search_box = driver.find_element(By.XPATH, "/html/body/table/tbody/tr/td[2]/input[1]")
search_box.send_keys("AA")
# Click on the search button
search_button = driver.find_element(By.XPATH, "/html/body/table/tbody/tr/td[2]/input[2]")
search_button.click()
# Check and process search results
output_area = driver.find_element(By.XPATH, "/html/body/table/tbody/tr/td")
output_text = output_area.text.strip()
# Wait for the results to load
try:
if output_text != "No results found":
# Extract and print the text part of the links
# Wait for the list of links to be displayed
link_elements = WebDriverWait(driver, 10).until(
EC.presence_of_all_elements_located((By.XPATH, "/html/body/table/tbody/tr/td"))
)
if len(link_elements) > 0:
# Get the text of the links
links_text = [link.text for link in link_elements]
print("List of links:")
for link_text in links_text:
print(link_text)
# Click on the fourth link
fourth_link = link_elements[3]
fourth_link.click()
else:
print("NULL")
result = None
except:
# Failed to retrieve results
print("Failed to retrieve results")
result = None
# Close the browser
driver.quit()
I tried doing a few things, first clicking on the ‘Tulu’, and ‘Anywhere’ or ‘Starting with’ radio buttons. Then passing the text in the textbox, say ‘AA’, ‘JK’, and post-clicking the search button, checking whether ‘No results found’ is displayed on the output area. If yes, NULL is returned, else I return the entire text of the output area (which has multiple links). I also tried clicking on one of the links, say the fourth one.
The code didn’t seem to work, and the web driver closed abruptly with the following error.
File "C:UserschakrAppDataLocalTemptempCodeRunnerFile.python", line 13, in <module>
tulu_radio = driver.find_element(By.XPATH, "/html/body/table/tbody/tr/td[1]/form/input[1]")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:Program FilesPython311Libsite-packagesseleniumwebdriverremotewebdriver.py", line 740, in find_element
return self.execute(Command.FIND_ELEMENT, {"using": by, "value": value})["value"]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:Program FilesPython311Libsite-packagesseleniumwebdriverremotewebdriver.py", line 346, in execute
self.error_handler.check_response(response)
File "C:Program FilesPython311Libsite-packagesseleniumwebdriverremoteerrorhandler.py", line 245, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"xpath","selector":"/html/body/table/tbody/tr/td[1]/form/input[1]"}
(Session info: chrome=114.0.5735.135); For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#no-such-element-exception
Stacktrace:
Backtrace:
GetHandleVerifier [0x00F5A813+48355]
(No symbol) [0x00EEC4B1]
(No symbol) [0x00DF5358]
(No symbol) [0x00E209A5]
(No symbol) [0x00E20B3B]
(No symbol) [0x00E4E232]
(No symbol) [0x00E3A784]
(No symbol) [0x00E4C922]
(No symbol) [0x00E3A536]
(No symbol) [0x00E182DC]
(No symbol) [0x00E193DD]
GetHandleVerifier [0x011BAABD+2539405]
GetHandleVerifier [0x011FA78F+2800735]
GetHandleVerifier [0x011F456C+2775612]
GetHandleVerifier [0x00FE51E0+616112]
(No symbol) [0x00EF5F8C]
(No symbol) [0x00EF2328]
(No symbol) [0x00EF240B]
(No symbol) [0x00EE4FF7]
BaseThreadInitThunk [0x753C7D59+25]
RtlInitializeExceptionChain [0x7725B74B+107]
RtlClearBits [0x7725B6CF+191]
Could someone point out what is wrong with the code and what should be changed?
2
Answers
There is a
FRAMEwhich is wrapping all the desired elements, you need to switch into it first and then perform actions like clicking on the radio buttons.Code to switch into the FRAME:
UPDATE:
Below is the complete working code:
Console Output:
When you access the webpage the options Tulu and Starting With is selected by default. So you just need to pass the text AA within the search box and click on search
Solution
To send a character sequence within the search box as the elements are within an
<iframe>so you have to:Induce WebDriverWait for the
frame_to_be_available_and_switch_to_it.Induce WebDriverWait for the desired element to be clickable.
You can use either of the following locator strategies:
Code block:
Console output:
Note : You have to add the following imports :
Reference
You can find a couple of relevant discussions in: