Troubleshooting modal dialogs in headless Selenium with Python

Other Questions Headless Browser
1

I’m working on a project using Python and Selenium in a headless environment on an Amazon EC2 instance. I’m running into an issue with modal dialogs. Every time I try to interact with the page, I get a WebDriverException saying ‘Modal dialog present’.

Here’s a simplified version of what I’m trying to do:

from selenium import webdriver
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By

def check_page():
    driver = webdriver.Firefox()
    driver.get('https://example.com')
    
    try:
        element = WebDriverWait(driver, 10).until(
            lambda x: x.find_element(By.ID, 'main-content')
        )
        print('Found element!')
    except Exception as e:
        print(f'Error: {e}')
    finally:
        driver.quit()

check_page()

This code keeps failing with the modal dialog error. Does anyone know how to handle these dialogs in a headless environment? I’ve tried using alert.accept() but it doesn’t seem to work. Any suggestions would be greatly appreciated!

2

Have you considered using a custom ExpectedCondition to wait for the modal to disappear? This approach can be more reliable than a fixed sleep. Here’s an example:

from selenium.webdriver.support import expected_conditions as EC

class modal_not_present(object):
def call(self, driver):
try:
alert = driver.switch_to.alert
alert.text
return False
except:
return True

wait = WebDriverWait(driver, 10)
wait.until(modal_not_present())

This code waits for up to 10 seconds for the modal to disappear before proceeding. It’s more flexible than a fixed wait and can help avoid timing issues. If this doesn’t work, the modal might be an HTML element rather than a JavaScript alert, in which case you’d need to locate and interact with it directly using Selenium’s element finding methods.

3

I’ve dealt with similar issues in headless Selenium setups before. One trick that’s worked for me is using JavaScript to dismiss modals directly. Try injecting this script before interacting with the page:

driver.execute_script(“”"
var modals = document.querySelectorAll(‘[class*=“modal”]’);
modals.forEach(function(modal) {
modal.style.display = ‘none’;
});
“”")

This finds elements with ‘modal’ in their class name and hides them. It’s a bit of a sledgehammer approach, but it’s saved me countless headaches when dealing with stubborn modals in headless environments.

If that doesn’t work, you might need to dive deeper into the page structure. Sometimes modals are nested in iframes or have unusual class names. In those cases, you’d need to tailor the JavaScript to target the specific modal on your page.

Hope this helps! Let me know if you need any clarification on implementing this approach.

4

hey, have u tried using a wait before interacting with the page? sometimes modals take a sec to load. you could try something like:

time.sleep(5) # wait 5 seconds
driver.find_element(By.ID, ‘main-content’)

that might give the modal time to appear and disappear before u interact with the page. worth a shot!