I need to extract data from a site where the content gets loaded through JavaScript after the page loads. I’m working in Microsoft Azure Notebook and want to keep everything in Python with Jupyter notebooks.
The problem is that regular scraping tools can’t see the content that gets added by JavaScript. I looked into PhantomJS and CasperJS but they need admin rights to install, which I don’t have in the notebook environment.
Are there any other browser automation solutions that work in Azure Notebook for handling JavaScript-generated content? I’m open to Python libraries or other approaches that don’t require system-level installation.