Troubleshooting Puppeteer Script Errors

Other Questions Puppeteer
1

Legacy Puppeteer scraper fails: XPath queries trigger error ‘page.$x is not a function’ even after selector updates. How can this be fixed?

const engine = require('puppeteer');

async function startCrawl() {
  const instance = await engine.launch({ headless: true });
  const tab = await instance.newPage();
  try {
    const nodes = await tab.$x('//span[contains(@class, "sample-item")]');
    console.log('Nodes:', nodes);
  } catch (error) {
    console.error('XPath error:', error);
  }
  await instance.close();
}

startCrawl();
2

In my experience, the error ‘page.$x is not a function’ often indicates a version mismatch or an unexpected object type returned by the launch process. I encountered this issue when using a slightly outdated version of Puppeteer that did not have proper support for the $x method. Verifying the Puppeteer package version in your package.json file and updating to the latest stable release resolved the issue in my case. Also, ensure that no conflicting libraries or global modifications are interfering with Puppeteer’s prototypes.