LinkedIn post ·

Screaming Frog & OpenAI Integration - 20th major release of the software

Engagement on LinkedIn, as of 2026-10-19

Reactions
42
Comments
2

Source: LinkedIn activity page (reactions, comments, reposts).

Screaming Frog & OpenAI Integration - 20th major release of the software

You’re now able to execute custom JavaScript while crawling. This means you’re able to manipulate pages or extract data, as well as communicate with APIs such as OpenAI’s ChatGPT, local LLMs, or other libraries.

Crawl with ChatGPT
You can select the ‘(ChatGPT) Template’ snippet, open it up in the JS editor, add your OpenAI API key, and adjust the prompt to query anything you like against a page while crawling.

At the top of each template, there is a comment which explains how to adjust the snippet. You’re able to test it’s working as expected in the right-hand JS editor dialog pre-crawling.

Thanks for sharing, Zachary Chahalis
Source: https://lnkd.in/eMcbe6aU

#screamingfrog
#openai
#release

"Crawl with ChatGPT" custom JavaScript snippet in a crawler tool

First published on LinkedIn on May 7, 2024, 12:35 PM UTC (original). Kept here in full so it stays available; the media are this site's copies of the ones on LinkedIn, also in Venkata Pagadala - Universe.

More posts on these topics