scrapy-playwright documentation

A Scrapy download handler that performs requests using Playwright for Python. It can be used to handle pages that require JavaScript (among other things), while adhering to the regular Scrapy workflow (i.e. without interfering with request scheduling, item processing, etc).

After the initial setup, set the playwright Request.meta key on the requests that you want Playwright to download.