Skip to content

issues Search Results · repo:scrapy-plugins/scrapy-playwright language:Python

Filter by

255 results
 (90 ms)

255 results

inscrapy-plugins/scrapy-playwright (press backspace or delete to remove)

I was trying to use extension with scrapy playwright, the extension is loaded to chrome process correctly but when i do a request the extension dont be activate tho this context/window like the extension ...
  • Jaogmar
  • Opened 
    on Apr 2
  • #342

What is (possibly) going wrong? Observing a mismatch between the (scrapy) Response headers and the Response body. How to reproduce? 1. Crawl a spider that would yield a single (scrapy) Request configured ...
  • ish-101
  • Opened 
    on Feb 27
  • #341

Is there a way to test an async callback using Scrapy contracts? Based on the error message, it seems like there s no support for that. It would be great to have this feature, or maybe I m missing something. ...
upstream issue
  • Ehsan-U
  • 1
  • Opened 
    on Feb 17
  • #340

Is it possible to access the playwright cookies in the callback without passing the page itself ? it can be accessed by storing into global variable but that could cause issues in case of multiple pages. ...
  • Ehsan-U
  • Opened 
    on Feb 15
  • #339

First of all, thanks for this plugin. I ve been actively using it and it s really great! Recently, I ran cProfile on a Scrapy spider that I m developing and the results suggest that the request and response ...
enhancement
  • jl-martins
  • 2
  • Opened 
    on Feb 12
  • #335

I am trying to use SitemapSpider with Playwright, but it doesn t work because XML gets transformed into HTML (webkit-xml-viewer). Is there any way to prevent this from happening? I cannot disable Playwright ...
enhancement
  • galloj
  • 1
  • Opened 
    on Feb 11
  • #334

I d like to propose scrapy-playwright add support for running pre-recorded Playwright scripts directly, in addition to the existing PageMethod approach. Reasoning - Ease of Use: Users could record ...
  • hamiltont
  • 1
  • Opened 
    on Jan 27
  • #333

When I add the settings for DOWNLOAD_ANDLERS(whether set in scrapy.settting or custom_settings) DOWNLOAD_HANDLERS :{ http : scrapy_playwright.handler.ScrapyPlaywrightDownloadHandler , https : scrapy_playwright.handler.ScrapyPlaywrightDownloadHandler ...
needs more info
support
Windows
  • Bluenight1
  • 4
  • Opened 
    on Dec 26, 2024
  • #332

I have long scrapes with long sequences of actions needed to be taken during playwright scrape. I have handled most of the problems with scrape and established long runes. I am now facing issues with lost ...
  • milan-cp-dev
  • 1
  • Opened 
    on Dec 23, 2024
  • #331

I m facing a sporadic issue with crawler process hangs after scrapy-playwright failed to navigate to a valid URL. 2024-12-08 09:56:38 [scrapy-playwright] DEBUG: Navigating to some valid url failed 2024-12-08 ...
  • alembiewski
  • 5
  • Opened 
    on Dec 8, 2024
  • #330
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Restrict your search to the title by using the in:title qualifier.
Issue search results · GitHub