Log inSign up
Log inSign up
Scrapling 🕷️
287 posts
Scrapling 🕷️ profile banner
@Scrapling_dev

Scrapling 🕷️

@Scrapling_dev
Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl by @D4Vinci1 Follow for daily tips & tricks.
scrapling.readthedocs.io/en/latest/
Joined April 2025
1 Following
1,043 Followers
RepliesRepliesRepostsRepostsMediaMedia

Log in or sign up for X

See what’s happening and join the conversation

Continue with phone
or
Log in with username or email
Terms·Privacy·Cookies·Accessibility·US TIDA·Ads Info·© 2026 X Corp.
  • Pinned
    @Scrapling_dev
    Scrapling 🕷️
    @Scrapling_dev
    Aug 23
    Important 🚨
    @D4Vinci1
    Karim Shoair
    @D4Vinci1
    Aug 23
    Scrapling v0.4.15 is out, and it's one of the biggest releases this year 🚀 🤖 The MCP server is reworked from the ground up. Tools are now split into one-shot tools and session tools, so your AI agent's session settings never get silently overwritten again. The new make_request
  • @Scrapling_dev
    Scrapling 🕷️
    @Scrapling_dev
    4h
    🕷️ Scrapling tip: is_blocked() can catch block pages that return 200 OK. Check for the site's challenge form and keep the built-in status checks with super(). Scrapling retries the request before parse() sees it. Stop silent data loss 🎯
  • @Scrapling_dev
    Scrapling 🕷️
    @Scrapling_dev
    Oct 8
    🕷️ Scrapling tip: DynamicSession can download files too. Fetch an image URL and save response.body as bytes. The download uses the same browser session as your scrape, with its cookies and proxy settings. No second HTTP client to set up ⚡
  • @Scrapling_dev
    Scrapling 🕷️
    @Scrapling_dev
    Oct 7
    🕷️ Scrapling tip: XMLFeedSpider strips XML namespaces before parse_node() runs. Read dc:creator with node.findtext("creator"), no namespace map needed. This example turns the Python blog feed into JSON with titles and authors. 🎯
  • @Scrapling_dev
    Scrapling 🕷️
    @Scrapling_dev
    Oct 6
    🕷️ Scrapling tip: user_data_dir keeps a browser profile on disk. Close the browser, start a new DynamicSession with the same folder, and localStorage is still there. No manual state export or import. Try the two-session demo below ⚡