The newest Python resources are on the Python page. For a reading order instead of a date order, see the Python learning path.
| Date Added | Link | Excerpt |
|---|---|---|
| 2025-03-01 2025 | GitHub - roshanlam/Spider: Web Crawler built using asynchronous Python and distributed task management that extracts and saves web data for analysis. beginner 4 min read | Library for asynchronous, distributed web crawling and data extraction. It leverages aiohttp, asyncio, Celery, Redis, and PostgreSQL to manage tasks, store data, and process information. Features include a plugin architecture for custom logic, comprehensive webpage data extraction (metadata, content, links, forms, social metadata), NLP-based entity recognition with spaCy, and JavaScript rendering support via Playwright. The library allows for scalable crawling, real-time metrics, and robust logging. |
| 2025-01-14 2025 | Build Your Web Scraper with Crawlbase in Python: A Beginner’s Guide beginner | Learn how to build your first web scraper in Python using Crawlbase. This beginner-friendly guide covers web scraping essentials, bypassing |
| 2024-12-31 2024 | GitHub - danialhalo/SqliSniper: Advanced Time-based Blind SQL Injection fuzzer for HTTP Headers advanced 3 min read Fuzzing SQLi | Tool for advanced time-based blind SQL injection fuzzing in HTTP headers. SqliSniper utilizes multi-threaded scanning for efficiency and employs response time analysis to reduce false positives. It supports custom payloads and headers, and can send alerts to Discord webhooks upon detecting vulnerabilities. The tool can scan single URLs, lists of URLs from a file, or process piped input from other security tools. |
| 2024-12-29 2024 | Python for Dark Web OSINT: Automate Threat Monitoring intermediate OSINT | Learn how to use Python to automate monitoring of dark web forums, leak sites, and marketplaces for actionable threat intelligence. |
| 2024-12-20 2024 | GitHub - xnl-h4ck3r/knoxnl: This is a python wrapper around the amazing KNOXSS API by Brute Logic intermediate 8 min read API Sec | Library for interacting with the KNOXSS API, enabling automated scanning for XSS and Open Redirect vulnerabilities. This Python wrapper supports various input methods, including single URLs and files, and allows for custom configurations for API keys, Discord webhooks, and output formats. It integrates with Burp Suite via the Piper extension, facilitating in-proxy security testing. The library respects KNOXSS API rate limits and offers features like Flash Mode for quick polyglot tests and handling of POST requests. |
| 2024-12-19 2024 | GitHub - WafflesExploits/hide-payload-in-images: A project that demonstrates embedding shellcode payloads into image files (like PNGs) using Python and extracting them using C/C++. Payloads can be retrieved directly from the file on disk or from the image stored in a binary's resources section (.rsrc) advanced 1 min read RCE | Library for embedding and extracting shellcode payloads within image files like PNGs. Utilizes Python for embedding and C/C++ for extraction, supporting retrieval from disk or a binary's `.rsrc` section. Includes stealthy extraction via manual PE header parsing and PEB access, avoiding WinAPI calls for enhanced evasion. Supports both executable and DLL builds with improved PEB structure definitions for portability. |
| 2024-12-12 2024 | GitHub - mherrmann/helium: Lighter web automation with Python beginner 4 min read | Library for lighter web automation in Python, Helium offers a high-level API that simplifies tasks compared to Selenium. It allows referencing elements by user-visible labels, resulting in shorter and more stable scripts. Helium also streamlines interaction with iframes, window management, and provides built-in implicit and explicit waits, eliminating the need for complex `WebDriverWait` calls. The library is sponsored by RapidProxy and can be installed via pip. |
| 2024-12-11 2024 | GitHub - apify/crawlee-python: Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation. beginner 5 min read | Library for building reliable web scrapers and crawlers in Python. It offers a unified interface for both HTTP and headless browser crawling, supporting BeautifulSoupCrawler for HTML parsing and PlaywrightCrawler for JavaScript-heavy sites. Key features include automatic retries, proxy rotation, configurable request routing, persistent queues, and pluggable storage for extracted data and files. Crawlee leverages asyncio for performance and integrates seamlessly with other asynchronous Python libraries. |
| 2024-11-29 2024 | Python Twisted proxy - how to intercept packets intermediate Burp | Library for intercepting and modifying HTTP request and response bodies using Python's Twisted framework. Demonstrates a basic proxy setup using `twisted.web.proxy` and `twisted.internet.reactor`, enabling developers to inspect and alter data as it flows through the proxy. The provided code snippet serves as a starting point for building custom HTTP proxy functionalities. → stackoverflow.com |
| 2024-10-30 2024 | Flask & Pydantic: Streamline Python APIs with Seamless Data Validation intermediate | This guide explores the seamless integration of Flask, a popular web framework, with Pydantic, a powerful data validation library. |
| 2024-10-30 2024 | SSH Scripting with Fabric and Python - Mouse Vs Python beginner 3 min read | Library for executing shell commands remotely over SSH using Python. This resource demonstrates using Fabric 3.2.2 to connect to servers, run commands with or without `sudo`, and transfer files using `put()` and `get()` methods, including uploading to restricted directories via a two-step `put()` and `sudo()` process. |
| 2024-10-24 2024 | Cryptography — The Hitchhiker's Guide to Python beginner 2 min read Secrets | Library for Python cryptography, offering both high-level symmetric encryption with Fernet and low-level primitives via the `cryptography` package. It also provides GPGME Python bindings, enabling interaction with the GNU Privacy Guard suite for encryption, decryption, and signing operations, supporting Python 2.6+ and 3.3+. |
| 2024-10-17 2024 | GitHub - cle-b/httpdbg: A tool for Python developers to easily debug the HTTP(S) client requests in a Python program. intermediate 4 min read | Tool for Python developers to debug HTTP(S) client and server requests. Executing programs via `pyhttpdbg` instead of `python` enables inspection of requests in a web browser at `http://localhost:4909`. Supports HTTP/1.0, HTTP/1.1, and HTTP/2. It can trace requests made by scripts, modules (like `pip`), and tests (`pytest`, `unittest`), and can record requests received by HTTP servers. The tool allows grouping requests by test and offers customization options for the web interface. |
| 2024-10-01 2024 | GitHub - bl4de/security-tools: My collection of various security tools created mostly in Python and Bash. For CTFs and Bug Bounty. intermediate Bug Bounty | My collection of various security tools created mostly in Python and Bash. For CTFs and Bug Bounty. - bl4de/security-tools |
| 2024-09-23 2024 | Let’s build and optimize a Rust extension for Python intermediate 9 min read | Library for optimizing Python performance by building Rust extensions. This resource details how to create a Rust extension for Python using tools like PyO3 and Maturin. It contrasts a memory-intensive exact unique value count with a probabilistic approach, then demonstrates reimplementing the probabilistic algorithm in Rust to achieve significant speed improvements over the pure Python version, showcasing techniques for efficient data handling and integration with Python objects. |
| 2024-08-28 2024 | GitHub - mkalioby/django-mfa2: A Django app that handles MFA, it supports TOTP, U2F, FIDO2 U2F (Webauthn), Email Token and Trusted Devices intermediate 5 min read AuthN | Library providing multi-factor authentication (MFA) for Django applications. It supports TOTP, U2F, FIDO2 (WebAuthn) with various authenticators like security keys and Windows Hello, Email Tokens, and Trusted Devices. The library allows for customizable settings, integration with existing login flows, and offers passwordless login capabilities. |
| 2024-08-21 2024 | 17 Mindblowing Python Automation Scripts I Use Everyday beginner | Scripts That Increased My Productivity and Performance |
| 2024-08-17 2024 | GitHub - wapiti-scanner/wapiti: Web vulnerability scanner written in Python3 intermediate 5 min read | Library for "black-box" web vulnerability scanning, Wapiti leverages Python 3.12-3.14 to act as a fuzzer, discovering vulnerabilities by sending payloads to web applications and analyzing responses. It supports various attack modules, including SQL Injections, XSS, File Disclosure, Command Execution, XXE, Shellshock, and Log4Shell (CVE-2021-44228), Spring4Shell (CVE-2020-5398), and can generate reports in multiple formats. Wapiti offers features like scan suspension, session management, proxy support, and the ability to import cookies from browsers. |
| 2024-08-02 2024 | GitHub - SpaceWolfWasTaken/httpy: A barebones HTTP server created from raw python sockets. intermediate | A barebones HTTP server created from raw python sockets. - SpaceWolfWasTaken/httpy |
| 2024-07-26 2024 | Release v0.3.0 · joaovitoriasilva/endurain news 1 min read AuthN | Library release v0.3.0 for endurain, a Python application security library, introduces OAuth scopes, multi-client support (web and mobile), PWA support, theme and language switchers, and dependency management with poetry. This update also includes significant backend changes to password hashing, requiring automatic migration for admin accounts. Frontend improvements focus on UI fixes and pagination, while general updates include multi-arch Docker images and documentation enhancements. Users should back up their database before updating due to schema changes. |
| 2024-07-23 2024 | Isolating risk in the CPython release process advanced 3 min read | Analysis of CPython's release process improvements, funded by Alpha-Omega, detailing the isolation of source artifact builds using GitHub Actions. This change significantly reduces the dependency footprint for critical build stages, decreasing supply chain risk by separating source artifact generation from documentation builds and testing, with the "Build Source" task now requiring approximately 170 dependencies instead of over 800. |
| 2023-12-18 2023 | Python Asyncio and Footguns intermediate | The content discusses the potential dangers of using Python's Asyncio module, referred to as "footguns," which are pitfalls that can lead to unintended consequences in asynchronous programming. It emphasizes the importance of understanding Asyncio's complexities to avoid common mistakes that can impact performance and reliability. The article likely provides insights on best practices, common pitfalls, and tips for effectively utilizing Asyncio in Python programming to maximize its benefits while minimizing risks. |
| 2023-12-10 2023 | timo-reymann/python-oauth2-cli-auth intermediate 1 min read | Library for simplifying OAuth2 authentication in Python CLIs, supporting OIDC providers like gitlab.com and manual configuration. It offers a straightforward method for obtaining access tokens without external dependencies, facilitating integrations with services requiring OAuth2 authorization. The project encourages community contributions for bug reporting, feature proposals, and code fixes. |
| 2023-11-09 2023 | How to Download Files From URLs With Python beginner 22 min read | Tutorial on downloading files from URLs using Python, covering the built-in `urllib` module and the popular `requests` library. It demonstrates using `urlretrieve()` for simple downloads and `requests.get()` for more advanced interactions. The guide also touches on efficient handling of large files through streaming, parallel downloads with `ThreadPoolExecutor` and `aiohttp`, and extracting metadata from HTTP headers for downloaded content, like the `Content-Type` and `Content-Length` of a World Bank CSV file. → realpython.com |
| 2023-11-07 2023 | Using the bpython Enhanced REPL beginner 1 min read | Library for enhancing the Python Read-Evaluate-Print Loop (REPL). This course teaches installation and usage of bpython, a more programmer-friendly alternative to the standard Python REPL. It covers boosting productivity with bpython's features, configuring color themes, using keyboard shortcuts, and contributing to the open-source project on GitHub. Familiarity with Python basics and the standard REPL is recommended. → realpython.com |
| 2023-11-07 2023 | 4 Python Web Scraping Libraries To Mine News Data beginner 7 min read | Library for mining news data, this resource details four open-source Python web scraping tools: PyGoogleNews, NewsCatcher, Feedparser, and Newspaper3k. These libraries enable developers to extract headlines, article content, authors, dates, and summaries from various news sources without requiring API keys, making them suitable for NLP projects and MVPs. |
| 2023-11-07 2023 | Peticali/FastHttpPy intermediate | Library implementing Golang's FastHttp in Python, achieving 63k requests/second, significantly outperforming Uvicorn. Easily installable via `pip install fasthttppy`, it supports static file serving, custom GET/POST request callbacks, and error/404 page configuration. Further performance gains are possible by replacing JSON communication with direct struct handling. |
| 2023-10-29 2023 | fortra/impacket intermediate 2 min read | Library of Python classes for low-level network protocol interaction, including Ethernet, IP, TCP, UDP, SMB1-3, MSRPC, TDS, and LDAP. Impacket supports Plain, NTLM, and Kerberos authentication and offers tools for security researchers to facilitate network protocol research and educational activities. |
| 2023-09-20 2023 | Episode 99: OAuth 2 and Authentication Choices for Your Python Project beginner 2 min read AuthN | Talk on OAuth 2 and authentication choices for Python projects. Features Dan Moore from FusionAuth discussing system setup, device grants, social login, and privacy. Includes a spotlight on a course for implementing Google Login with Flask, covering OAuth 2, OpenID Connect, and session management. Mentions RFC 6749 and RFC 6750 as key resources. → realpython.com |
| 2023-09-20 2023 | How to Authenticate using Keys BasicAuth OAuth2 inPython beginner 1 min read AuthN | Library for authenticating Python applications, focusing on BasicAuth and OAuth2 using keys. It details how to implement these authentication methods for secure API interactions, covering setup and usage within Python projects. The library aims to simplify the process of integrating secure authentication into applications, ensuring data protection and access control. |
| 2023-09-19 2023 | dnspython intermediate 2 min read | Library providing Python implementations for DNS record manipulation, including retrieving MX targets, performing dynamic DNS updates with TSIG keys, and manipulating domain names. It facilitates generating reverse mapping information for A RRs from zone files, converting IPv4 and IPv6 addresses to/from their DNS reverse map names, and converting E.164 numbers to/from ENUM names. |
| 2023-09-02 2023 | Containerized PDF Summarizer with FastAPI and Hamilton intermediate 10 min read | Library for building containerized LLM applications, showcasing a PDF summarizer using FastAPI, Streamlit, and Hamilton. This approach emphasizes modularity and dataflow principles for easier iteration, testing, and maintenance of LLM capabilities, decoupling core logic from platform concerns like API caching and scaling. |
| 2023-09-02 2023 | trafilatura: Web scraping tool for text discovery and retrieval beginner 4 min read | Library for web scraping and text extraction. Trafilatura is a Python package and command-line tool that simplifies gathering text from raw HTML, offering robust discovery and processing components for web crawling, downloads, and extraction of main texts, metadata, and comments. It balances precision and recall, outperforming other open-source libraries in benchmarks, and is used by HuggingFace, IBM, and Microsoft Research. Output formats include TXT, Markdown, CSV, JSON, HTML, XML, and XML-TEI. |
| 2023-09-02 2023 | Running Untrusted Python Code intermediate 5 min read | Library for securely running untrusted Python code by employing a separate process with applied resource limits. It leverages Linux's seccomp to restrict system calls, allowing only essential operations like `read` and `write` to stdout/stderr, while returning `EPERM` for unauthorized calls. Additionally, it utilizes `setrlimit` to control CPU time, virtual memory, and file size, preventing resource exhaustion. The library aims to avoid common pitfalls of in-application sandboxing, acknowledging the complexity and potential for escape vectors inherent in Python's introspection features. |
| 2023-08-24 2023 | The subprocess Module: Wrapping Programs With Python beginner 51 min read | Library for running shell commands and managing external processes in Python. It enables executing commands like `ls` or `dir`, launching applications, and handling input/output streams. The library offers tools for error handling and inter-process communication, making it a flexible option for integrating command-line operations into Python projects. Key functions include `subprocess.run()`, `subprocess.call()`, and `subprocess.Popen()`, differentiating execution methods and output handling. → realpython.com |
| 2023-08-24 2023 | dis Disassembler for Python bytecode Python 3.9.6 documentation beginner 30 min read | Library for analyzing CPython bytecode, the `dis` module enables inspection of compiled Python code. It disassembles functions, methods, and code objects, revealing instructions and their arguments. Key features include support for showing inline caches, specialized bytecode with `show_caches` and `adaptive` parameters, and instruction offsets with `show_offsets`. The `dis.Bytecode` class provides an object-oriented interface for iterating through instructions, and command-line invocation is supported via `python -m dis`. |
| 2023-08-13 2023 | Swing in Python Burp Extensions - Part 1 intermediate 5 min read Burp | Library for crafting Python Burp extensions with custom GUIs using Jython Swing. This guide details implementing tabs, `JPanel` containers with `BorderLayout`, `JButton` actions, `JSplitPane` for layout, `JScrollPane` and `JList` for displaying data, and handling `ListSelectionEvent` with `valueChanged` to prevent double-adding events. It also covers using `JTabbedPane` for multiple tabs and `JTextPane` with `StyledDocument` for styled text, as well as `JEditorPane` for displaying web content, enabling or disabling editing. |
| 2023-08-05 2023 | Socket Programming in Python Part 1: Handling Connections beginner | Library for Python socket programming, enabling inter-process communication (IPC) across local or external networks. This video course guides users through building a simple socket server and client, then progresses to handling multiple simultaneous connections. It culminates in developing a full-fledged socket application with custom headers and content, essential for network-based applications. → realpython.com |
| 2023-08-05 2023 | How To Keep A Secret in Python Apps beginner 67 min read Secrets | Library for securely managing secrets in Python applications, emphasizing practices like avoiding hard-coding credentials, using password managers (like PinPal), and employing threat modeling. It highlights the `keyring` library for OS-native secure storage, contrasts macOS Keychain security prompts with environment variable risks, and discusses using GitHub Actions secrets. Foundational security, including disk encryption and keeping OS updated, is also stressed, alongside creating repeatable security processes and recognizing phishing red flags. |
| 2023-06-08 2023 | Test website for SQL injection vulnerabilities using Python intermediate SQLi | Test website for SQL injection vulnerabilities using Python https://ift.tt/msKlYeM |
| 2023-06-06 2023 | Reversing Pickles with r2pickledec intermediate 10 min read Deser | Tool for decompiling Python pickle files, r2pickledec supports all instructions up to protocol 5. It integrates with Radare2, enabling analysis of pickle contents, including identifying serialized objects like "requests.sessions" and "Session," and understanding the assembly language used in pickles. The tool facilitates reversing complex pickle data by translating the byte stream into human-readable instructions and object structures. → blog.doyensec.com |
| 2023-04-13 2023 | Understanding Python Bytecode beginner | Understanding Python Bytecode https://ift.tt/1NED8CP |
| 2023-04-10 2023 | How to Implement OAuth 2.0 Login for Python Flask Web Server Applications intermediate 4 min read API Sec AuthN | Tutorial on implementing OAuth 2.0 login for Python Flask web server applications. This guide details enabling Google APIs, creating OAuth client IDs, securely storing credentials, and writing Python code using Flask to handle user authentication and consent. It covers setting up a `requirements.txt` file, environment variables, and Jinja2 templates for a seamless Google single sign-on experience, with runnable code available on GitHub. |
| 2023-04-03 2023 | Download and Installation Scapy 2.4.5. documentation beginner 5 min read Fuzzing | Library for packet manipulation and network scanning, Scapy offers installation instructions for various platforms including Unix-like systems, macOS, OpenBSD, Solaris, and Windows. It details methods for installing both the latest stable release and development versions using pip, and outlines optional dependencies for advanced features such as plotting with Matplotlib, 2D graphics with PyX, graph generation requiring Graphviz and ImageMagick, 3D graphics with VPython-Jupyter, WEP decryption and TLS decryption utilizing cryptography, Nmap fingerprinting, and VOIP functionality with SoX. Platform-specific notes cover libpcap integration, native Linux support, and Npcap requirements on Windows. Documentation can be built locally using Sphinx, and UML diagrams can be generated with pyreverse. |
| 2023-04-03 2023 | Scapy beginner Fuzzing | Scapy http://scapy.net/ |
| 2023-04-03 2023 | Usage Scapy 2.4.5. documentation beginner 38 min read Fuzzing | Library for network packet manipulation, Scapy enables users to craft, send, sniff, dissect, and analyze network traffic. Its interactive shell allows for dynamic packet building, layer stacking with operators like `/`, and dissection of raw data. Scapy supports reading and writing PCAP files, graphical packet dumps via PyX, and generating sets of packets using Cartesian products of field values. It provides functions like `send()` and `sendp()` for layer 3 and layer 2 packet transmission, respectively, with options for return packets, looping, and interval control. Advanced features include multicast support with scope identifiers and a `fuzz()` function for randomizing packet fields. |
| 2023-04-03 2023 | Basic and Low-level Python Network Attacks intermediate RCE | https://ift.tt/SxGhvBQ |
| 2023-04-02 2023 | Writing a Network Scanner using Python intermediate Recon | Writing a Network Scanner using Python https://ift.tt/DAWbHwz |
| 2023-01-31 2023 | Build an Arp Spoofer From Scratch intermediate | The content discusses creating an ARP spoofer from scratch. ARP spoofing involves manipulating network traffic by sending false ARP messages. By building an ARP spoofer, one can intercept and modify data packets within a network. This technique is commonly used for malicious purposes like eavesdropping or conducting Man-in-the-Middle attacks. The content likely provides a guide or instructions on how to create an ARP spoofer independently. |
| 2023-01-31 2023 | Creating an Advanced Network Packet Sniffer in Python: A Step-by-Step Guide intermediate | The content is a step-by-step guide on creating an advanced network packet sniffer using Python. It provides detailed instructions on how to build the sniffer tool, which can capture and analyze network packets for various purposes. The guide likely covers topics such as setting up the necessary libraries, capturing packets, analyzing packet data, and potentially implementing additional features for advanced functionality. Overall, the content aims to help readers understand the process of creating a network packet sniffer using Python through a structured and informative guide. |