专业英语问题（3）---Website Spidering

nine_eight 2005-03-09 09:35:03

Website Spidering

...全文

102 5 打赏收藏转发到动态举报

写回复

用AI写文章

5 条回复

切换为时间正序

请发表友善的回复…

发表回复

nine_eight 2005-03-11

打赏
举报

求解

nine_eight 2005-03-10

打赏
举报

还有别的吗？

yeshucheng 2005-03-10

打赏
举报

这个东西有点是：只可意会，不可言传
：）大家一看都知道什么意思，但就是不好翻译出来。我看其实完全可以理解网络交互
不知道准确与否

nine_eight 2005-03-10

打赏
举报

还有其它的译法吗

dakuntk 2005-03-09

打赏
举报

站点辐射

Spidering_Hacks_100_Industrial_Strength_Tips_Tools_2003.chm This book teaches you the methodologies and algorithms behind spiders and the variety of ways that spiders can be used. Hopefully, it will inspire you to come up with some useful spiders of your own.

Spidering Hacks is about coming up with easier, more automated ways of performing everyday tasks and gathering information.

Untangle your web scraping complexities and access web data with ease using Python scripts Key FeaturesHands-on recipes to advance your web scraping skills to expert levelAddress complex and challenging web scraping tasks using PythonUnderstand the web page structure and collect meaningful data from the website with easeBook Description Python Web Scraping Cookbook is a solution-focused book that will teach you techniques to develop high-performance scrapers and deal with crawlers, sitemaps, forms automation, Ajax-based sites, and caches.You'll explore a number of real-world scenarios where every part of the development/product life cycle will be fully covered. You will not only develop the skills to design and develop reliable data flows, but also deploy your codebase to an AWS. If you are involved in software engineering, product development, or data mining (or are interested in building data-driven products), you will find this book useful as each recipe has a clear purpose and objective. Right from extracting data from the websites to writing a sophisticated web crawler, the book's independent recipes will be a godsend on the job. This book covers Python libraries, requests, and BeautifulSoup. You will learn about crawling, web spidering, working with AJAX websites, and paginated items. You will also learn to tackle problems such as 403 errors, working with proxy, scraping images, and LXML. By the end of this book, you will be able to scrape websites more efficiently and deploy and operate your scraper in the cloud. What you will learnUse a wide variety of tools to scrape any website and data-including BeautifulSoup, Scrapy, Selenium, and many moreMaster expression languages such as XPath, CSS, and regular expressions to extract web dataDeal with scraping traps such as hidden form fields, throttling, pagination, and different status codesBuild robust scraping pipelines with SQS and RabbitMQScrape assets such as images media and know what to do when Scraper fails to runExplore ETL techniques of building a customized crawler, parser, and convert structured and unstructured data from websitesDeploy and run your scraper as a service in AWS Elastic Container ServiceWho This Book Is For Python Web Scraping Cookbook is ideal for Python programmers, web administrators, security professionals or someone who wants to perform web analytics would find this book relevant and useful. Familiarity with Python and basic understanding of web scraping would be useful to take full advantage of this book. Table of ContentsGetting Started with ScrapingData Acquisition and ExtractionProcessing DataWorking with Images, Audio and Other AssetsScraping - Code of ConductScraping Challenges and SolutionsText Wrangling and AnalysisSearching, Mining and Visualizing DataWorking with an API and Providing a Data APICreating Scraper Microservices with DockerA Complete Real-World Example

使用Burpsuite精通Web渗透测试，英文版，原汁原味！本资源转载自网络,如有侵权,请联系上传者或csdn删除本资源转载自网络,如有侵权,请联系上传者。 Get hands-on experience of using Burp Suite to execute attacks and perform web assessments Key Features Use tools in Burp Suite to meet your web infrastructure security demands Configure Burp to fine-tune the suite of tools specific to the target Use Burp extensions to assist with various technologies commonly found in application stacks Book Description Burp Suite is a Java-based platform used for testing the security of your web applications, and has been adopted widely by professional enterprise testers. The Burp Suite Cookbook contains recipes to help you tackle challenges related to determining and exploring vulnerabilities in web applications. The book's first few sections will help you understand how to uncover security flaws with various test cases for complex environments. After you've configured Burp for your environment, you will use Burp tools such as Spider, Scanner, Intruder, Repeater, and Decoder, among others, to resolve specific problems faced by pentesters. You'll also be able to work with Burp's various modes, in addition to performing operations on the web. Toward the concluding chapters, you'll explore recipes that target specific test scenarios and learn how to resolve them using best practices. By the end of this book, you'll be up and running with deploying Burp for securing web applications. What you will learn Configure Burp Suite for your web applications Perform authentication, authorization, business logic, and data validation testing Explore session management and client-side testing Understand unrestricted file uploads and server-side request forgery Execute XML external entity attacks with Burp Perform remote code execution with Burp Who this book is for If you are a security professional, web pentester, or software developer who wants to adopt Burp Suite for application security, this book is for you. Table of Contents Getting Started with Burp Sui

一个可扩展的PHP WEB 蜘蛛，示例代码： use VDB\Spider\Spider; use VDB\Spider\Discoverer\XPathExpressionDiscoverer; $spider = new Spider('http://www.oschina.net'); 特性： supports two traversal algorithms: breadth-first and depth-first supports depth limiting and queue size limiting supports adding custom URI discovery logic, based on XPath, CSS selectors, or plain old PHP comes with a useful set of URI filters, such as Domain limiting supports custom URI filters, both prefetch (URI) and postfetch (Resource content) supports custom request handling logic comes with a useful set of persistence handlers (memory, file. Redis soon to follow) supports custom persistence handlers collects statistics about the crawl for reporting dispatches useful events, allowing developers to add even more custom behavior supports a politeness policy will soon come with many default discoverers: RSS, Atom, RDF, etc. will soon support multiple queueing mechanisms (file, memcache, redis) will eventually support distributed spidering with a central queue 标签：PHPspider

Java EE

67,513

社区成员

225,879

社区内容

发帖

与我相关

我的任务

社区管理员

加入社区

近7日
近30日
至今

加载中

查看更多榜单

社区公告

暂无公告

试试用AI创作助手写篇文章吧

+ 用AI写文章