EN 
PL 
DE 
Crawlomatic Multisite Scraper Post Generator plugin for WordPress
The Crawlomatic Multisite Scraper Post Generator plugin for WordPress is a cutting-edge tool designed to transform your site into an automated content powerhouse. Using advanced crawling and site scraping techniques, this plugin lets you scrape content from virtually any website, even those without APIs, and automatically generate posts. Set it up once, and it will manage your content creation around the clock.
How it works
With Crawlomatic Multisite Scraper Post Generator, you can enter a URL that will be crawled to discover all the links on that web page. It will then visit each discovered URL to extract the desired content. The crawling process is highly customizable, allowing you to customize settings like crawl depth, speed, maximum number of posts, and even filter links by specific classes or IDs, among other options.
Crawlomatic v2.0 Update
Crawlomatic Multisite Scraper Post Generator v2.0 update introduces new live scraper shortcode: [crawlomatic-scraper]. This feature extends the plugin's functionality by allowing you to extract real-time data and display it directly in posts, pages, or sidebars. The scraped content is temporarily cached, ensuring efficient use of your site's resources. This solution is great for integrating real-time data such as stock quotes, sports scores, or other dynamic content from public sources.
- Display scraped content using custom template tags or shortcodes in posts, pages, or sidebars.
- Configurable caching options for scraped data, with caching timeouts set in minutes.
- Set a custom User-Agent for each scrape to mimic different browsers or devices.
- Numerous analysis options available including CSS Selector, XPath, Regex, and Auto-Detect.
- Dynamic content conversion for different character encodings.
- Create dynamic URLs or post arguments to scrape content in real time based on your page parameters.
- Advanced parsing with configurable callback functions.
More information Plugin
Crawlomatic Multisite Scraper Post Generator lets you scrape content from almost any website that can be accessed via a browser. If the content is generated using JavaScript, the plugin can be used in conjunction with PhantomJS to capture even JavaScript-driven data. It also supports automatic creation of an unlimited number of custom crawl and scrape site tasks, making it a versatile content generation tool.
