Skip to main content

Cyware Threat Intelligence eXchange

Web Scraper

A web scraper in Intel Exchange extracts threat intel from web pages. Extracted threat intel allows analysts to correlate artifacts to connect the dots for a threat or cyber attack. Any trusted web page or site that provides valuable IOCs for threat-hunting operations acts as a source for the web scraper.

You can utilize the web scraper to curate IOCs and tag them with information before sharing them with subscribers and clients. As an advanced workflow, the platform enriches and correlates the threat data before transferring them as threat intelligence. The platform normalizes the data collected from web pages and sites as threat data. The platform normalizes the collected data into the following data types:

  • IPV4

  • SHA1

  • SHA512

  • IPV6

  • SHA256

  • MD5

  • URL

  • Domain

  • Vulnerability

  • Autonomous System