Skip to main navigation Skip to search Skip to main content

End-to-end automation of email intelligence in OSINT workflows: Architecture and implementation

  • Bengisu Aydemir
  • , Malek Malkawi*
  • , Reda Alhajj
  • *Corresponding author for this work
  • Istanbul Medipol University

Research output: Contribution to journal › Journal article › Research › peer-review

50 Downloads (Pure)

Abstract

Open Source Intelligence (OSINT) has become increasingly important in cybersecurity, digital risk assessment, and investigative research due to the growing volume of publicly available information. Traditional OSINT tools often operate in silos, focusing on narrow tasks such as domain lookup or metadata extraction, which limits their effectiveness in providing comprehensive intelligence. Meanwhile, manual workflows remain time-consuming and prone to errors in large-scale or time-sensitive scenarios. To address these challenges, this paper presents a fully automated framework for email-focused OSINT explicitly scoped at the domain level rather than individual mailbox verification. The system integrates asynchronous web scraping, DNS and WHOIS queries, MX record checks for domain-level mail infrastructure validation, and the analysis of email authentication protocols including SPF, DKIM, and DMARC. Unlike conventional approaches, the proposed pipeline incorporates a validation mechanism that combines real-time harvesting with domain-level checks, avoiding assumptions about individual email address existence and thereby improving infrastructure-level reliability while reducing noise from duplicate, role-based, or inactive addresses. Experimental evaluations conducted on 17 domains spanning academic, governmental, corporate, startup, and privacy-focused providers demonstrate that the framework achieves approximately a 90% infrastructure-level validation rate, while maintaining consistent performance and competitive execution times compared to existing OSINT workflows. These results highlight the potential of the system to support cybersecurity operations, digital forensics, and threat intelligence by enabling scalable, ethical, and autonomous reconnaissance of email-related intelligence at the domain infrastructure level without relying on intrusive verification techniques.

Original languageEnglish
Article number100841
JournalArray
Volume30
Number of pages12
ISSN2590-0056
DOIs
Publication statusPublished - Jul 2026

Keywords

  • Automation
  • Cybersecurity
  • OSINT
  • Threat intelligence
  • Web scraping

Fingerprint

Dive into the research topics of 'End-to-end automation of email intelligence in OSINT workflows: Architecture and implementation'. Together they form a unique fingerprint.

Cite this