OSINT-Collector : Harnessing Advanced Frameworks For Domain-Specific Intelligence Gathering

OSINT-Collector is an advanced framework that facilitates the collection, analysis, and management of OSINT information useful for conducting investigations in specific domains of interest.

Table Of Contents

• Design and Architecture
• Requirements
• Sequence Diagram
  • Interaction Flow
• Backend
  • Configuration
  • Importing OSINT Ontology
  • Creating Domain Ontology with Wikidata
  • Neo4j Plugins
• Launcher
• Frontend
  • Add Tools
• Usage
  • Run Tools
  • View Results
  • Make Inferences
  • Search Engine
• Preventing a School Shooting: a DEMO Scenario!

Design And Architecture

In this framework has been used an Ontology approach:

• The OSINT Ontology describes how data extracted from OSINT sources should be inserted into the database, including their respective properties and relationships.
• Domain Ontologies describe various domains of interest. These ontologies are utilized to link the extracted data to entities within these domains, enabling deeper inferences.

Using the graphical interface, the user can select an OSINT tool, input required parameters, and initiate execution to perform a specific search.

This execution request is sent via an HTTP request to the Launcher, which then executes the requested tools using the corresponding inputs.

The resulting data are aggregated, filtered and sent via an HTTP request to the backend, which communicates with the database and performs the following operations:

• Insertion and linking of data based on the schema described by the OSINT Ontology.
• Analysis of textual documents using NLP techniques provided by cloud services to extract suspicious entities and moderate the text to identify dangerous categories.
• Linking of entities and categories extracted in the previous phase with the domain ontologies.

The user can visualize the search results through the graphical interface, with the framework highlighting the identified contents during the analysis, emphasizing suspicious entities and categories.

Users can conduct further, more in-depth searches.

Using the OSINT Ontology allows for easily including new OSINT sources to leverage.

Requirements

This project requires the following dependencies to be installed:

• Docker and Docker Compose
• Node.js and npm

For more information click here.