OSIB Ideas

Some Ideas

• a thing which provides briefs for entities/graphs (and topics?) (aka feeds?)
• a thing which allows entity transclusions
• add hindsight bias for market overview page
• a thing which allows you to attach notes to entities
• a thing which provides grouping/“breadth first” for entities
• a thing which allows graphs to be shared publically, potentially could crowd source annotations as on Genius / Hypothesis
• a thing which “programs your attention” through spaced repetition aka designing the environment to modify the users attention. Think: “{cron} for your entities and entity notes”
  • Systematically, we can generalize spaced repetition to:
  • a priority queue of entities
  • an interactive environment which presents sufficiently high-priority tasks
  • feedback actions which modify a things subsequent priority

OSIB: Plugin Ideas

• Searxng

• Shodan

• + Many other sources from that OSINT book I have…

OSIB: Client Ideas

• Visual entity builder, drag and drop then label input fields for entities. Automatically generate the Python code for these visual entities

• Visual entity function builder/connect transforms to different entities?

• …

OSIB: Database and Backend Ideas

• Continous graph monitoring to pull fresh data (mark and remove dupes)

• Integrate hstore/use JSON to store entity settings

  • hstore

• Consider adding geospatial support to client, rust backend, and postgres db:

  • postgis: support for storing, indexing, and querying geospatial data.
  • earthdistance: calculate great-circle distances
  • What would this look like client side? Maybe add a geopoint type field to entities? Add a world map to display geopoint enabled entities on? Hmmm

• Add/improve searching

  • pg_trgm: support for similarity of text using trigram matching
  • PGroonga
  • pg_search

• Add admin dashboard showing web server stats and db stats, could maybe use:

  • pgmetrics: Easily collect and report PostgreSQL metrics for scripting, automation and troubleshooting.
  • pg_stat_statement
  • bg_mon
  • postgresql-metrics

• Add support to store all types of files:

  • file-fdw
  • ddl-foreign-data
  • dc_fdw
  • git_fdw
  • parquet_fdw
  • sqlite_fdw
  • zipfile-fdw

• Add audit logs:

  • pgaudit: open source audit logging
  • pgMemento

• Investigate what adding encryption entails and how that would work with the apache/age postgres graphs:

  • acra: application-level encryption for data fields, multi-layered access control, database leakage prevention, and intrusion detection capabilities
  • pgcrypto