Releases: OSINT-TECHNOLOGIES/dpulse
v1.2.3-stable
ADDED
- Added Wayback Machine snapshotting
- Added some functions and config values to work with Wayback Machine snapshotting
- Added some new styles for HTML reports
- Added new fields in config file to change HTML report styles
v1.2.2-stable
ADDED
- Added steps counter for basic scan
- Added counter for received and accessed subdomains
- Reactivated XLSX report selection
- Added system requirements in ReadTheDocs page
DELETED
- Temporarily removed API scan results insertion in XLSX report
- Removed pagesearch_keyword variable usage in HTML report
- Removed transfer of unused variables into reporting functions
- Removed some redundant imports
- Removed redundant pagesearch_main module
CHANGED
- Done some code clean up
- Fixed wrong code (tried to join short_domain string)
- Simplified logic of used API flag insertion in report_storage.db
- Bumped version for required Jinja2 (security issue)
- Clarified valid and tested Python versions in pyproject.toml
- Minor CLI visual changes
- Cleaned-up redundant requirements
- Updated XLSX report with new content
- Corrected installation ways in ReadTheDocs
v1.2.1-stable
ADDED
- Added support of HudsonRock API. It doesn't require a key, so you can give it a try!
- Added domain's main page snapshotting (with screenshot)
- Added domain's main page snapshotting (by making HTML copy of domain's main page)
- Added config parameters for selenium snapshotting setups
- Added selenium and webdriver-manager requirements
- Significantly widened amount of results returned from VirusTotal API
DELETED
- Removed PageSearch Sitemap Inspection module
CHANGED
- Fixed "dirty API key" problem for SecurityTrails API and VirusTotal API (API keys transfered with invisible symbols from SQLite DB)
- Temporarily disabled XLSX reporting module
- Unified returns from SecurityTrails API and VirusTotal API in individual variables
- Significantly changed visual design for API reports in DPULSE CLI
v1.2 - API & Dorking update
Dorking mode rework
As you may remember, Google Dorking automatization was implemented in DPULSE for a long time. It was a very simple concept solution that only proved the functionality of this method. Since v1.1 this concept has been expanded into a working solution that offers much better interaction during investigation process. However, work on this mode is not finished and will continue in the future.
API integration
There are many third-party APIs that are useful in OSINT research. In order to simplify the process of their use it was decided to integrate several APIs (VirusTotal and SecurityTrails) directly into DPULSE with local API keys database. However, similar to Google Dorking mode, work on the more APIs integration will continue in the future.
PDF reports deprecation
Working with PDF reports in Python did not meet expectations. It requires a lot of effort in code development when it comes to appearance customization or supporting different encodings or languages. Therefore, it was decided to deprecate PDF reports, which were replaced by a more convenient and easier to support HTML reports.
ReadTheDocs documentation
High-quality and accurate documentation is one of the key factors in future development of open-source project. That's why Readthedocs documentation page was created. It is already filled with the basic details about the DPULSE, but during DPULSE development and updating process this page will be expanded.
v1.1.6-stable
ADDED
- Added XLSX and HTML report examples
DELETED
- Removed warning about deprecated PDF report
CHANGED
- Changed XLSX report content in order to replicate HTML report content
- Unified data_array content both for XLSX and HTML reports
- Extended bad emails clean-up support for scans without PageSearch
- Improved handling of API results returning in XLSX report
- Fixed error when selecting only 1 API to scan crashes program entirely
- Extended column sizes for some XLSX sheets
- Updated Jinja2 required version to 3.1.5+ in order to fix security issue
- Fixed wrong cosmetical wrap for not found SSL certificate info
- Some code clean up
v1.1.5-stable
ADDED
- Added keywords_list None value if PageSearch was not selected
- Added proxifier.py to handle proxies gathering for Google Dorking
- Added user-agents list support for config generator
- Added user-agents rotation support
- Added CLI output for user-agent changing
- Added X.com links parsing support
- Extended Twitter links paragraph with X.com links in HTML report
- Added new paragraph for proxies file path
- Added code to handle proxies usage
- Added support of VirusTotal API and SecurityTrails API scans reporting
CHANGED
- Moved Google Dorking DB related functions to db_creator.py
- Modified color scheme for dorking results output
- Corrected local imports names
- HTML report cosmetical improvements (PS and SI)
- Cosmetical update for N/A organization name filler
- Some code clean-up and CLI cosmetical improvements
v1.1.4-stable
ADDED
- Added Table of Contents in HTML report
- Added paragraph separators in HTML report
- Added PageSearch paragraphs in HTML report
- Added Dorking results paragraph in HTML report
- Added used API flag transfer to Report Storage DB
- Added API scan status to show in Report Storage DB CLI Inspector
- Added dorking_results.txt file removal after creating HTML report. You won't see this file anymore
DELETED
- Deleted choice for PDF report creation. Forever
- Removed deprecated HTML report templates
- Removed PDF report handling functions and modules
- Removed xhtml2pdf requirement
- Removed empty line in basic_dorking.db
- Removed some double imports
CHANGED
- Rewritten "None" dorking mark to "N" when starting a scan
- Fixed bug with wrong api_scan_db handling in XLSX report
- Improved config editing exception hanling
- Fixed some typos
- Unified report creation calling function, so there'll be no more duplication of code
- Fixed long spaces between some string and menus in some places
- Adapted XLSX report for unified report creation function
v1.1.3-stable
ADDED
- Added basic support for APIs
- Added basic VirusTotal API support
- Added basic SecurityTrails API support
- Added reference API Keys DB
DELETED
- Removed some unused imports from modules
CHANGED
- Fixed incomplete URL sanitization security issue
- Improved exception handling for dorking processes
- Reactivated and reworked API Keys DB menu in Settings
- Moved API key enter menu point to separate main menu point
- Moved some long prints to cli_init module
- Fixed wrong config file check logic
- Fixed wrong XLSX report creation with Dorking module activated
- Made cosmetical fix for XLSX Google Dorking sheet if mode was set to None
- Refactored PageSearch documents saving code
- Optimized imports by making them situational
- Changed "Clear journal content" menu point from 5 to 3
- Fixed incorrect separators appearing during PageSearch process
v1.1.2-stable
ADDED
- Added support for adminpanels_dorking.db
- Added config parameters for Google Dorking module
- Added new settings point menu
- Added "Clear journal content" function
- Added webstructure_dorking database
- Added separate module to handle custom Dorking DB generation
- Added custom Dorking DB usage support
- Added check on existent custom DB name
- Added possibility to view and edit config file
CHANGED
- Modified dorking_delay and delay_step transfer
- Some CLI visual changes
- Reactivated some parts of settings menu
- Fixed DPULSE stuck by config file absence
- Updated basic_dorking table content
- Fixed SSL/TLS and incomplete URL sanitization security issues
- Fixed 'No such file or directory' error when dorking mode is set to None
- Reactivated "Generate custom Dorking DB" menu point
- Done some code refactoring
v1.1.1-stable
ADDED
- Extended README with new installation commands set for rolling versions
- Added 3 databases with different dorks to use them in new extended scan mode
- Added new extended scan mode: Google Dorking with different dorking types (which are represented by DBs)
- Added check on presence of databases with dorks
- Added config file (temporarily it is a test change, and it's still WIP)
- Added domain regex and connectivity check
- Added misc.py module to control various mini functions
- Added config_processor.py module
- Added dorking post-scan summary output
- Added folder for future APIs module
- Added possibility to recreate HTML reports from report storage DB
REMOVED
- [TEMPORARILY] Disabled Settings menu
- Deprecated old dorking_processor.py module and TXT file with dorks
- Removed some double imports
CHANGED
- Minor CLI changes (different checks were moved before DPULSE main banner)
- Moved and reworked functions from dorking_processor.py to dorking_handler.py
- Fixed bug when 0 found subdomains stops DPULSE when PS is activated
- Fixed wrong keywords search result printing in reports (PS)