Commit Graph

26 Commits

Author SHA1 Message Date
epi
973893ee42 removed dependency on tool-dict.pkl (#93)
* removed tool_dict dependency

* updated tests

* updated go version

* added defaults for failing iteration during tool installation

* Update pythonapp.yml

* updated docs
2020-08-27 20:40:15 -05:00
bamhm182
f4162631df Added Dockerfile. Updated docs accordingly. #62 (#78) 2020-07-27 09:45:12 -05:00
epi052
6ed51a19be Added tools command asciicast 2020-06-28 07:54:28 -05:00
epi052
9d5cac6b34 WIP: added tools command; closes #44 (#60)
* added tools command with placeholders for un/reinstall along with placeholder tests

* added missing docs build dependency

* updated documentation to reflect tools vs install

* refactored some code for DRY, fixed up prior merge with master

* fixed broken tests in test_recon_pipeline_shell

* existing tests all passing

* added tools list command

* added tools list command

* added tools reinstall

* removed lint

* fixed reinstall test

* fixed install go test

* fixed go install test again
2020-06-27 21:23:16 -05:00
epi052
f556319453 WIP: add waybackurls scan (#56)
* fixed up config.defaults definition

tools-dir and database-dir now use defaults.home value

* added tool definition file; closes #54

* added basic PoC for waybackurls scanner; updated helpers.py test

* added Endpoint/Target parsing; updated existing tests to pass

* added tests for waybackurls

* added WaybackurlsScan to FullScan

* added documenation for WaybackurlsScan
2020-05-02 20:06:44 -05:00
epi052
2ecdf4319a Prompt user on existing directory (#57)
* added tests and check_scan_directory

* added documentation; closes #30
2020-04-30 10:19:56 -05:00
epi052
08119e2079 Added apt update to installation instructions; closes #38 (#50) 2020-04-28 08:28:55 -05:00
epi052
f9120796b0 updated docs/readme to show new tested OS for install; closes #40 (#49) 2020-04-28 08:16:20 -05:00
epi
8bd43d371a removed dependency badges; added view command video to docs 2020-04-17 11:07:17 -05:00
epi
af03de34dc updated sqlalchemy badge 2020-04-17 10:55:27 -05:00
epi052
6eb3bd8cb0 Completed store results in a database project (#32)
Co-authored-by: Ryan Good <usafaryangood@gmail.com>

* added initial skeleton; restructured project directories

* removed workers directive from luigi; changed input to tko-subs

* changed masscan command to use config.tool_paths

* linted __init__ files and updated docstring for get_scans

* added per-file-ignores for linting

* recon-pipeline linted

* PoC working for amass results -> db; rudimentary db mgmt commands also

* more linting

* added database management commands to the shell

* db_location passes through to all tasks; masscan results added to db

* removed unused imports from masscan.py

* added ParseNmapOutput class to handle parsing for database storage

* cleaned up repeat code

* searchsploit results stored in db

* lint/format

* gobuster scans now stored in database

* fixed test_recon tests to use db_location

* fixed web tests

* tkosub entries recorded in db

* subjack scan results stored in database

* webanalyze results stored in db

* refactored older commits to use newer helper functions

* refactored older commits to use newer helper functions

* aquatone results stored in database

refactored a few scans to use dbmanager helper functions
refactored db structure wrt headers/screenshots
added 80/443 to web_ports in config.py

* fixed a few queries and re-added webanalyze to FullScan

* view targets/endpoints done

* overhauled nmap parsing

* print all nmap_results good, next to focus on filtering

* complex nmap filters complete

* nmap printing done

* updated pipfile

* view web-technologies complete

* view searchsploit results complete

* removed filesystem code from amass

* targetlist moved to db only

* targets,amass,masscan all cutover to full database; added view ports

* nmap fully db compliant

* aquatone and webtargets db compliant

* gobuster uses db now

* webanalyze db compliant

* all scans except corscanner are db compliant

* recon tests passing

* web tests passing

* linted files

* added tests for helpers.py and parsers.py

* refactored some redundant code

* added tests to pre-commit

* updated amass tests and pre-commit version

* updated recon.targets tests

* updated nmap tests

* updated masscan tests

* updated config tests

* updated web targets tests

* added gobuster tests

* added aquatone tests

* added subdomain takeover and webanalyze tests; updated test data

* removed homegrown sqlite target in favor of the sqla implementation

* added tests for recon-pipeline.py

* fixed cluge function to set __package__ globally

* updated amass tests

* updated targets tests

* updated nmap tests

* updated masscan tests

* updated aquatone tests

* updated nmap tests to account for no searchsploit

* updated nmap tests to account for no searchsploit

* updated masscan tests

* updated subjack/tkosub tests

* updated web targets tests

* updated webanalyze tests

* added corscanner tests

* linted DBManager a bit

* fixed weird cyclic import issue that only happened during docs build; housekeeping

* added models tests, removed test_install dir

* updated docs a bit; sidenav is wonky

* fixed readthedocs requirements.txt

* fixed issue where view results werent populated directly after scan

* added new tests to pipeline; working on docs

* updated a few overlooked view command items

* updated tests to reflect changes to shell

* incremental push of docs update

* documentation done

* updated exploitdb install

* updated exploitdb install

* updated seclists install

* parseamass updates db in the event of no amass output

* removed corscanner

* added pipenv shell to install instructions per @GreaterGoodest

* added pipenv shell to install instructions per @GreaterGoodest

* added check for chromium-browser during aquatone install; closes #26

* added check for old recon-tools dir; updated Path.resolve calls to Path.expanduser.resolve; fixed very specific import bug due to filesystem location

* added CONTIBUTING.md; updated pre-commit hooks/README

* added .gitattributes for linguist reporting

* updated tests

* fixed a few weird bugs found during test

* updated README

* updated asciinema links in README

* updated README with view command video

* updated other location for url scheme /status

* add ability to specify single target using --target (#31)

* updated a few items in docs and moved tool-dict to tools-dir

* fixed issue where removing tempfile without --verbose caused scan to fail
2020-04-17 10:29:16 -05:00
epi052
25da9574e3 Update README.md 2020-02-07 21:59:08 -06:00
epi052
82e4d3335a Update README.md 2020-02-07 21:58:18 -06:00
epi052
2793284426 Update README.md 2020-01-27 20:28:40 -06:00
epi052
61de5801aa added CI pipeline (#2)
* Create pythonapp.yml

* Update pythonapp.yml

* fixing up flake8/black

* Update pythonapp.yml

* testing addition of tests

* testing masscan install

* testing pipenv install

* test install command done?

* first set of tests complete
2020-01-25 20:39:27 -06:00
epi052
82653674dd bugfix: initial pathing of results_dir and nmap indexing 2020-01-25 07:11:41 -06:00
epi052
234fe5e639 update README 2020-01-23 20:04:09 -06:00
epi052
04ae261d9d update README 2020-01-23 19:56:32 -06:00
epi052
bc0c975d69 added outdir option; install/scan colors match 2020-01-19 13:51:24 -06:00
epi052
89720a25a6 updated README 2020-01-18 06:42:38 -06:00
epi052
42450fafe5 updated README; included cmd2 in Pipfile; fixed displaying multiple queued tasks 2020-01-12 21:12:00 -06:00
epi
d5fcd64289 initial addition of masscan; needs tested on kali 2019-09-02 19:53:43 -05:00
epi
03fc0b7a1c small changes to README 2019-09-02 15:25:09 -05:00
epi
ca8b12acf6 added scope file description and command structure to README 2019-09-02 15:23:07 -05:00
epi
bd2b1f5fef updated README to include command execution steps and systemd unit file 2019-09-02 15:16:08 -05:00
epi052
c885dfe7b4 Initial commit 2019-09-02 07:54:27 -05:00