RapidRepoPull : Quickly Pull & Install Repos from its List

RapidRepoPull goal is to quickly pull and install repos from its list. This program uses Python to clone/maintain multiple security related repos using threading and multiprocessing.

Use cases

  • Quickly install your favorite Security repos on a new system
  • Kick off multiple concurrent git clone tasks utilizing Python
  • Add remove repos to the worker_data list as needed in order to address indivudual use case/project needs

Requirements

  • This program was tested with Python version 3.7.2 64-bit
  • Ensure the Python3 virtual environment package is installed (Ubuntu)

sudo apt-get install python3-venv

  • Ensure git is installed (Ubuntu)

sudo apt-get install git

Also Read – Remot3d : A Simple Tool Created for Large Pentesters

Usage Option 1 Automatic (Docker)

  • Clone code repo

git clone https://github.com/tbalz2319/RapidRepoPull.git

  • Change directory into RapidRepoPull

cd RapidRepoPull

  • The script will run in a minimal Alpine Docker container (126 MB) and extract the dirs in the current working dir

docker-compose up –build

Usage Option 2 Local Install

  • Clone code repo

git clone https://github.com/tbalz2319/RapidRepoPull.git

  • Change directory into RapidRepoPull

cd RapidRepoPull

  • Execute the script below

./install.sh

Usage Option 3 Manual

  • Clone code repo

git clone https://github.com/tbalz2319/RapidRepoPull.git

  • Change directory into RapidRepoPull

cd RapidRepoPull

  • Create a virtual Python3 environment to run this code

python3 -m venv venv

  • Activate the virual enivornment

source venv/bin/activate

  • Install requirements

pip install -r requirements.txt

  • Run program

python3 rapid.py

Update Program

  • Run the following script

./update.sh

Mass Update all existing repos

  • Run the command to maintain all existing repos by attempting to pull latest version

./update_repos.sh

To do

  • Add error handling

Clean up code

R K

Recent Posts

How Do I Do Reverse Image Search

Have you ever come across a picture on the internet and wondered where it came…

13 hours ago

WhatsMyName App – Find Anyone Across 640+ Platforms

Overview WhatsMyName is a free, community-driven OSINT tool designed to identify where a username exists…

2 weeks ago

Analyzing Directory Size Linux Tools Explained

Managing disk usage is a crucial task for Linux users and administrators alike. Understanding which…

2 weeks ago

Understanding Disk Usage with du Command

Efficient disk space management is vital in Linux, especially for system administrators who manage servers…

2 weeks ago

How to Check Directory Size in Linux

Knowing how to check directory sizes in Linux is essential for managing disk space and…

2 weeks ago

Essential Commands for Linux User Listing

Managing user accounts is a core responsibility for any Linux administrator. Whether you’re securing a…

2 weeks ago