Goop : Google Search Scraper

Goop can perform google searches without being blocked by the CAPTCHA or hitting any rate limits.

How it works?

Facebook provides a debugger tool for its scraper. Interestingly, Google doesn’t limit the requests made by this debugger (whitelisted?) and hence it can be used to scrap the google search results without being blocked by the CAPTCHA.

Since facebook is involved, a facebook session Cookie must be supplied to the library with each request.

Also Read – Osmedeus : Security Framework For Reconnaissance & Vulnerability Scanning

Usage

Installation

pip install goop

Example

from goop import goop

page_1 = goop.search(‘red shoes’, ”)
page_2 = goop.search(‘red_shoes’, ”, page=’1′)
include_omitted_results = goop.search(‘red_shoes’, ”, page=’8′, full=True)

The returned is a dict of following structure

{
“0”: {
“url”: “https://example.com”,
“text”: “Example webpage”,
“summary”: “This is an example webpage whose aim is to demonstrate the usage of …”
},
“1”: {

cli.py demonstrates the usage by performing google searches from the terminal with the following command

python cli.py <query> <number_of_pages>

Disclaimer

Scraping google search results is illegal. This library is merely a proof of concept of the bypass. The author isn’t responsible for the actions of the end users.

R K

Recent Posts

WhatsMyName App – Find Anyone Across 640+ Platforms

Overview WhatsMyName is a free, community-driven OSINT tool designed to identify where a username exists…

1 week ago

Analyzing Directory Size Linux Tools Explained

Managing disk usage is a crucial task for Linux users and administrators alike. Understanding which…

1 week ago

Understanding Disk Usage with du Command

Efficient disk space management is vital in Linux, especially for system administrators who manage servers…

1 week ago

How to Check Directory Size in Linux

Knowing how to check directory sizes in Linux is essential for managing disk space and…

1 week ago

Essential Commands for Linux User Listing

Managing user accounts is a core responsibility for any Linux administrator. Whether you’re securing a…

1 week ago

Command-Line Techniques for Listing Linux Users

Linux offers powerful command-line tools for system administrators to view and manage user accounts. Knowing…

2 weeks ago