Goop : Google Search Scraper

Goop can perform google searches without being blocked by the CAPTCHA or hitting any rate limits.

How it works?

Facebook provides a debugger tool for its scraper. Interestingly, Google doesn’t limit the requests made by this debugger (whitelisted?) and hence it can be used to scrap the google search results without being blocked by the CAPTCHA.

Since facebook is involved, a facebook session Cookie must be supplied to the library with each request.

Also Read – Osmedeus : Security Framework For Reconnaissance & Vulnerability Scanning

Usage

Installation

pip install goop

Example

from goop import goop

page_1 = goop.search(‘red shoes’, ”)
page_2 = goop.search(‘red_shoes’, ”, page=’1′)
include_omitted_results = goop.search(‘red_shoes’, ”, page=’8′, full=True)

The returned is a dict of following structure

{
“0”: {
“url”: “https://example.com”,
“text”: “Example webpage”,
“summary”: “This is an example webpage whose aim is to demonstrate the usage of …”
},
“1”: {

cli.py demonstrates the usage by performing google searches from the terminal with the following command

python cli.py <query> <number_of_pages>

Disclaimer

Scraping google search results is illegal. This library is merely a proof of concept of the bypass. The author isn’t responsible for the actions of the end users.

R K

Recent Posts

Pystinger : Bypass Firewall For Traffic Forwarding Using Webshell

Pystinger is a Python-based tool that enables SOCKS4 proxying and port mapping through webshells. It…

7 days ago

CVE-Search : A Tool To Perform Local Searches For Known Vulnerabilities

Introduction When it comes to cybersecurity, speed and privacy are critical. Public vulnerability databases like…

7 days ago

CVE-Search : A Tool To Perform Local Searches For Known Vulnerabilities

Introduction When it comes to cybersecurity, speed and privacy are critical. Public vulnerability databases like…

1 week ago

How to Bash Append to File: A Simple Guide for Beginners

If you are working with Linux or writing bash scripts, one of the most common…

1 week ago

Mastering the Bash Case Statement with Simple Examples

What is a bash case statement? A bash case statement is a way to control…

1 week ago

How to Check if a File Exists in Bash – Simply Explained

Why Do We Check Files in Bash? When writing a Bash script, you often work…

1 week ago