Lk_scraper is an fully configurable LinkedIn scrape : scrape anything within LinkedIn
Installation
$ pip install git+git://github.com/jqueguiner/lk_scraper
Setup
$ docker-compose up -d
$ docker-compose run lk_scraper python3
First, you need to run a selenium server
$ docker run -d -p 4444:4444 –shm-size 2g selenium/standalone-firefox:3.141.59-20200326
After running this command, from the browser navigate to your IP address followed by the port number and /grid/console. So the command will be http://localhost:4444/grid/console.
Also Read – Lollipopz : Data Exfiltration Utility For Testing Detection Capabilities
Retrieving Cookie
Setting Up The Cookie
You can add your LinkedIn li_at cookie in the config file that is located in your home (~/.lk_scraper/config.yml) see
from lk_scraper import Scraper
li_at = “My_super_linkedin_cookie”
scraper = Scraper(li_at=li_at)
(Not implemented Yet)
$ export LI_AT=”My_super_linkedin_cookie”
Example
run the jupyter notebook linkedin-example.ipynb
>>from lk_scraper import Scraper
>>scraper = Scraper()
>>from lk_scraper import Scraper
>>scraper = Scraper()
>>company = scraper.get_object(object_name=’company’, object_id=’apple’)
>>from lk_scraper import Scraper
>>scraper = Scraper()
>>profil = scraper.get_object(object_name=’profil’, object_id=’jlqueguiner’)
Docker is a powerful open-source containerization platform that allows developers to build, test, and deploy…
Docker is one of the most widely used containerization platforms. But there may come a…
Introduction Google Dorking is a technique where advanced search operators are used to uncover information…
Introduction In cybersecurity and IT operations, logging fundamentals form the backbone of monitoring, forensics, and…
What is Networking? Networking brings together devices like computers, servers, routers, and switches so they…
Introduction In the world of Open Source Intelligence (OSINT), anonymity and operational security (OPSEC) are…