Skip to content

Latest commit

 

History

History
38 lines (28 loc) · 435 Bytes

README.md

File metadata and controls

38 lines (28 loc) · 435 Bytes

Web Crawler

Web crawler explore the web and save every pages he found.

Build

Dependences

  • cmake
  • ninja or make
  • gcc
  • sqlite3
  • curl
  • SQLiteCpp clone on /libs/SQLiteCpp

Build

  • with Ninja :
mkdir build
cd build
cmake -G Ninja ..
ninja
  • with Make
mkdir build
cd build
cmake ..
make

Use

web-crawler <url> --clear-waitlist