Low-Orbital-Tractor-Beam designed to be a simple platform for creating Reddit-interaction projects in a modular and extensible way.
- Create a bullet-proof Reddit connection and authentication module
- Have a central codebase for creating ad-hoc and repeat scrapers
- Create a module that other apps, espcially bots, can use to connect to Reddit
- Add an API for remote use.
- Build a modular system where a single, tested, pull-request could viably add an entire new feature.
- Create a CLI, web, desktop, and API front-end for the system.
..
├── RedditScrape
│ ├── __init__.py
| ├── .env
│ ├── .gitignore
│ ├── LICENSE
│ ├── README.md
│ ├── main.py
│ └── src
│ ├── __init__.py
│ ├── auth.py
│ ├── data
│ │ └── settings.json
│ └── routing.py
├── data- Clone the repo
- Edit the .env file with your Reddit API credentials. The system currently uses the PRAW library, so you'll need to create a Reddit app and get your credentials from there. The .env file should look like this:
APP_NAME=
CLIENT_ID=
REDDIT_SECRET=
REDIRECT_URI=
USERNAME=
PASSWORD=- Update PRAW authentication to use the code flow.
- Create a CLI front-end.
- Allow specific scrape jobs to be defined in a .json or .yml file and simply run through the front-end.
- Bullet-proof app-wide rate-limiting.
- Create a link with the Golem bot as a prototype for generic future access.