Skip to content

Commit

Permalink
Breeze (#26)
Browse files Browse the repository at this point in the history
* fix bare run, uses .env instead of /.env

* remove dangling prints

* move get_keywords into its own file

* isolate current brain function

* the brain function chooses the scraping module to be used

* pass parameters from brain to scraping modules

* prepare quality, evaluate batch size, brain

* /keywords.json -> keywords.json

* fix batch-size -> batch_size

* print module version choosen by brain.think

* /.env has been moved to .env in write_env

* Update self_update.py

upgraded self update procedure

* Update setup.py

added packaging

* Update __init__.py

fixed version check to be properly handled by packaging lib

* Update self_update.py

* brain functions added (get_ponderation, float_normalization, choose_value)

* move generate_url in scraping modules

* scraping modules are responsible of url generation (#25)

* Update self_update.py

* Update __init__.py

* several small fixes towards rc

* twitter url parameter key 'live_mode' is 'live'

* brain uses data.get_scraping_module instead of importlib

* change module names from domain to hash

* refactor modules layout

* is_older_version

* cleaning up

* exorde_data is a sub_repository

* working

* updated data ref

* correct the pip install command

* fix pip install repository path and logging

* Update .gitmodules

fixed ssh to https URLs in gitmodules

* Update .gitmodules

* Update .gitmodules

* updated the data repository reference

* fix module loader log

* Update Dockerfile

updated dockerfile to match new submodule repo

* Update self_update.py

* Update keep_alive.sh

* Added exorde_data submodule

---------

Co-authored-by: Patrick Borowy <patrick.borowy@proton.me>
Co-authored-by: Patrick Borowy <112330025+6r17@users.noreply.github.com>
  • Loading branch information
3 people authored Jul 7, 2023
1 parent 79554ac commit e7be42f
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions data
Submodule data added at 82be45

0 comments on commit e7be42f

Please sign in to comment.