Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Webscraper for websites without rss feed #44

Open
3 tasks
p2h5 opened this issue Jul 14, 2021 · 0 comments
Open
3 tasks

Add Webscraper for websites without rss feed #44

p2h5 opened this issue Jul 14, 2021 · 0 comments
Assignees
@p2h5 @DerAlexmeister
Labels
enhancement New feature or request good first issue Good for newcomers Scraper Scraper related issue
Milestone
0.1.2

Comments

@p2h5
Copy link
Collaborator

p2h5 commented Jul 14, 2021 •
edited
Loading

Is your feature request related to a problem? Please describe.
Various websites are not having rss feeds to scrape. For those websites, another way has to be found to get the data from.

Describe the solution you'd like

  • Download html from gven sources
  • Extract links from the downloaded data.
  • Scrape for IOCs within the reports, the link points to.
@DerAlexmeister DerAlexmeister added enhancement New feature or request good first issue Good for newcomers Scraper Scraper related issue labels Jul 14, 2021
@DerAlexmeister DerAlexmeister added this to the 0.1.2 milestone Jul 14, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@p2h5 p2h5

@DerAlexmeister DerAlexmeister

Labels
enhancement New feature or request good first issue Good for newcomers Scraper Scraper related issue
Projects
None yet
Milestone
0.1.2
Development

No branches or pull requests
2 participants
@p2h5 @DerAlexmeister