Skip to content

Commit

Permalink
add archive for old docs
Browse files Browse the repository at this point in the history
  • Loading branch information
C-Loftus committed Nov 19, 2024
1 parent 7b0f00b commit d43dada
Show file tree
Hide file tree
Showing 8 changed files with 5 additions and 1 deletion.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
6 changes: 5 additions & 1 deletion docs/internals.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
# Gleaner Internals

This document describes the internal workings of Gleaner. The rest of the old documentation has been moved into the [`archive`](./archive/) folder given the fact that some was outdated.

## Walkthrough of the e2e path

1. Read in CLI arguments with Viper
Expand All @@ -14,7 +16,9 @@
4. Summon the sitemaps
1. Get all the sources in the gleaner config of type API
2. Run ResRetrieve to pull down the data graphs at resources
- For each url associated with a given domain, spawn a go routine with getDomain
- For each url associated with a given domain, spawn a go routine with `getDomain`

TODO: There is more code after this that can be further documented, but these may be refactored as the codebase matures and is in goroutines making in slightly harder to reason about.

## Properties

Expand Down

0 comments on commit d43dada

Please sign in to comment.