Skip to content

Commit

Permalink
added second harvest to gleaner gh action to verify idempotency. Warn…
Browse files Browse the repository at this point in the history
…ing current test may fail if test starts on a given day but finishes next day as prov json-ld documents will increase due to embedded datestamp causes creation of new json-ld file due to content-addressing scheme
  • Loading branch information
adplincinst committed May 29, 2024
1 parent 9b8fba5 commit c58eaa8
Showing 1 changed file with 23 additions and 1 deletion.
24 changes: 23 additions & 1 deletion .github/workflows/test_geoconnex_dev_sitemap.yml
Original file line number Diff line number Diff line change
Expand Up @@ -45,4 +45,26 @@ jobs:
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/summoned/refgages0 330
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/summoned/refmainstems 66
echo "::endgroup::"
- name: Build and Run Gleaner Harvest #2
run: |
echo "::group::Build and Run Gleaner Harvest"
make
sh scripts/iow/start-gleaner.sh
echo "::endgroup::"
- name: Verify Harvest Counts on #2 Harvest (Verify Idempotency)
run: |
echo "::group::Verify Harvest Counts on First Harvest (Pristine S3)"
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/orgs 5
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/prov/cdss0 30
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/prov/dams0 45
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/prov/nmwdist0 266
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/prov/refgages0 330
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/prov/refmainstems 66
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/summoned/cdss0 30
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/summoned/dams0 45
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/summoned/nmwdist0 265
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/summoned/refgages0 330
sh scripts/iow/assert-s3-dir-cnt.sh $HOME/bin/mc myminio/iow/summoned/refmainstems 66
echo "::endgroup::"

0 comments on commit c58eaa8

Please sign in to comment.