Multithreading & Caching Optimizations for RefreshIG and ExtractMatBundleOperation#481

Closed

echicoine-icf wants to merge 47 commits intocqframework:masterfrom echicoine-icf:refresh-ig-caching

+2,005-1,546

Commits on Oct 11, 2023

Added processing for transaction bundle test files during post
Evan Chicoine
committed
Using Mockito.mockStatic to capture HttpClientUtils.post calls. Test now includes fhir server entry in arguments.
Evan Chicoine
committed

Commits on Oct 12, 2023

Executor approach, take 2
Evan Chicoine
committed

Commits on Oct 16, 2023

Introduced caching where paths are same
Evan Chicoine
committed
Reverting IGProcessor & IGBundleProcessor
Evan Chicoine
committed
Removed system out calls
Evan Chicoine
committed
Reverting change
Evan Chicoine
committed
Reverting change
Evan Chicoine
committed
Added some better caching and test directory handling. Updated HttpClientUtils to collect POST calls and execute them at the end.
Evan Chicoine
committed

Commits on Oct 17, 2023

Added custom ConcurrentLinkedHashMap and ConcurrentLinkedHashSet classes for thread safety. Declaring certain variables outside of loops for stability.
Evan Chicoine
committed
Reduced performance issues within for loops, using StringBuilder where needed.
Evan Chicoine
committed
merge branch 'master' of https://github.com/echicoine-icf/cqf-tooling into refresh-ig-caching
Evan Chicoine
committed
Processing POST calls sequentially instead of in paralell, for security reasons (ddos false flag)
Evan Chicoine
committed
Restoring ResourceUtils valueset handling to older straightforward approach.
Evan Chicoine
committed
Restoring ResourceUtils
Evan Chicoine
committed

Commits on Oct 18, 2023

Found good balance in post settings to not overload cqf-ruler
Evan Chicoine
committed
Backing out changes to IGProcessor
Evan Chicoine
committed

Commits on Oct 19, 2023

Reverting some files
Evan Chicoine
committed
Using List as argument instead of ArrayList for compatibility.
Evan Chicoine
committed
Removing unused repository entries, setting firm versions
Evan Chicoine
committed
ConcurrentLinkedHashMap and ConcurrentLinkedHashSet appear to not be needed due to the nature of modifications of each by the process.
Evan Chicoine
committed
Using buffered readers and writers in ResourceUtils and IOUtils for better performance.
Evan Chicoine
committed

Commits on Oct 20, 2023

Commits on Oct 24, 2023

Added ThreadUtils to handle common handling of executing multiple tasks.
Evan Chicoine
committed

Commits on Oct 25, 2023

Commits on Oct 26, 2023

Broke up process into smaller methods, fixed issue with task focount
Evan Chicoine
committed

Commits on Oct 27, 2023

Commits on Nov 7, 2023

Refactored code to use a parent abstract class housing common methods to reduce duplication of code
Evan Chicoine
committed
Organizing imports
Evan Chicoine
committed
Organized imports for all touched files
Evan Chicoine
committed
Restoring correct TestCaseProcessor
Evan Chicoine
committed
Restoring IGProcessor
Evan Chicoine
committed
Code cleanup
Evan Chicoine
committed
Fixed tests
Evan Chicoine
committed