Skip to content

Commit

Permalink
Added images
Browse files Browse the repository at this point in the history
  • Loading branch information
lkumarjain committed Nov 6, 2024
1 parent 2dcbe13 commit 952a200
Show file tree
Hide file tree
Showing 55 changed files with 862 additions and 773 deletions.
14 changes: 7 additions & 7 deletions .github/workflows/benchmark.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,8 +20,8 @@ jobs:
- name: Dependencies
run: |
echo "Download Dependencies"
go mod tidy
go mod vendor
cd /home/runner/work/benchmark/benchmark/expression-evaluation && go mod tidy
cd /home/runner/work/benchmark/benchmark/expression-evaluation && go mod vendor
- name: Benchmark
run: |
Expand All @@ -41,8 +41,8 @@ jobs:
- name: Dependencies
run: |
echo "Download Dependencies"
go mod tidy
go mod vendor
cd /home/runner/work/benchmark/benchmark/in-memory-cache && go mod tidy
cd /home/runner/work/benchmark/benchmark/in-memory-cache && go mod vendor
- name: Benchmark
run: |
Expand All @@ -62,11 +62,11 @@ jobs:
- name: Dependencies
run: |
echo "Download Dependencies"
go mod tidy
go mod vendor
/home/runner/work/benchmark/benchmark/worker-pool && go mod tidy
/home/runner/work/benchmark/benchmark/worker-pool && go mod vendor
- name: Benchmark
run: |
echo "Benchmark In-Memory Cache libraries"
cd /home/runner/work/benchmark/benchmark/worker-pool && go test -bench=. -benchmem -count 1 -benchtime=100x > results/results.out
cd /home/runner/work/benchmark/benchmark/worker-pool && go test -bench=. -benchmem -count 1 -benchtime=100x > results/results.out
31 changes: 18 additions & 13 deletions expression-evaluation/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,19 +12,24 @@ Benchmarks of expression evaluation libraries for Golang.

All the [benchmarks](/results.out) are performed in the `Intel(R) Core(TM) i7-7660U CPU @ 2.50GHz` machine with `10K` samples and `5` iterations.

### Compile

Average Compile time for each expression library

![Average Compile](/expression-evaluation/results/Average_Compile.png)
![Average Compile Expand](/expression-evaluation/results/Average_Compile_Expand.png)

### Evaluation

Average Evaluation time for each expression library

![Average Evaluate](/expression-evaluation/results/Average_Evaluate.png)
![Average Evaluate Expand](/expression-evaluation/results/Average_Evaluate_Expand.png)
#### Time / Operation
| Compile | Evaluate |
| ------------------------------------------------------------------- | --------------------------------------------------------------------- |
| ![compile_time_bar.png](/expression-evaluation/results/compile_time_bar.png) | ![evaluate_time_bar.png](/expression-evaluation/results/evaluate_time_bar.png) |
| ![compile_time_table.png](/expression-evaluation/results/compile_time_table.png) | ![evaluate_time_table.png](/expression-evaluation/results/evaluate_time_table.png) |

#### Allocations / Operation

| Compile | Evaluate |
| ------------------------------------------------------------------- | --------------------------------------------------------------------- |
| ![compile_allocations_bar.png](/expression-evaluation/results/compile_allocations_bar.png) | ![evaluate_allocations_bar.png](/expression-evaluation/results/evaluate_allocations_bar.png) |
| ![compile_allocations_table.png](/expression-evaluation/results/compile_allocations_table.png) | ![evaluate_allocations_table.png](/expression-evaluation/results/evaluate_allocations_table.png) |

#### Bytes / Operation
| Compile | Evaluate |
| ------------------------------------------------------------------- | --------------------------------------------------------------------- |
| ![compile_memory_bar.png](/expression-evaluation/results/compile_memory_bar.png) | ![evaluate_memory_bar.png](/expression-evaluation/results/evaluate_memory_bar.png) |
| ![compile_memory_table.png](/expression-evaluation/results/compile_memory_table.png) | ![evaluate_memory_table.png](/expression-evaluation/results/evaluate_memory_table.png) |

## Libraries

Expand Down
4 changes: 2 additions & 2 deletions expression-evaluation/makefile
Original file line number Diff line number Diff line change
Expand Up @@ -6,5 +6,5 @@ benchmark:
go test -bench=. -benchmem -count 5 -benchtime=10000x > results/results.out

generate-graph:
cd ${PWD}/../result/bin && ./result -ParserFilePath=${PWD}/results -OutputFileTemplate=compile_%s -LegendTemplate="{1} {2}" -KeyTemplate={0}/{1}/{2} -Filter=functionName==\"Evaluate\" -TableWidth=4096 -TableLegendSpan=2
cd ${PWD}/../result/bin && ./result -ParserFilePath=${PWD}/results -OutputFileTemplate=evaluate_%s -LegendTemplate="{1} {2}" -KeyTemplate={0}/{1}/{2} -Filter=functionName==\"Compile\" -TableWidth=4096 -TableLegendSpan=2
${PWD}/../result/bin/result -ParserFilePath=${PWD}/results -OutputFileTemplate=compile_%s -LegendTemplate="{1} {2}" -KeyTemplate={0}/{1}/{2} -Filter=functionName==\"Evaluate\" -TableWidth=2048 -TableLegendSpan=2
${PWD}/../result/bin/result -ParserFilePath=${PWD}/results -OutputFileTemplate=evaluate_%s -LegendTemplate="{1} {2}" -KeyTemplate={0}/{1}/{2} -Filter=functionName==\"Compile\" -TableWidth=2048 -TableLegendSpan=2
Binary file modified expression-evaluation/results/compile_allocations_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/compile_allocations_table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/compile_memory_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/compile_memory_table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/compile_time_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/compile_time_table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/evaluate_allocations_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/evaluate_allocations_table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/evaluate_memory_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/evaluate_memory_table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/evaluate_time_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified expression-evaluation/results/evaluate_time_table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
25 changes: 19 additions & 6 deletions in-memory-cache/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,17 +12,30 @@ Benchmarks of in-memory cache libraries for Golang.

All the [benchmarks](/results.out) are performed in the `Intel(R) Core(TM) i7-7660U CPU @ 2.50GHz` machine with `100K` samples and `5` iterations.

![Average](/in-memory-cache/results/Average_Cache.png)
### Time / Operation

### Average ns / operation
|Function| Chart View | Table View |
|-----| ------------------------------------------------------------------- | --------------------------------------------------------------------- |
|Get Function| ![get_time_bar.png](/in-memory-cache/results/get_time_bar.png) | ![get_time_table.png](/in-memory-cache/results/get_time_table.png) |
|Set Function| ![set_time_bar.png](/in-memory-cache/results/set_time_bar.png) | ![set_time_table.png](/in-memory-cache/results/set_time_table.png) |
|Remove Function| ![remove_time_bar.png](/in-memory-cache/results/remove_time_bar.png) | ![remove_time_table.png](/in-memory-cache/results/remove_time_table.png) |

#### Set Function
#### Allocations / Operation

![Average_ns_per_operation_set.png](/in-memory-cache/results/Average_ns_per_operation_set.png)
|Function| Chart View | Table View |
|-----| ------------------------------------------------------------------- | --------------------------------------------------------------------- |
|Get Function| ![get_allocations_bar.png](/in-memory-cache/results/get_allocations_bar.png) | ![get_allocations_table.png](/in-memory-cache/results/get_allocations_table.png) |
|Set Function| ![set_allocations_bar.png](/in-memory-cache/results/set_allocations_bar.png) | ![set_allocations_table.png](/in-memory-cache/results/set_allocations_table.png) |
|Remove Function| ![remove_allocations_bar.png](/in-memory-cache/results/remove_allocations_bar.png) | ![remove_allocations_table.png](/in-memory-cache/results/remove_allocations_table.png) |

#### Get & Remove Function
#### Bytes / Operation

|Function| Chart View | Table View |
|-----| ------------------------------------------------------------------- | --------------------------------------------------------------------- |
|Get Function| ![get_memory_bar.png](/in-memory-cache/results/get_memory_bar.png) | ![get_memory_table.png](/in-memory-cache/results/get_memory_table.png) |
|Set Function| ![set_memory_bar.png](/in-memory-cache/results/set_memory_bar.png) | ![set_memory_table.png](/in-memory-cache/results/set_memory_table.png) |
|Remove Function| ![remove_memory_bar.png](/in-memory-cache/results/remove_memory_bar.png) | ![remove_memory_table.png](/in-memory-cache/results/remove_memory_table.png) |

![Average_ns_per_operation_get_remove](/in-memory-cache/results/Average_ns_per_operation_get_remove.png)

## Libraries

Expand Down
5 changes: 5 additions & 0 deletions in-memory-cache/makefile
Original file line number Diff line number Diff line change
Expand Up @@ -4,3 +4,8 @@ dependencies:

benchmark:
go test -bench=. -benchmem -count 5 -benchtime=100000x > results/results.out

generate-graph:
${PWD}/../result/bin/result -ParserFilePath=${PWD}/results -OutputFileTemplate=get_%s -LegendTemplate="{1}" -OptionsTemplate={0} -KeyTemplate={0}/{1}/{2} -Filter=functionName!=\"Get\" -TableWidth=2048 -TableLegendSpan=2
${PWD}/../result/bin/result -ParserFilePath=${PWD}/results -OutputFileTemplate=set_%s -LegendTemplate="{1}" -OptionsTemplate={0} -KeyTemplate={0}/{1}/{2} -Filter=functionName!=\"Set\" -TableWidth=2048 -TableLegendSpan=2
${PWD}/../result/bin/result -ParserFilePath=${PWD}/results -OutputFileTemplate=remove_%s -LegendTemplate="{1}" -OptionsTemplate={0} -KeyTemplate={0}/{1}/{2} -Filter=functionName!=\"Remove\" -TableWidth=2048 -TableLegendSpan=2
Binary file added in-memory-cache/results/get_allocations_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added in-memory-cache/results/get_memory_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added in-memory-cache/results/get_memory_table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added in-memory-cache/results/get_time_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added in-memory-cache/results/get_time_table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added in-memory-cache/results/remove_memory_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added in-memory-cache/results/remove_memory_table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added in-memory-cache/results/remove_time_bar.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added in-memory-cache/results/remove_time_table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 952a200

Please sign in to comment.