Skip to content

Commit

Permalink
Merge pull request #851 from hyperledger/aath-summary-results
Browse files Browse the repository at this point in the history 
Changes by create-pull-request action
  • Loading branch information
@swcurran
swcurran authored Jul 22, 2024
2 parents bbb1b8f + 925bdb0 commit 0d290d8
Show file tree
Hide file tree
Showing 4 changed files with 44 additions and 18 deletions.
6 changes: 3 additions & 3 deletions docs/README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,15 +24,15 @@ Want to add your Aries component to this page? You need to add a runset to the

| Test Agent | Scope | Exceptions | ACA-Py | AFJ | VCX | **All Tests** |
| ----- | ----- | ----- | :----: | :----: | :----: | :----: |
| [ACA-Py](acapy.md)| AIP 1, 2 | None | 89 / 96<br>92% | 48 / 67<br>71% | 19 / 28<br>67% | **156 / 191<br>81%** |
| [ACA-Py](acapy.md)| AIP 1, 2 | None | 82 / 96<br>85% | 48 / 67<br>71% | 30 / 56<br>53% | **160 / 219<br>73%** |
| [AFJ](javascript.md)| AIP 1 | Revocation | 48 / 67<br>71% | 12 / 28<br>42% | 3 / 18<br>16% | **63 / 113<br>55%** |
| [VCX](aries-vcx.md)| AIP 1 | Revocation | 19 / 28<br>67% | 3 / 18<br>16% | 27 / 32<br>84% | **49 / 78<br>62%** |
| [VCX](aries-vcx.md)| AIP 1 | Revocation | 30 / 56<br>53% | 3 / 18<br>16% | 27 / 32<br>84% | **60 / 106<br>56%** |

- Where the row and column are the same Test Agent, the results include only the tests where the Test Agent plays ALL of the roles (ACME, Bob, Faber and Mallory)
- The results in the "All Tests" column include tests involving the "Test Agent" in ANY of the roles.
- Wondering what the results mean? Please read the brief [introduction to Aries interoperability](aries-interop-intro.md) for some background.
- Select the "Test Agent" links to drill down into the tests being run for each Test Agent.


*Results last updated: Mon Jul 15 04:13:52 UTC 2024*
*Results last updated: Mon Jul 22 04:25:41 UTC 2024*

40 changes: 33 additions & 7 deletions docs/acapy.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,9 +6,10 @@
| ------ | :--------------: | :-------------: | :----------------: | :-----------------: | ----- | :-----: |
| [acapy-afj](#runset-acapy-afj) | acapy-main<br>1.0.0rc4 | javascript<br>0.5.0-alpha.97 | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | AIP 1.0 | [**37 / 39<br>94%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-javascript/reports/latest/index.html?redirect=false#behaviors) |
| [acapy-aip10](#runset-acapy-aip10) | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | AIP 1.0 | [**35 / 35<br>100%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-aip10/reports/latest/index.html?redirect=false#behaviors) |
| [acapy-aip20](#runset-acapy-aip20) | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | AIP 2.0 | [**54 / 61<br>88%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-aip20/reports/latest/index.html?redirect=false#behaviors) |
| [acapy-aip20](#runset-acapy-aip20) | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | AIP 2.0 | [**47 / 61<br>77%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-aip20/reports/latest/index.html?redirect=false#behaviors) |
| [acapy-ariesvcx](#runset-acapy-ariesvcx) | acapy-main<br>1.0.0rc4 | aries-vcx<br>0.64.0 | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | AIP 1.0 | [**19 / 28<br>67%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-aries-vcx/reports/latest/index.html?redirect=false#behaviors) |
| [afj-acapy](#runset-afj-acapy) | javascript<br>0.5.0-alpha.97 | acapy-main<br>1.0.0rc4 | javascript<br>0.5.0-alpha.97 | javascript<br>0.5.0-alpha.97 | AIP 1.0 | [**11 / 28<br>39%**](https://allure.vonx.io/api/allure-docker-service/projects/javascript-b-acapy/reports/latest/index.html?redirect=false#behaviors) |
| [ariesvcx-acapy](#runset-ariesvcx-acapy) | aries-vcx<br>0.64.0 | acapy-main<br>1.0.0rc4 | aries-vcx<br>0.64.0 | aries-vcx<br>0.64.0 | AIP 1.0 | [**11 / 28<br>39%**](https://allure.vonx.io/api/allure-docker-service/projects/aries-vcx-b-acapy/reports/latest/index.html?redirect=false#behaviors) |

## Runset Notes

Expand All @@ -20,7 +21,7 @@ Runset Name: ACA-PY to AFJ
**Latest results: 37 out of 39 (94%)**
*Last run: Mon Jul 15 00:47:47 UTC 2024*
*Last run: Mon Jul 22 00:48:57 UTC 2024*
```

#### Current Runset Status
Expand All @@ -43,7 +44,7 @@ Runset Name: ACA-PY to ACA-Py
**Latest results: 35 out of 35 (100%)**
*Last run: Mon Jul 15 01:09:52 UTC 2024*
*Last run: Mon Jul 22 01:11:04 UTC 2024*
```

#### Current Runset Status
Expand All @@ -63,10 +64,10 @@ All of the tests being executed in this runset are passing.
Runset Name: ACA-PY to ACA-Py

```tip
**Latest results: 54 out of 61 (88%)**
**Latest results: 47 out of 61 (77%)**
*Last run: Mon Jul 15 01:42:17 UTC 2024*
*Last run: Mon Jul 22 01:40:39 UTC 2024*
```

#### Current Runset Status
Expand All @@ -89,7 +90,7 @@ Runset Name: acapy to aries-vcx
**Latest results: 19 out of 28 (67%)**
*Last run: Mon Jul 15 01:59:53 UTC 2024*
*Last run: Mon Jul 22 01:56:48 UTC 2024*
```

#### Current Runset Status
Expand All @@ -111,7 +112,7 @@ Runset Name: AFJ to ACA-PY
**Latest results: 11 out of 28 (39%)**
*Last run: Mon Jul 15 02:57:29 UTC 2024*
*Last run: Mon Jul 22 02:54:52 UTC 2024*
```

#### Current Runset Status
Expand All @@ -125,5 +126,30 @@ All AIP10 tests are currently running.
- [Results by executed Aries RFCs](https://allure.vonx.io/api/allure-docker-service/projects/javascript-b-acapy/reports/latest/index.html?redirect=false#behaviors)
- [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/javascript-b-acapy/reports/latest)


### Runset **ariesvcx-acapy**

Runset Name: aries-vcx to acapy

```tip
**Latest results: 11 out of 28 (39%)**
*Last run: Mon Jul 22 03:44:44 UTC 2024*
```

#### Current Runset Status

Most tests are currently struggling, due to aries-vcx reporting the wrong connection state to the
backchannel. Being resolved here: https://github.com/hyperledger/aries-vcx/issues/1253
@RFC0793 has relatively low success due to aries-vcx not supporting full range of DID methods in
these tests.
*Status Note Updated: 2024.07.05*

#### Runset Details

- [Results by executed Aries RFCs](https://allure.vonx.io/api/allure-docker-service/projects/aries-vcx-b-acapy/reports/latest/index.html?redirect=false#behaviors)
- [Test execution history](https://allure.vonx.io/allure-docker-service-ui/projects/aries-vcx-b-acapy/reports/latest)

Jump back to the [interoperability summary](./README.md).

10 changes: 5 additions & 5 deletions docs/aries-vcx.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
| Runset | ACME<br>(Issuer) | Bob<br>(Holder) | Faber<br>(Verifier) | Mallory<br>(Holder) | Scope | Results |
| ------ | :--------------: | :-------------: | :----------------: | :-----------------: | ----- | :-----: |
| [acapy-ariesvcx](#runset-acapy-ariesvcx) | acapy-main<br>1.0.0rc4 | aries-vcx<br>0.64.0 | acapy-main<br>1.0.0rc4 | acapy-main<br>1.0.0rc4 | AIP 1.0 | [**19 / 28<br>67%**](https://allure.vonx.io/api/allure-docker-service/projects/acapy-b-aries-vcx/reports/latest/index.html?redirect=false#behaviors) |
| [ariesvcx-acapy](#runset-ariesvcx-acapy) | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | aries-vcx<br>1.0.0 | AIP 1.0 | [**0 / 0<br>0%**](https://allure.vonx.io/api/allure-docker-service/projects/aries-vcx-b-acapy/reports/latest/index.html?redirect=false#behaviors) |
| [ariesvcx-acapy](#runset-ariesvcx-acapy) | aries-vcx<br>0.64.0 | acapy-main<br>1.0.0rc4 | aries-vcx<br>0.64.0 | aries-vcx<br>0.64.0 | AIP 1.0 | [**11 / 28<br>39%**](https://allure.vonx.io/api/allure-docker-service/projects/aries-vcx-b-acapy/reports/latest/index.html?redirect=false#behaviors) |
| [ariesvcx-ariesvcx](#runset-ariesvcx-ariesvcx) | aries-vcx<br>0.64.0 | aries-vcx<br>0.64.0 | aries-vcx<br>0.64.0 | aries-vcx<br>0.64.0 | AIP 1.0 | [**27 / 32<br>84%**](https://allure.vonx.io/api/allure-docker-service/projects/aries-vcx/reports/latest/index.html?redirect=false#behaviors) |
| [javascript-ariesvcx](#runset-javascript-ariesvcx) | javascript<br>0.5.0-alpha.97 | aries-vcx<br>1.0.0 | javascript<br>0.5.0-alpha.97 | javascript<br>0.5.0-alpha.97 | AIP 1.0 | [**3 / 18<br>16%**](https://allure.vonx.io/api/allure-docker-service/projects/javascript-b-aries-vcx/reports/latest/index.html?redirect=false#behaviors) |

Expand All @@ -19,7 +19,7 @@ Runset Name: acapy to aries-vcx
**Latest results: 19 out of 28 (67%)**
*Last run: Mon Jul 15 01:59:53 UTC 2024*
*Last run: Mon Jul 22 01:56:48 UTC 2024*
```

#### Current Runset Status
Expand All @@ -38,10 +38,10 @@ RFC0023 is disabled due to inconsistent results. RFC0793 is also being investiga
Runset Name: aries-vcx to acapy

```tip
**Latest results: 0 out of 0 (0%)**
**Latest results: 11 out of 28 (39%)**
*Last run: Mon Jul 15 04:13:50 UTC 2024*
*Last run: Mon Jul 22 03:44:44 UTC 2024*
```

#### Current Runset Status
Expand All @@ -66,7 +66,7 @@ Runset Name: aries-vcx to aries-vcx
**Latest results: 27 out of 32 (84%)**
*Last run: Mon Jul 15 03:32:45 UTC 2024*
*Last run: Mon Jul 22 04:00:20 UTC 2024*
```

#### Current Runset Status
Expand Down
6 changes: 3 additions & 3 deletions docs/javascript.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ Runset Name: ACA-PY to AFJ
**Latest results: 37 out of 39 (94%)**
*Last run: Mon Jul 15 00:47:47 UTC 2024*
*Last run: Mon Jul 22 00:48:57 UTC 2024*
```

#### Current Runset Status
Expand All @@ -42,7 +42,7 @@ Runset Name: AFJ to ACA-PY
**Latest results: 11 out of 28 (39%)**
*Last run: Mon Jul 15 02:57:29 UTC 2024*
*Last run: Mon Jul 22 02:54:52 UTC 2024*
```

#### Current Runset Status
Expand All @@ -65,7 +65,7 @@ Runset Name: AFJ to AFJ
**Latest results: 12 out of 28 (42%)**
*Last run: Mon Jul 15 03:12:37 UTC 2024*
*Last run: Mon Jul 22 03:10:39 UTC 2024*
```

#### Current Runset Status
Expand Down

0 comments on commit 0d290d8

Please sign in to comment.