Skip to content

Commit

Permalink
release: 0.8.0
Browse files Browse the repository at this point in the history
  • Loading branch information
audrium committed Nov 30, 2021
1 parent f82e202 commit 9f6edde
Show file tree
Hide file tree
Showing 7 changed files with 64 additions and 33 deletions.
3 changes: 3 additions & 0 deletions AUTHORS.rst
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@ Authors

The list of contributors in alphabetical order:

- `Adelina Lintuluoto <https://orcid.org/0000-0002-0726-1452>`_
- `Anton Khodak <https://orcid.org/0000-0003-3263-4553>`_
- `Audrius Mecionis <https://orcid.org/0000-0002-3759-1663>`_
- `Camila Diaz <https://orcid.org/0000-0001-5543-797X>`_
Expand All @@ -12,9 +13,11 @@ The list of contributors in alphabetical order:
- `Dinos Kousidis <https://orcid.org/0000-0002-4914-4289>`_
- `Harri Hirvonsalo <https://orcid.org/0000-0002-5503-510X>`_
- `Jan Okraska <https://orcid.org/0000-0002-1416-3244>`_
- `Kenyi Hurtado-Anampa <https://orcid.org/0000-0002-9779-3566>`_
- `Leticia Wanderley <https://orcid.org/0000-0003-4649-6630>`_
- `Lukas Heinrich <https://orcid.org/0000-0002-4048-7584>`_
- `Marco Vidal <https://orcid.org/0000-0002-9363-4971>`_
- `Matthew Feickert <https://orcid.org/0000-0003-4124-7862>`_
- `Michael R. Crusoe <https://orcid.org/0000-0002-2961-9670>`_
- `Robin Long <https://github.com/longr>`_
- `Rokas Maciulaitis <https://orcid.org/0000-0003-1064-6967>`_
Expand Down
49 changes: 37 additions & 12 deletions CHANGES.rst
Original file line number Diff line number Diff line change
@@ -1,21 +1,46 @@
Changes
=======

Version 0.8.0 (UNRELEASED)
Version 0.8.0 (2021-11-30)
--------------------------

- Users:
- Adds support for Snakemake workflow engine.
- Administrators
- Adds new configuration to set node labels splitting workflow nodes, job nodes and session nodes
(``node_label_runtimebatch``, ``node_label_runtimejobs``, ``node_label_runtimesessions``).
- Adds a default ``kubernetes_memory_limit`` value (4Gi).
- Adds configuration environment variable to set workflow scheduling policy (``REANA_WORKFLOW_SCHEDULING_POLICY``).
- Adds configuration environment variables to set REST API rate limit values (``REANA_RATELIMIT_GUEST_USER``, ``REANA_RATELIMIT_AUTHENTICATED_USER``).
- Adds configuration environment variable to set a prefetch count for job status consumer (``REANA_JOB_STATUS_CONSUMER_PREFETCH_COUNT``).
- Adds new configuration ``quota.enabled`` to enable or disable quota accounting.
- Adds new configuration ``quota.termination_update_policy`` to select the resources for which the quota must be calculated.
- Changes Helm templates to use PostgreSQL 12.8 version.
- Adds support for running and validating Snakemake workflows.
- Adds support for ``outputs.directories`` in ``reana.yaml`` allowing to easily download output directories.
- Adds new command ``quota-show`` to retrieve information about total CPU and Disk usage and quota limits.
- Adds new command ``info`` that retrieves general information about the cluster, such as available workspace path settings.
- Changes ``validate`` command to add the possibility to check the workflow against server capabilities such as desired workspace path via ``--server-capabilities`` option.
- Changes ``list`` command to add the possibility to filter by workflow status and search by workflow name via ``--filter`` option.
- Changes ``list`` command to add the possibility to filter and display all the runs of a given workflow via ``-w`` option.
- Changes ``list`` command to stop including workflow progress and workspace size by default. Please use new options ``--include-progress`` and ``--include-workspace-size`` to show this information.
- Changes ``list --sessions`` command to display the status of interactive sessions.
- Changes ``logs`` command to display also the start and finish times of individual jobs.
- Changes ``ls`` command to add the possibility to filter by file name, size and last-modified values via ``--filter`` option.
- Changes ``du`` command to add the possibility filter by file name and size via ``--filter`` option.
- Changes ``delete`` command to prevent hard-deletion of workflows.
- Changes Yadage workflow specification loading to be done in ``reana-commons``.
- Changes CWL workflow engine to ``cwltool`` version ``3.1.20210628163208``.
- Removes support for Python 2.7. Please use Python 3.6 or higher from now on.
- Administrators:
- Adds new configuration options ``node_label_runtimebatch``, ``node_label_runtimejobs``, ``node_label_runtimesessions`` allowing to set cluster node labels for splitting runtime workload into dedicated workflow batch nodes, workflow job nodes and interactive session nodes.
- Adds new configuration option ``workspaces.paths`` allowing to set a dictionary of available workspace paths to pairs of ``cluster_node_path:cluster_pod_mountpath`` for mounting directories from cluster nodes.
- Adds new configuration option ``quota.enabled`` to enable or disable CPU and Disk quota accounting for users.
- Adds new configuration option ``quota.termination_update_policy`` to select the quota resources such as CPU and Disk for which the quota usage will be calculated immediately at the workflow termination time.
- Adds new periodic cron job to update Disk quotas nightly. Useful if the ``quota.termination_update_policy`` does not include Disk quota resource.
- Adds configuration environment variable ``reana_server.environment.REANA_WORKFLOW_SCHEDULING_POLICY`` allowing to set workflow scheduling policy (first-in first-out, user-balanced and workflow-complexity balanced).
- Adds configuration environment variables ``reana_server.environment.REANA_RATELIMIT_GUEST_USER``, ``reana_server.environment.REANA_RATELIMIT_AUTHENTICATED_USER`` allowing to set REST API rate limit values.
- Adds configuration environment variable ``reana_server.environment.REANA_SCHEDULER_REQUEUE_SLEEP`` to set a time to wait between processing queued workflows.
- Adds configuration environment variable ``reana_workflow_controller.environment.REANA_JOB_STATUS_CONSUMER_PREFETCH_COUNT`` allowing to set a prefetch count for the job status consumer.
- Adds support for Kubernetes 1.21 version clusters.
- Adds default ``kubernetes_memory_limit`` value (4 GiB) that will be used for all user jobs unless they specify otherwise.
- Changes Helm template to use PostgreSQL 12.8 version.
- Changes Helm template for ``reana-db`` component to allow 300 maximum number of database connections by default.
- Fixes email validation procedure during ``create-admin-user`` command to recognize more permissive email address formats.
- Developers:
- Changes ``git-*`` commands to add the possibility of excluding certain components via the ``--exclude-components`` option.
- Changes ``git-create-release-commit`` command to bump all version files in a component.
- Changes ``git-log`` command to show diff patch or to pass any wanted argument.
- Changes ``helm-upgrade-components`` command to also upgrade the image tags in ``prefetch-images.sh`` script.

Version 0.7.4 (2021-07-07)
--------------------------
Expand Down
2 changes: 1 addition & 1 deletion helm/reana/Chart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ keywords:
- reusable-science
type: application
# Chart version.
version: 0.8.0-alpha.5
version: 0.8.0
kubeVersion: ">= 1.13.0-0 < 1.22.0-0"
dependencies:
- name: traefik
Expand Down
2 changes: 1 addition & 1 deletion helm/reana/templates/NOTES.txt
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ The REANA system has been installed!
If you are upgrading from a previous REANA release series, you may need to
upgrade database schema now:

$ kubectl -n {{ .Release.Namespace }} exec -i -t deployment/{{ .Release.Name }}-server -- reana-db alembic upgrade
$ kubectl -n {{ .Release.Namespace }} exec -i -t deployment/{{ .Release.Name }}-server -c rest-api -- reana-db alembic upgrade

Please see the dedicated upgrade documentation at
<https://docs.reana.io/administration/deployment/upgrading-db/>
Expand Down
21 changes: 12 additions & 9 deletions helm/reana/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -56,38 +56,41 @@ components:
docs_url: https://docs.reana.io
forum_url: https://forum.reana.io
imagePullPolicy: IfNotPresent
image: reanahub/reana-ui:0.8.0-alpha.4
image: reanahub/reana-ui:0.8.0
reana_db:
enabled: true
reana_server:
imagePullPolicy: IfNotPresent
image: reanahub/reana-server:0.8.0-alpha.6
image: reanahub/reana-server:0.8.1
environment:
REANA_MAX_CONCURRENT_BATCH_WORKFLOWS: 30
REANA_SCHEDULER_REQUEUE_SLEEP: 15
REANA_USER_EMAIL_CONFIRMATION: true
REANA_WORKFLOW_SCHEDULING_POLICY: "fifo"
REANA_RATELIMIT_GUEST_USER: "20 per second"
REANA_RATELIMIT_AUTHENTICATED_USER: "20 per second"
uwsgi:
processes: 6
threads: 4
reana_workflow_controller:
imagePullPolicy: IfNotPresent
image: reanahub/reana-workflow-controller:0.8.0-alpha.5
image: reanahub/reana-workflow-controller:0.8.0
environment:
SHARED_VOLUME_PATH: /var/reana
REANA_JOB_STATUS_CONSUMER_PREFETCH_COUNT: 200
reana_workflow_engine_cwl:
image: reanahub/reana-workflow-engine-cwl:0.8.0-alpha.4
image: reanahub/reana-workflow-engine-cwl:0.8.0
reana_workflow_engine_yadage:
image: reanahub/reana-workflow-engine-yadage:0.8.0-alpha.5
image: reanahub/reana-workflow-engine-yadage:0.8.0
reana_workflow_engine_serial:
image: reanahub/reana-workflow-engine-serial:0.8.0-alpha.4
image: reanahub/reana-workflow-engine-serial:0.8.0
reana_workflow_engine_snakemake:
image: reanahub/reana-workflow-engine-snakemake:0.8.0-alpha.2
image: reanahub/reana-workflow-engine-snakemake:0.8.0
reana_job_controller:
image: reanahub/reana-job-controller:0.8.0-alpha.7
image: reanahub/reana-job-controller:0.8.0
reana_message_broker:
imagePullPolicy: IfNotPresent
image: reanahub/reana-message-broker:0.8.0-alpha.2
image: reanahub/reana-message-broker:0.8.0

notifications:
enabled: false
Expand Down
2 changes: 1 addition & 1 deletion reana/version.py
Original file line number Diff line number Diff line change
Expand Up @@ -13,4 +13,4 @@

from __future__ import absolute_import, print_function

__version__ = "0.8.0a5"
__version__ = "0.8.0"
18 changes: 9 additions & 9 deletions scripts/prefetch-images.sh
Original file line number Diff line number Diff line change
Expand Up @@ -11,15 +11,15 @@ for image in \
maildev/maildev:1.1.0 \
postgres:12.8 \
redis:5.0.5 \
reanahub/reana-job-controller:0.8.0-alpha.7 \
reanahub/reana-message-broker:0.8.0-alpha.2 \
reanahub/reana-server:0.8.0-alpha.6 \
reanahub/reana-ui:0.8.0-alpha.4 \
reanahub/reana-workflow-controller:0.8.0-alpha.5 \
reanahub/reana-workflow-engine-cwl:0.8.0-alpha.4 \
reanahub/reana-workflow-engine-serial:0.8.0-alpha.4 \
reanahub/reana-workflow-engine-snakemake:0.8.0-alpha.2 \
reanahub/reana-workflow-engine-yadage:0.8.0-alpha.5 \
reanahub/reana-job-controller:0.8.0 \
reanahub/reana-message-broker:0.8.0 \
reanahub/reana-server:0.8.1 \
reanahub/reana-ui:0.8.0 \
reanahub/reana-workflow-controller:0.8.0 \
reanahub/reana-workflow-engine-cwl:0.8.0 \
reanahub/reana-workflow-engine-serial:0.8.0 \
reanahub/reana-workflow-engine-snakemake:0.8.0 \
reanahub/reana-workflow-engine-yadage:0.8.0 \
; do
docker pull $image
kind load docker-image $image
Expand Down

0 comments on commit 9f6edde

Please sign in to comment.