Skip to content

Commit

Permalink
[UPDATE] Improved shell scripts for large dataset handling: batch pro…
Browse files Browse the repository at this point in the history
…cessing, error handling, path optimization, and logging enhancements. Resolves #26.
  • Loading branch information
FMCalisto committed Sep 22, 2024
1 parent eae9b03 commit 011c5c5
Show file tree
Hide file tree
Showing 8 changed files with 65 additions and 0 deletions.
9 changes: 9 additions & 0 deletions scripts/birads_to_server.sh
Original file line number Diff line number Diff line change
@@ -1,9 +1,18 @@
#!/bin/bash
#
# Author: Francisco Maria Calisto
# Maintainer: Francisco Maria Calisto
# Email: francisco.calisto@tecnico.ulisboa.pt
# License: ACADEMIC & COMMERCIAL
# Created Date: 2024-04-11
# Revised Date: 2024-09-22 # Updated to reflect improvements
# Version: 1.2 # Incremented version to reflect further optimizations for large datasets
# Status: Development
# Credits:
# - Carlos Santiago
# - Catarina Barata
# - Jacinto C. Nascimento
# - Diogo Araújo
# Usage: ./birads_to_server.sh
# Example: ./script/birads_to_server.sh
# Description: This script copies files from a local directory to a remote server using scp.
Expand Down
9 changes: 9 additions & 0 deletions scripts/clean_batches.sh
Original file line number Diff line number Diff line change
@@ -1,9 +1,18 @@
#!/bin/bash
#
# Author: Francisco Maria Calisto
# Maintainer: Francisco Maria Calisto
# Email: francisco.calisto@tecnico.ulisboa.pt
# License: ACADEMIC & COMMERCIAL
# Created Date: 2024-04-04
# Revised Date: 2024-09-22 # Updated to reflect optimizations and improvements
# Version: 1.1 # Incremented version to reflect the additional changes
# Status: Development
# Credits:
# - Carlos Santiago
# - Catarina Barata
# - Jacinto C. Nascimento
# - Diogo Araújo
# Usage: ./clean_batches.sh
# Example: ./script/clean_batches.sh
# Description: This script clears files in specified directories by removing them in batches.
Expand Down
9 changes: 9 additions & 0 deletions scripts/clean_tests.sh
Original file line number Diff line number Diff line change
@@ -1,9 +1,18 @@
#!/bin/bash
#
# Author: Francisco Maria Calisto
# Maintainer: Francisco Maria Calisto
# Email: francisco.calisto@tecnico.ulisboa.pt
# License: ACADEMIC & COMMERCIAL
# Created Date: 2024-04-04
# Revised Date: 2024-09-22 # Updated to reflect improvements
# Version: 1.2 # Incremented version to reflect further optimizations
# Status: Development
# Credits:
# - Carlos Santiago
# - Catarina Barata
# - Jacinto C. Nascimento
# - Diogo Araújo
# Usage: ./clean_tests.sh
# Example: ./script/clean_tests.sh
# Description: This script clears all files from specified test and data directories.
Expand Down
9 changes: 9 additions & 0 deletions scripts/copy_testing_files.sh
Original file line number Diff line number Diff line change
@@ -1,9 +1,18 @@
#!/bin/bash
#
# Author: Francisco Maria Calisto
# Maintainer: Francisco Maria Calisto
# Email: francisco.calisto@tecnico.ulisboa.pt
# License: ACADEMIC & COMMERCIAL
# Created Date: 2024-04-07
# Revised Date: 2024-09-22 # Updated to reflect improvements
# Version: 1.3 # Incremented version to reflect further optimizations
# Status: Development
# Credits:
# - Carlos Santiago
# - Catarina Barata
# - Jacinto C. Nascimento
# - Diogo Araújo
# Usage: ./copy_testing_files.sh
# Example: ./script/copy_testing_files.sh
# Description: This script reads a list of file paths from a text file and copies them
Expand Down
9 changes: 9 additions & 0 deletions scripts/copy_to_server.sh
Original file line number Diff line number Diff line change
@@ -1,9 +1,18 @@
#!/bin/bash
#
# Author: Francisco Maria Calisto
# Maintainer: Francisco Maria Calisto
# Email: francisco.calisto@tecnico.ulisboa.pt
# License: ACADEMIC & COMMERCIAL
# Created Date: 2024-04-11
# Revised Date: 2024-09-22
# Version: 1.4 # Incremented version to reflect further improvements
# Status: Development
# Credits:
# - Carlos Santiago
# - Catarina Barata
# - Jacinto C. Nascimento
# - Diogo Araújo
# Usage: ./copy_to_server.sh
# Example: ./script/copy_to_server.sh
# Description: This script copies files from a local directory to a remote server using rsync.
Expand Down
2 changes: 2 additions & 0 deletions scripts/move_files.sh
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,8 @@
# Maintainer: Francisco Maria Calisto
# Email: francisco.calisto@tecnico.ulisboa.pt
# License: ACADEMIC & COMMERCIAL
# Created Date: 2024-09-21
# Revised Date: 2024-09-22 # Updated to reflect optimizations and improvements
# Version: 1.5 # Incremented version to reflect new logging location
# Status: Development
# Credits:
Expand Down
9 changes: 9 additions & 0 deletions scripts/search_in_logs.sh
Original file line number Diff line number Diff line change
@@ -1,9 +1,18 @@
#!/bin/bash
#
# Author: Francisco Maria Calisto
# Maintainer: Francisco Maria Calisto
# Email: francisco.calisto@tecnico.ulisboa.pt
# License: ACADEMIC & COMMERCIAL
# Created Date: 2024-04-10
# Revised Date: 2024-09-22 # Updated date to reflect revisions
# Version: 1.1 # Incremented version to reflect improvements
# Status: Development
# Credits:
# - Carlos Santiago
# - Catarina Barata
# - Jacinto C. Nascimento
# - Diogo Araújo
# Usage: ./search_in_logs.sh
# Example: ./script/search_in_logs.sh
# Description: This script searches for a specified word within .log files
Expand Down
9 changes: 9 additions & 0 deletions scripts/split_log_files.sh
Original file line number Diff line number Diff line change
@@ -1,9 +1,18 @@
#!/bin/bash
#
# Author: Francisco Maria Calisto
# Maintainer: Francisco Maria Calisto
# Email: francisco.calisto@tecnico.ulisboa.pt
# License: ACADEMIC & COMMERCIAL
# Created Date: 2024-04-10
# Revised Date: 2024-09-22 # Updated to reflect improvements
# Version: 1.2 # Incremented version to reflect improvements
# Status: Development
# Credits:
# - Carlos Santiago
# - Catarina Barata
# - Jacinto C. Nascimento
# - Diogo Araújo
# Usage: ./split_log_files.sh
# Example: ./script/split_log_files.sh
# Description: This script splits large .log files into smaller parts based on a maximum
Expand Down

0 comments on commit 011c5c5

Please sign in to comment.