Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

division-specific folders in the data directory are not used #97

Open
sandwitch opened this issue Mar 30, 2023 · 3 comments
Open

division-specific folders in the data directory are not used #97

sandwitch opened this issue Mar 30, 2023 · 3 comments
Assignees
Labels
invalid This doesn't seem right

Comments

@sandwitch
Copy link
Collaborator

I was told that the uploaders places the directories uploaded at first in the division folders in the datadirectory, however it places everything in the root of the datadirectoy. Is this a miscobfiguration on our part or a bug?

Lising current situation:

ls -l /srv/Park/
total 1024
drwxr-xr-x. 2 uploader uploader 0 9 feb 09:38 _1
drwxr-xr-x. 2 uploader uploader 0 10 feb 13:49 _2
-rw-r-----. 1 uploader uploader 4240 22 feb 2022 2022-02-22_Algemeen.txt
drwxr-xr-x. 2 uploader uploader 0 9 mrt 10:58 _3
drwxr-xr-x. 2 uploader uploader 0 27 mrt 12:20 _4
drwxr-xr-x. 2 uploader uploader 0 27 mrt 14:55 _5
drwxr-xr-x. 2 uploader uploader 0 27 mrt 14:57 _6
drwxr-xr-x. 2 uploader uploader 0 23 feb 2022 AAAA
drwxr-xr-x. 2 uploader uploader 0 10 aug 2021 beeld
drwxr-xr-x. 2 uploader uploader 0 9 feb 09:26 cc
drwxr-xr-x. 2 uploader uploader 0 28 mrt 08:49 datavarse_test
drwxr-xr-x. 2 uploader uploader 0 9 mrt 2022 dit
drwxr-xr-x. 2 uploader uploader 0 28 mrt 11:30 folder2
drwxr-xr-x. 2 uploader uploader 0 9 feb 10:01 geckodriver-v0.32.0-linux64
drwxr-xr-x. 2 uploader uploader 0 9 feb 11:51 geckodriver-v0.32.0-linux64_1
drwxr-xr-x. 2 uploader uploader 0 27 mrt 13:08 geckodriver-v0.32.0-linux64_2
drwxr-xr-x. 2 uploader uploader 0 9 feb 11:25 G_Output
drwxr-xr-x. 2 uploader uploader 0 14 feb 2022 her
drwxr-xr-x. 2 uploader uploader 0 10 aug 2021 hl
drwxr-xr-x. 2 uploader uploader 0 10 aug 2021 hs
drwxr-xr-x. 2 uploader uploader 0 9 feb 11:16 igd
drwxr-xr-x. 2 uploader uploader 0 10 aug 2021 jc
drwxr-xr-x. 2 uploader uploader 0 10 aug 2021 kind
drwxr-xr-x. 2 uploader uploader 0 10 aug 2021 lab
drwxr-xr-x. 2 uploader uploader 0 9 feb 11:11 Oefeningen
drwxr-xr-x. 2 uploader uploader 0 9 feb 15:52 Oefeningen_1
drwxr-xr-x. 2 uploader uploader 0 9 feb 16:12 Oefeningen_2
drwxr-xr-x. 2 uploader uploader 0 10 aug 2021 owc
drwxr-xr-x. 2 uploader uploader 0 9 feb 10:37 temp
drwxr-xr-x. 2 uploader uploader 0 27 mrt 10:49 test_am_uploader_20230327
drwxr-xr-x. 2 uploader uploader 0 27 mrt 12:22 test_am_uploader_20230327_1
drwxr-xr-x. 2 uploader uploader 0 27 mrt 14:55 test_am_uploader_20230327_2
drwxr-xr-x. 2 uploader uploader 0 27 mrt 15:51 test_am_uploader_20230327_3
drwxr-xr-x. 2 uploader uploader 0 29 mrt 10:23 test_am_uploader_20230327_4
drwxr-xr-x. 2 uploader uploader 0 9 feb 14:05 Test data
drwxr-xr-x. 2 uploader uploader 0 9 feb 15:12 Test data_1
drwxr-xr-x. 2 uploader uploader 0 10 feb 12:43 Test data_2
drwxr-xr-x. 2 uploader uploader 0 10 feb 13:50 Test data_3
drwxr-xr-x. 2 uploader uploader 0 13 feb 10:51 Test data_4
drwxr-xr-x. 2 uploader uploader 0 9 mrt 10:29 Test data_5
drwxr-xr-x. 2 uploader uploader 0 27 mrt 14:56 Test data_6
drwxr-xr-x. 2 uploader uploader 0 9 feb 13:27 test_folder_1
drwxr-xr-x. 2 uploader uploader 0 13 feb 11:07 test_folder_1_1
drwxr-xr-x. 2 uploader uploader 0 14 feb 11:58 test_folder_1_2
drwxr-xr-x. 2 uploader uploader 0 9 mrt 10:59 test_folder_1_3
drwxr-xr-x. 2 uploader uploader 0 27 mrt 14:36 test_folder_1_4
drwxr-xr-x. 2 uploader uploader 0 28 mrt 14:20 test_folder_1_5
drwxr-xr-x. 2 uploader uploader 0 29 mrt 10:45 test_folder_1_6
drwxr-xr-x. 2 uploader uploader 0 10 aug 2021 vb
drwxr-xr-x. 2 uploader uploader 0 10 aug 2021 vf

For clarification files in the division folders are from before the uploader install:

for DIR in beeld cc dit her hl hs igd jc kind lab owc vb vf ; do ls -l /srv/Park/${DIR} ; done
total 0
total 0
total 0
drwxr-xr-x. 2 uploader uploader 0 16 feb 2022 22_Athero
drwxr-xr-x. 2 uploader uploader 0 16 feb 2022 22_Beeld
drwxr-xr-x. 2 uploader uploader 0 3 mrt 2022 22_COVID_19
drwxr-xr-x. 2 uploader uploader 0 15 feb 2022 22_Dermatologie
total 0
drwxr-xr-x. 2 uploader uploader 0 21 jan 2021 22_YOUth_spde
total 0
total 0
total 0
drwxr-xr-x. 2 uploader uploader 0 9 feb 11:16 test_folder_1
total 0
total 0
total 0
total 0
total 0
total 0

@sandwitch
Copy link
Collaborator Author

sandwitch commented Mar 30, 2023

Our config:

umcu_uploader.yaml.txt

@npoppelier npoppelier added the invalid This doesn't seem right label Mar 30, 2023
@npoppelier npoppelier changed the title The divisionfolders in the datadirectory are not used division-specific folders in the data directory are not used Mar 30, 2023
@mcantelon
Copy link
Member

mcantelon commented May 11, 2023

Hi @sandwitch ! Uploaded research folders don't currently get put into division-specific subdirectories in the data directory. Only Archivematica transfer source directories can currently be configured to be division-specific.

@joel-simpson
Copy link
Contributor

I think that makes sense... when you first upload a dataset to the UMCU uploader, you don't know what division it should go into until the user has filled in the metadata form.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
invalid This doesn't seem right
Projects
None yet
Development

No branches or pull requests

4 participants