Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

🔱 Productionise Glue Copy Metadata script #6133

Closed
2 of 4 tasks
julialawrence opened this issue Nov 19, 2024 · 1 comment
Closed
2 of 4 tasks

🔱 Productionise Glue Copy Metadata script #6133

julialawrence opened this issue Nov 19, 2024 · 1 comment
Assignees
@tom-webber @AntFMoJ
Labels
spike investigation, discovery into a thing

Comments

@julialawrence
Copy link
Contributor

julialawrence commented Nov 19, 2024 •
edited by tom-webber
Loading

Context

Follows on from #5859

Currently, the python script which copies metadata across accounts is running locally. We need to decide and agree on where it's best to deploy it and conditions under which to run it.

Proposal

How do we run it?
Where we run it from
* CaDeT workflow
* Separate workflow
	*Linked only to relevant metadata (we can use the extracted metadata file)
* Take a stab at guessing timing and do it then. (lambda)
     * Means might not be current
* Other?

Spike requirements

Data Engineer 3 das

Definition of Done

  • Solution has been designed / detailed
  • New issue details the follow-up tasks
  • PoC completed
  • PoC findings captured / documented
@julialawrence julialawrence added the spike investigation, discovery into a thing label Nov 19, 2024
@tom-webber tom-webber moved this from 👀 TODO to 🚀 In Progress in Analytical Platform Nov 22, 2024
@tom-webber
Copy link
Contributor

https://github.com/moj-analytical-services/create-a-derived-table/pull/2465

@tom-webber tom-webber mentioned this issue Nov 22, 2024
Merged
This was referenced Nov 19, 2024
Open
Merged
Merged
tom-webber added a commit that referenced this issue Nov 26, 2024
@tom-webber
fix: update role name to clearer name
341479f 
This PR is being tracked as part of #6133

Depends on ministryofjustice/modernisation-platform-environments#8812

Uses a clearer name for the role assumed by the CaDeT runner
This was referenced Nov 26, 2024
Merged
Merged
Merged
Merged
tom-webber added a commit that referenced this issue Nov 27, 2024
@tom-webber
fix: update role name to clearer name
c0e8437 
This PR is being tracked as part of #6133

Depends on ministryofjustice/modernisation-platform-environments#8812

Uses a clearer name for the role assumed by the CaDeT runner
tom-webber added a commit that referenced this issue Nov 27, 2024
@tom-webber
fix: update role name to clearer name (#6181)
44554a2 
This PR is being tracked as part of #6133

Depends on ministryofjustice/modernisation-platform-environments#8812

Uses a clearer name for the role assumed by the CaDeT runner
This was referenced Nov 28, 2024
Merged
Merged
Merged
Merged
@tom-webber tom-webber moved this from 🚀 In Progress to 🎉 Done in Analytical Platform Dec 9, 2024
@tom-webber tom-webber closed this as completed by moving to 🎉 Done in Analytical Platform Dec 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tom-webber tom-webber

@AntFMoJ AntFMoJ

Labels
spike investigation, discovery into a thing
Projects
Analytical Platform
Archived in project
Milestone
No milestone
Development

No branches or pull requests
3 participants
@tom-webber @julialawrence @AntFMoJ