Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

💨 Internal Airflow #1591

Closed
2 of 6 tasks
Tracked by #2843
jacobwoffenden opened this issue Sep 19, 2023 · 0 comments
Closed
2 of 6 tasks
Tracked by #2843

💨 Internal Airflow #1591

jacobwoffenden opened this issue Sep 19, 2023 · 0 comments
Labels
✈️ Airflow Migration Epic (Epic #2843) data-platform-apps-and-tools This issue is owned by Data Platform Apps and Tools

Comments

@jacobwoffenden
Copy link
Member

jacobwoffenden commented Sep 19, 2023 •
edited
Loading

User Story

As a platform engineering team

I want to host an Apache Airflow instance separate to Amazon MWAA

So that non user DAGS can be scheduled, for example Open Metadata's ingestion

Value / Purpose

Amazon MWAA uses AWS IAM token based authentication, Open Metadata uses basic authentication to communicate

Useful Contacts

No response

User Types

No response

Hypothesis

If we... [do a thing]
Then... [this will happen]

Proposal

Rather than use Open Metadata's dependency packages Airflow, we run a instance as a standalone service

Additional Information

No response

Definition of Done

Example - [ ] Documentation has been written / updated

  • README has been updated
  • User docs have been updated
  • Another team member has reviewed
  • Tests are green

Issues
@jacobwoffenden jacobwoffenden added the enhancement enhancing an existing feature label Sep 19, 2023
@YvanMOJdigital YvanMOJdigital added data-platform-apps-and-tools This issue is owned by Data Platform Apps and Tools and removed enhancement enhancing an existing feature labels Sep 22, 2023
@github-actions github-actions bot mentioned this issue Oct 1, 2023
Closed
@github-project-automation github-project-automation bot moved this to ✨ Done ✨ in Analytical Platform Oct 2, 2023
@github-actions github-actions bot mentioned this issue Jan 26, 2024
Closed
16 tasks
@jacobwoffenden jacobwoffenden moved this to 🎉 Done in Analytical Platform Feb 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
✈️ Airflow Migration Epic (Epic #2843) data-platform-apps-and-tools This issue is owned by Data Platform Apps and Tools
Projects
Analytical Platform
Archived in project
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jacobwoffenden @YvanMOJdigital @julialawrence