Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(duckdb): Add DuckDB Backend #598

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

alifiroozi80
Copy link

@alifiroozi80 alifiroozi80 commented Nov 3, 2024

Hello there,
Thanks for this fantastic project.
I needed the DuckDB feature but it wasn't available, so I added it.

In writing, I realized there is no DuckDB driver for Gorm, so I first created that driver (you can see it here, and here is the merge request on Gorm to add this driver to their main website), and then I used it here for this feature.


After the merge, I will create another merge request on buz-docs and add this supported backend there as well.


Here are the steps:

make bootstrap

Then send a dummy data:

curl -X POST "localhost:8080/webhook" -H 'Content-Type:application/json' -d '{"arbitrary": "thing"}'

Here is the result:

Screenshot 2024-11-18 at 12 20 38 PM

@jakthom
Copy link
Contributor

jakthom commented Nov 17, 2024

@alifiroozi80 love this!! It's totally where my head is as well (see https://github.com/jakthom/hercules for what I've been playing with along this line of thinking).

I've been trying to work through all the CGO=1 implications (ci builds, running in a lambda, etc) before adding a DuckDB backend. Do you have thoughts on all the CGO things? This might (finally) be incentive to make builds dependent on what sinks are configured, etc...

@alifiroozi80
Copy link
Author

alifiroozi80 commented Nov 18, 2024

Hello @jakthom
Thanks, mate🙏🍻
About CGO, I didn't get your point. Did you mean to use C and write a custom driver instead of using something like GORM?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants