Can we add support for remote CDP driven browser?

[nicoandmee]

Suggestion: Allow for interfacing with chromium-based browsers using CDP protocol. This is needed for scraping "sensitive" sites and the like, where using a custom build of chromium in a docker container is required. CDP feels perfect for this use-case, but I am curious to hear your thoughts.

[snshn]

Hi Nico!

That's a pretty cool idea. I've used CDP just recently for a very cool scraping project working with a lovely bunch of folks; it seems to be widely utilized for an array of things. Custom builds of Chromium in a Docker container and just something cloud-based are certain use cases, there may be more. I'll look into how to make it work.

Meanwhile, I think you could achieve this by making the Docker container print the HTML into STDOUT, and then piping that to monolith, it supports STDIN via pipes.