> the biggest issue with crawling is the blocking part and how much you need to invest to circumvent Cloudflare and similar … mix of residential proxies, captcha solvers, rotating user-agents, stealth chrome binaries

I would like to register my hatred and contempt for what you do. I sincerely hope you suffer drastic consequences for your antisocial behavior.

Please elaborate, why exactly is it antisocial? Because Cloudflare decides who can or cant access a users website? When they specifically signed up for my service.

But how does that work?

Does Cloudflare force firewall rules for those who choose to use it for their websites?

If the tool that does the crawling identifies itself properly, does Cloudflare block it even if users do not tell Cloudflare to block it?

It intentionally circumvents the explicit desires of those who own the websites being exploited. It is nonconsensual. It says “fuck you, yes” to a clearly-communicated “please no”.

OP literally said that users add their domains, meaning they are explicitly ASKING OP to scrape their websites.

Users sign up for my service.

Cloudflare and Big Tech are primary contributors to the impairment and decline of the Internet commons for moats, control, and profit; you are upset at the wrong parties.

Why not both?

This is kind of like getting upset with people who go to ATMs because drug dealers transact in cash lol.

I would argue that the ability to crawl and scrape is core to the original ethos of the internet and all the hoops people jump through to block non-abusive scraping of content is in fact more anti-social than circumventing these mechanisms.

It was bought by Microsoft and declined, yes.

“I would argue that…” is a weaker statement, because it ends with an implied “…but since I don’t care that much, I’m not ‘seriously’ arguing that.” It’s not at all equivalent to the strong statement “I argue that…”, which has no such qualifier.

Why cure yourself of useful conversational nuance?

In my view, another example would be Gautama Buddha, with Dependent Origination. It’s basically a super early realisation of Process Philosophy.

https://en.wikipedia.org/wiki/Prat%C4%ABtyasamutp%C4%81da https://iep.utm.edu/processp/

Edit: but even it likely relied on his prior experience with nondualistic Hinduisms, of course.

If it tried to play Balatro using knowledge of, e.g., poker, it would lose badly rather than win. Have you played?

I think I weakly disagree. Poker players have intuitive sense of the statistics of various hand types showing up, for instance, and that can be a useful clue as to which build types are promising.

>Poker players have intuitive sense of the statistics of various hand types showing up, for instance, and that can be a useful clue as to which build types are promising.

Maybe in the early rounds, but deck fixing (e.g. Hanged Man, Immolate, Trading Card, DNA, etc) quickly changes that. Especially when pushing for "secret" hands like the 5 of a kind, flush 5, or flush house.

It’s a lot easier to keep your values when you aren’t literally waiting for and counting on the billion dollar check, though.

And who gets to decide the membership of those groups? You?

If I'm going to take part in lawmaking, then yes, of course.

Isn’t Telegram at least plausibly a tool of Russian surveillance? My understanding was that its attempts to distance itself from the regime were laughable and only made the relationship more obvious.

I think that’s why it’s rarely mentioned.

I mean, discord is a tool of US surveillance and I’m a Lot more worried about that government doing something to me given Russia is ten thousand miles away

To be fair, the British invented and innovated that style of tea. You should only look east if you’re interested in the many other styles.