Is there room for an open-source search engine?

driven by god knows what.

by money

stract hasn’t been crawling a lot for a while, it’s still in the developmental phase. Most of the news is old and it’s still missing a lot of stuff. There are even some major websites that don’t even come up when you search them. Like, GitHub.

its more or less just a tech demo right now for the website.

bring back webrings.

Thanks for the mention. Yes we are fully indepedent, and also offer out API to others.

Crawling and indexing the web is not as expensive as Google would like you to think. Especially when you don’t engage in tracking, collecting masses of data and then processing it. Our index is 8 Billion+ pages and is served up on our own assembed (not expensive) servers. A big part of the challenge is developing the IP to serve up and rank results for a search, from those billions of pages, in ~200ms.

we encourage it, no less :smiley:

And there are more than two companies, but less than you’d want: https://www.searchenginemap.com/ (this is English language)

Second that. While I love the idea, a p2p search engine would be risky for everyone who signs up to be a node. Especially if it starts to rival Google, they’ll start coming at ISPs for user info to scare people off and kill the platform

People run tor nodes so it’s not unthinkable that some would run a webcrawler for a decentralised search engine project.

Just running it through a decent VPN would sort out the legal issues.

Doesn’t your smart fridge run a webcrawler?

not only that, but folks would game it to just show disturbing links for the lulz (like goatse in the early 2000s)

nobody said it would be easy, but it is needed.

They are one of said bigots.

And under construction .gif!

Crawling and indexing the web is not as expensive as Google would like you to think. Especially when you don’t engage in tracking, collecting masses of data and then processing it.

Thanks for the encouraging info! How much of the web is Mojeek able to represent, in %? And how current is it?

Happily corrected! So the yellow ones do actual crawling.

No, Google is indeed a search engine. They maintain and build their own index. Searx does not. It uses existing search engines instead.

Edit: can’t read.

Easy? We’re saying that the very nature of open sourcing it means it can’t work. Google etc keep their algorithms as trade secrets and are still constantly having to adapt and react to people gaming the system

Bruh I said whoogle

Maybe a non-profit closed source. I’m only saying it is needed if we want to combat censorship and control of the data which will get worse, guaranteed. Oligarchs will not allow free speech and freedom of information.

I could’ve sworn it said Google, but I must’ve misread in this heat. You’re right.