|
Top-level
 @amin I have a suggestion and a question. I use searxng as a meta search engine. I could imagine it would be neat to add clew as plugin to see how much better it is to the other (now AI tainted) engines. the second one is: could I scope it to index only the intranet of a company, when self hosting? 3 comments
re: searxng although I think it would just be enough to provide a good API I think and well focus on publishing it, I think a plugin is written out rather fast. re: scope for my intranet it would be enough to access the public parts so basically what you plan anyway. I just need something that can crawl the company internal wiki and a couple of other public doc.  Sounds perfect, then! I'll keep that on my radar. You're also welcome to submit feature requests here to make sure it stays on my radar: https://codeberg.org/Clew/Clew/issues |
Gregory's Server
@NafiTheBear
re: searxng
Hmm, that would definitely be cool! Do you know if there's some kind of API I could implement that would make that easier? I don't really know much about searx so any guidance in helping make that a reality is appreciated.
re: scope
Not currently, but the ability to do that definitely fits into my roadmap for the project. One specific idea I've had is to be able to scope it to crawl sites from a webring, so you can search the webring, like Lieu, and scoping it to an intranet would not be much harder.
I assume, though, that would need some kind of authentication to crawl the intranet? That might be the tricky part depending on how the intranet is implemented. (Unless it's just a "be on the local network" thing in which case it's probably pretty easy.)
@NafiTheBear
re: searxng
Hmm, that would definitely be cool! Do you know if there's some kind of API I could implement that would make that easier? I don't really know much about searx so any guidance in helping make that a reality is appreciated.
re: scope
Not currently, but the ability to do that definitely fits into my roadmap for the project. One specific idea I've had is to be able to scope it to crawl sites from a webring, so you can search the webring, like Lieu, and scoping it to an intranet...