@aires You forgot YaCy. https://es.wikipedia.org/wiki/YaCy...

@aires You forgot YaCy. https://es.wikipedia.org/wiki/YaCy

I'd love to make a joke about it, but my experiences with it are way in the past. It was hard to install but nice to have. Your personal search engine, index based on what you actually looked at. Ate all your bandwidth to crawl websites.

Like 8 June at 9:24 | Wall-to-wall | Open on digitalcourage.social

17 comments

Captain of the SS El Faro

@datenritter @aires finally something gigabit fibre is actually good for, installing now(if I can)

8 June at 13:39 | Open on climatejustice.social

datenritter

@bangskij Please try. I heard it has some problems and I'd love to know if it's doable. @aires

8 June at 14:41 | Open on digitalcourage.social

Captain of the SS El Faro

@datenritter @aires Downloaded, installed, had to manually install Java, now it's running, I guess it'll need some time to do indexing, I'm not very techie. I'll leave it till tomorrow and then try some searching.

8 June at 17:10 | Open on climatejustice.social

datenritter

@bangskij Nice. Maybe I'll give it another try. Do you see some kind of progress indicator in the web interface? @aires

8 June at 20:21 | Open on digitalcourage.social

Captain of the SS El Faro

@datenritter @aires there's this, looks like I gotta figure out how to open a port for full functionality

8 June at 20:29 | Open on climatejustice.social

Captain of the SS El Faro

@datenritter @aires actually there's a great many settings and things in here. Was hoping for more automagic but I'll figure it out

8 June at 20:38 | Open on climatejustice.social

datenritter

@bangskij Nice! @aires

8 June at 20:57 | Open on digitalcourage.social

Captain of the SS El Faro

@datenritter @aires it looks like I can set it to crawl any website I specify, I tried discogs but it says it can't reach it, guess that's that port, I opened it in the firewall but I think I gotta open it in the router too

8 June at 20:59 | Open on climatejustice.social

datenritter

@bangskij It should allow you to paste a URL you want to be crawled. (Careful with the depth setting! Something like 12 or 18 will crawl the whole internet...) Also, when I tried it, there was a proxy function. Set your browser to use the YaCy proxy and it will crawl all sites you visit.

8 June at 21:14 | Open on digitalcourage.social

Captain of the SS El Faro replied to datenritter

@datenritter I managed to open the port, connect properly to the network and get a crawl starting. It's using very little bandwidth, about 1-2 megabits with the odd spike into 10. Considering I have a thousand of those and use them for email and this social network I think I should be good. It still posts an error message but it is also crawling so, guess it's fine. I don't know how to proxy my browser through it though but it's late here, try again tomorrow.

8 June at 22:28 | Open on climatejustice.social

Captain of the SS El Faro replied to Captain of the SS El Faro

@datenritter I set it to crawl google at 7 levels and it kept stopping for no memory, but it did spike into 50mbits. Restarting it now with more RAM allocated. Off to sleepy, but this is very exciting. Can't believe I can have my own search engine.

8 June at 22:55 | Open on climatejustice.social

datenritter

@bangskij Looks like it's still useful. Those settings should be documented somewhere. Most important IMHO: federation, access restrictions, index building. @aires

8 June at 20:58 | Open on digitalcourage.social

datenritter

@bangskij Also bandwidth limits. 😬@aires

8 June at 20:59 | Open on digitalcourage.social

hexmode

@datenritter @aires Just installed via docker and then pulled it up on localhost:8090. It found results for tech stuff right away. Some other results we disapppointing, but its a good start.