-- Leo's gemini proxy

-- Connecting to gemini.omarpolo.com:1965...

-- Connected

-- Sending request

-- Meta line: 20 text/gemini;lang=en

# pkg_add larbin

Larbin is a web crawler (also called (web) robot, spider, scooter...).
It is intended to fetch a large number of web pages to fill the database
of a search engine. With a network fast enough, Larbin should be able to
fetch more than 100 millions pages on a standard PC.

-- Response ended

-- Page fetched on Sat Jun 1 23:35:44 2024