Implementation of my own web crawler and performing focused crawling.

Implementation of DFS & BFS Crawler: Neo4j, Redis and Docker

Simple Web Crawler with customizable independent backend support.

Web search engine to retrieve most relevant web-pages for user search query from web-pages crawled on the UIC domain

Breadth-First Search Web Crawler

Este projeto tem como objetivo avaliar o desempenho de técnicas do estado da arte para Web Crawler e extração de conteúdos em páginas Web no contexto da automatização da avaliação de portais de transparência no estado da Paraíba

A simple mutli-threaded web crawler

Tugas Besar 2 Strategi Algoritma: Folder Crawling

Discover nodes breadth first and adjust their weight on the fly. This simulates HTTP crawling.

A Web Crawler which crawls the webpage in BFS form and returns the depth from origin ,most frequent word and number of valid external links on the page

General purpose utility to apply changes on folder content in BFS traversal of os path