Tag Archives forCrawler

Human Curated Intelligent Web Crawlers

Why?

Help create the best “top list” on a given subject.

How?

Create topic specific intelligent crawlers that go through the web and finds the “good stuff.” These are then are curated by experts in that topic to make the final top list.

Icons made by Freepik

 

November 23, 2016

Watch List for Low Level Blogs That Are Used as a Source for Higher Profile Publications

Why?

Online news publications need constant content 24/7/365. They often keep watch on low-level blogs and use materials they find there. It would be good to be up to date on which blogs they use often.

How?

Do a constant crawl of these high-profile publications to discover their sources, and keep an updated list of these sources ordered by topic and probability of being used as a source.

Icons made by Freepik

 

September 6, 2016

Map of Influential Bloggers’ Presence Online

Why?

To see visually where these bloggers are publishing their writings and get a birds eye view of their network of influence.

How?

Write a crawler that would scan the internet and map who publishes where. Using this constantly expanding database you could see a map of influence for a specific influencer: where is his main point of influence and what other publications is he using to enhance his footprint and influence.

Icons made by Freepik

 

September 5, 2016