Item13: Crawl completion is too slow, clogging up the queue

• speed up database procedures: statistics + analyse. Look at which 'plan' is made by explain. One afternoon. Enable slow query log!
  • done
    
• change default settings to 1,2 for new users.
  • done
    
• create alerts + more info on network types (e.g. 3,3 is not better)
  • not done
    
• special 'server' for 3 iterations and/or scheduled crawls - plug 'n' play crawl
  • done, not special, just added third crawler

-- ErikBorra - 28 Feb 2008