Projects mentioned at #ApacheCon - Tika, Stanbol, Webintents, Mahout, Gora, Nutch, Solr, ElasticSearch, Hadoop, Heritix. Worth to look at.