Yesterday I attended an event hosted by Booz Allen/Amazon around Big Data and Cloud Computing for life sciences. It was a fascinating event that brought together folks from data science, software, and pharma background. The takeaway was clear: Cloud Computing, Full Text Search, and Big Data are revolutionizing genomics and pharmaceutical research. So much computing [...]
Better late then never, here is the screencast of my presentation Big Search for Big Data that I gave at LuceneRevolution. It’s a story of the mistakes and victories we had in a major search project we did for a Federal customer. Big Search with Big Data Principles from Lucene Revolution on Vimeo.
Matt Overstreet was the Master of Ceremonies for the Richmond Startup Weekend earlier this month. And the guest speaker was Aneesh Chopra, first CTO of the United States. Matt Overstreet introducing Aneesh Chopra Our friends at GroundWorkDesign, who build virtual experiences, recorded this.
My colleague Scott Stults talks about our experiences in using Amazon EC2 to perform distributed indexing into Solr as well as reprocessing a million TIFF images. At one point we had over 350 EC2 Large instances running! Enjoy! Indexing Big Data on Amazon AWS from Lucene Revolution on Vimeo.
I went to LuceneRevolution to test out my assertion that Search is the dominant metaphor for working with Big Data and based on the conversations that I had, that assertion holds water. As Grant Ingersoll pointed out in his keynote, the basic plumbing required for Big Data: storage, distributed processing, cheap price tag, have been [...]
After a couple of exhausting days at HIMSS last week, where I was overwhelmed both by being a first time visitor to the glitz of Las Vegas and the sheer size of the HIMSS exhibit hall, I’ve come to the conclusion that HealthIT is currently running on two separate parallel tracks. The first track is [...]
Eric Pugh got notified today that he’s been accepted to speak on “Better Search Engine Testing” at the 2011 Apache Lucene Eurocon. So, what, you may ask, does search engine testing entail? Great search implementation isn’t just about installing Solr and making it run a millisecond faster. It’s about setting up the conditions to ensure [...]
On June 15, I presented at the Basis Technologies Lucene and Solr in the Government conference on the topic of multi-level security (MLS) in Solr using ManifoldCF. This post covers the notes from my presentation. My presentation covers document security as it pertains to search: …across multiple repositories …by users of varying clearance …against documents [...]
