Hadoop & Startups: Where Open Source Meets Business Data
Jul 18, 2011, 17:00 (0 Talkback[s])
"Even a modestly successful startup has a user base comparable
in population to nation-states. The resultant mass of user data
creates problems and opportunities. Problems because understanding
the value of every user and transaction becomes more complex.
Opportunities because the collective intelligence of the population
can be leveraged into better user experiences.
Until just a year or two ago, analyzing this scale of data
required the same kind of enterprise solutions that LAMP was
created to avoid. Multiyear, multimillion dollar deals with the
likes of IBM, Oracle, and Teradata. Of course, almost no startup
can afford that kind of expense. Furthermore, the closed-source
technological pedigree of these solutions makes them incompatible
with startup engineering knowledge and culture.
Enter Hadoop. Hadoop solves these data processing problems in a
way that is both startup-compatible, and technologically