Skip to main content
Big data’s humble beginnings
August 14, 2016 at 2:45 PM
by Joe Apprendi

Clicks. Once upon a time they were the most powerful tool in assessing online ad performance. A humble beginning, but much has changed. The data-driven measurement and predictive analytics technologies that launched adtech and expanded to marketing are now being applied to nearly everything — and yet, it’s easy to forget the road that led here.

The genesis of big data

October 27, 1994: The first ad to hit the web is published.

It was difficult to recognize the significance at the time, but that single, floating rectangle at the top of my computer screen would bring into being an entirely unique market.

Adtech was invented — designed for this emerging sector, and built to measure the return of the new media creators produced.

Finally, ads could be understood.

The science of productivity

Adtech has a reputation for being overcomplicated and overpriced; however, it is largely misunderstood. It is not only underappreciated, but undervalued. Adtech is to big data what the Big Bang is to the universe. The collective origin story of all productivity measuring data begins with adtech. From measuring the performance of ads, we can now measure the performance of most anything — even people.

It didn’t take long for those in the industry to realize how much potential their new data-measuring technology had. The applications are endless, as we continue to see today.

Big data software and services are predicted to grow to a $41.5 billion market in 2018. And as the appetite for data grows, so too will the demand for sophisticated tools to interpret and refine it.

Applied analytics

Following the example set by adtech, other sectors are leveraging big data and predictive technologies to drive efficiency and accuracy.

In 2014, Uber launched UberPool, which uses algorithms to match riders based on location and sets the price based on the likelihood of picking up another passenger.

The latest generation of finance management software learns from consumers’ transaction history and spending patterns, and provides intelligent recommendations and personalized advice.

Human resources departments are bringing analytics into the tasks of corporate hiring, retention and promotion, and the insurance sector is using data to influence customers into better driving habits.

Data-driven ecosystems

Similarly to the way the LUMAscape evolved for adtech, new ecosystems are poised to coalesce around other industries. Businesses that rely on data to make key decisions will want better, more granular insights. So the shift to predictive analytics in multiple sectors will form a virtuous cycle, driving demand for tools to further enrich and interpret all that data.

As we approach a period of exponential growth, formerly siloed verticals are abandoning legacy systems and embracing analytics.

Enterprises are already embracing big data and predictive analytics to hire and retain talent, forecast staffing needs and improve employee satisfaction. In the next two years, 6,400 organizations with 100 employees or more plan to implement big data analytics, providing ample opportunities for a new crop of startups that collect, refine and interpret data to populate the HR analytics landscape.

Startups are leveraging Watson’s technology to deliver data-driven recommendations to consumers and healthcare providers; this pattern will soon extend to the health sector at large. People are generating more health-related data than ever before, and doctors, patients and researchers need tools to make sense of it. Physicians will be able to compare patients’ data with health trends in the general population and provide