Blog

Data Science and Analytics Outsourcing – Vendors, Models, Steps

Posted by Ravi Kalakota on Nov 13, 2013, 5:27:00 AM

To meet demand for faster innovation around analytics, changeCFOs and CIOs are rethinking their
silo’d sourcing strategies and looking at new way of doing things via Outsourcing Analytics.

The “should we or shouldn’t we outsource data science” discussion is heating up in board-rooms and executive suites  as analytics becomes core to the firm, C-level execs have to consolidate efforts for delivering the same services to different groups within an organization.

As managers look to execute on outsourcing strategy they have many structural options depending on which variable they want to optimize around (cost, quality, productivity, innovation, time to market):

  • Outsource Analytics vs. Building a Shared Services Analytics Function at the LoB or corporate level?
  • Outsource the Analytics Platform development and support or keep it in-house in the IT function or LoB
  • Outsource the modeling and data science part or hire/build the capabilities in-house?
  • Augment the current staff with domain specific expertise or hire FTEs?
  • Centralize analytics in a shared services model or let the LoBs do their thing?

Build vs. Buy vs. Lease (as-a-service cloud solutions) — What is the right configuration… the answer depends on the organization – internal politics, credibility of IT leadership, ability to execute and so on.

Why Outsource Data Science or Analytics?

Data science and analytics capability is becoming table stakes in areas that haven’t traditionally been thought of as data-focused industries.

However, enterprise IT is typically slow to react. In many enterprise IT budgets, the cost of operations (run the business) is the fastest growing line item—consuming 70+% of budget dollars.  IT organizations are being asked respond to (grow the business or change the business) by enabling new big data analytics innovation opportunities,  regulatory demands, and building shared private cloud infrastructure that is comparable to Amazon Web Services.  A herculean task for IT to keep up.

The race to implement innovation is often a driver for outsourcing…acquire the right mindset, toolset, skillset and dataset… to get the job done. LoB leaders, instead of waiting for IT,  drive top-line growth by seeking the most direct path to solutions that will support their initiatives. They want solutions that deliver a quick ROI,  can be implemented quickly and affordably, without a huge drain on IT (a source they may not have much control over). 

The result of this approach is a one-off  pragmatic, speed-to-market fractured environments. Typical scenario in a large firm… business units leveraging different service providers, different storage and processing technologies, and different front-end visualization tools.  In some cases, I have seen organizations with multiple teams contracting with different vendors within the same business units to solve similar problems (e.g., customer attrition and next best action), creating a nightmare for IT who have to support multiple solutions concurrently in production and customer-facing organizations getting conflicting insights from the different solutions.  This scenario typically forces a centralization and subsequent outsourcing discussion.

What are Some Areas to Outsource?

The different areas of data sciences or analytics outsourcing (based on lifecycle of a project) include:

  • Analytics Consulting (strategy, technology selection, model development, decision process re-engineering
  • Analytics Platform Deployment, Customization and Integration
  • Analytics ”as-a-service” platform strategies—by leveraging a common set of development, production, and support capabilities
  • Analytics Program Staffing — resource augmentation (salary and intellectual arbitrage), project and program management
  • Domain and Function Modeling Knowhow — depends on how standardized the tasks and KPIs are
  • Legacy BI modernization – a growing problem of enhancing or wrapping the old to produce new

For each area and business need (transformation vs. strategic vs. tactical) there are different vendors that are a better fit.  In this posting I examine the frequently asked executive questions around Outtasking or Outsourcing Analytics (and Data Sciences) – models of engagement, cost models etc.  Also included is a list of Analytics Outsourcing Providers that I have been tracking.   Most of these firms are evolving their capabilities but are rooted in providing BI and Analytics capabilities on a staffing or project basis.

Outsourced analytic providers serving many industries, including retail, telecommunications, healthcare and others, provide clients with domain expertise in database-driven marketing and customer segmentation. If you know of others that need to be included on this list send me an e-mail.

What are the models of Outsourcing engagement ?

  • Project based model
  • Competency based Staff Augmentation based on salary arbitrage
  • Creating a Analytics center of excellence (CoE) staffed by your team and vendor team
  • Creating a hybrid CoE (partly onshore in the corporation + partly offshore at a captive or third party vendor)
  • SLA or Outcome based is the most complex engagement model.
  • Pay per use “as-a-service” Cloud models - providers are responding to the continuing shortage of data scientists by offering data science know-how as a cloud service.

In some cases you will need mixed models. For instance, it’s important to keep in mind that 80% of the costs for data-related projects get spent on data preparation – mostly on cleanup data quality issues. Unfortunately data related budgets for many companies tend to go into platforms, frameworks which can only be used after you have quality data.

Who makes the Outsourcing Decision?

Who handles the management and implementation of  analytics in the enterprise?  CIO,CFO, CDO, LoB or marketing executives?  Most enterprises are struggling with the right operating model for analytics and data science.  This was relatively straightforward with BI and data management which was often under a global CIO or CTO’s umbrella.

Data sciences and analytics are seen as potential game changer. So, who is the buyer? With the right solutions and execution, analytics can have a powerful impact on customer engagement, frontline business units,  and operations. Also as speed-to-market and innovation become critical,  getting the right solutions and implementing them is outside the purview of a typical CIO or CTO.  

In a recent Deloitte study, “The Analytics Advantage,” highlights how diverse the initiative ownership is. Executives in many different types of roles own the  analytics initiatives within their enterprises, and no clear title emerges as the dominant owner (see below).

Overseer of Analytics

Who are the industry leaders in this space?

This is a tough question to answer without more context around problem or use-case.  But in general, our survey of market leaders shows:

  • Broad “super market” services firms with a broad array of capabilities - Accenture, IBM, Deloitte
  • The growing pure-play analytics firms include:  Mu-Sigma, Opera, EXL Analytics
  • Offshore vendors who have built their model around analytics – Genpact (spin out from GE)
  • Domain specific vendors — Dunnhumby (retail analytics); Acxiom (database marketing)

What are the Range of Outsourcing Services Offered?  Increasingly vendors are able to offer horizontal and vertical solutions effectively packaged in a variety of configurations. Vendors are becoming more sophisticated as they gain experience handling large, complex datasets.  The services range from Data Sciences ->  expertise in various techniques -> toolsets -> vertical specific expertise.

Analytics Offerings

What is Data science?  Data Science is an umbrella term that encapsulates the extraction of timely, actionable  information from diverse data sources. It covers data collection, data modeling and analysis, and problem solving and decision making. It incorporates and builds on techniques and theories from many fields, including mathematics, statistics,  pattern recognition and learning, advanced computing, visualization, and uncertainty modeling with the goal of extracting meaning from data and creating data products.

Data science is  often used interchangeably with business analytics, although it is becoming more common. Data science seeks to use all available and relevant data to effectively tell a story that can be easily understood by non-practitioners.

Data science is nothing new. But digital has increasingly created new opportunities where scientific methods can be applied to massive, real world data sets.

See below for a partial list of Data Science and Analytics Services Providers…

List of Analytics Services Providers 

  1. IBM Analytics (General – serves broad areas) –http://www.ibm.com/analytics/us/en/
  2. Mu-Sigma (Sales, Marketing, Supply Chain, and Risk Analytics) –http://www.mu-sigma.com/
  3. LatentView (Marketing, Risk, Customer Management) –http://www.latentview.com/index_flash.htm
  4. HCL Technologies (General – serves broad areas) –http://www.hcltech.com/enterprise-transformation-services/business-analytics
  5. Accenture (General – serves broad areas) – http://www.accenture.com/in-en/consulting/analytics/Pages/index.aspx
  6. Genpact Analytics (acquired Symphony Technology Group) (General – serves broad areas) – http://www.genpact.com/home/solutions/analytics-research
  7. Cognizant Analytics (General – serves broad areas) –http://www.cognizant.com/enterpriseanalytics
  8. TCS Analytics (General – serves broad areas) –http://www.tcs.com/offerings/business_process_outsourcing_BPO/analytics-insights/Pages/default.aspx
  9. Wipro Analytics (General – serves broad areas) –http://www.wipro.com/services/analytics-information-management/
  10. Amberoon Inc. (Solutions for business use cases ) – http://www.Amberoon.com
  11. McKinsey Analytics Knowledge Centre (General – serves broad areas) –http://mckc.mckinsey.com/our_work/analytics
  12. Deloitte Analytics (General – serves broad areas) –http://www.deloitte.com/view/en_US/us/Services/additional-services/deloitte-analytics-service/index.htm
  13. PwC Analytics (General – serves broad areas) –http://www.pwc.com/us/en/technology-forecast/index.jhtml
  14. AbsolutData (Consumer Behavior Analytics) – http://www.absolutdata.com/
  15. Fractal Analytics (Customer Loyalty, Operations) –http://www.fractalanalytics.com/
  16. iCreate (Banking Analytics) – http://www.icreate.in/
  17. Dunhumby (Retail Analytics) – http://www.dunnhumby.com/in/
  18. Global Analytics (Credit Risk, Financial, Lending) - http://www.global-analytics.com/
  19. Manhattan Systems (Retail Analytics)
  20. Capillary Technologies (Retail Analytics) – http://www.capillarytech.com/
  21. Nabler (Online Retail Analytics) – http://www.nabler.com/
  22. Activecubes (Sales, Marketing, Supply Chain, Operations) –http://www.activecubes.com/analytics.php
  23. ICRA Technology Services (General – serves broad areas) –http://www.icteas.com/business_analytics.php
  24. WNS Analytics (acquired Marketics) (Marketing, Consumer Behavior Analytics) –http://www.wns.com/Services/Cross-Industry-Solutions/Research-and-Analytics.aspx
  25. Opera Solutions (General – serves broad areas) – http://www.operasolutions.com
  26. Data Monitor (General – serves broad areas) – http://www.datamonitor.com/
  27. Ipsos (Marketing Analytics) – http://www.ipsosasiapacific.com/
  28. EXL Services (acquired Inductis) (General – focuses on broad areas) –http://www.exlservice.com/
  29. Meritus (Marketing, Customer Analytics) – http://www.meritusglobal.com/
  30. Modelytics (Financial, Lending, Collections, Recovery, Retail Banking) –http://www.modelytics.com/integrated/index.htm
  31. Bridge i2i Analytics (Behavioral Modeling & Resource Planning) –http://www.bridgei2i.com/
  32. Cytel (Clinical & Pharma Analytics) – http://www.cytel.co.in/index.shtml
  33. Neural Techsoft (Financial & Risk Analytics) – http://www.neuraltechsoft.com/
  34. Vehere Interactive (Telecom, Financial) – http://www.vehereinteractive.com/
  35. Aegis Global (General – focuses on broad areas) –http://www.aegisglobal.com/section_level3.aspx?cont_id=eLxpcOMCwVY=
  36. Datamatics (Financial, Insurance) –http://www.datamatics.com/services/information-management/business-intelligence-analytics
  37. Marketelligent (CPG, Finance, Telecom Analytics) –http://www.marketelligent.com/home/
  38. TNS Global (Marketing Analytics) - http://www.tnsglobal.com
  39. NettPositive Analytics (Marketing, Credit Risk Analytics) –http://www.nettpositive.com/
  40. Affine Analytics (Marketing Analytics) – http://www.affineanalytics.com/
  41. EVALUESERVE (Financial, Life Sciences Analytics) – http://www.evalueserve.com

Issues to Consider in Picking an Analytics Service Provider?

  • Who handles the data;  How sensitive is the data; how unusual (and competitive advantage based) are the analytics usually dictates the engagement model
  • Capability of the team:  Most firms and vendors are capable of report generation, descriptive statistics or dashboard generation
  • Ability to Analyze and interpret results: Moving to more complex predictive models requires domain expertise and use case knowhow….most vendors claim to have this but very rarely do.
  • How easy are they to work with?  Do you have to spoon feed them or ambiguity is ok. Since clients are looking for faster turn-arounds for more sophisticated insights  on continuously increasing amounts of data, vendors need to deliver solutions that will scale better with lower cost of ownership to meet their clients’ internal service-level agreements.
  • Experience with large complex data sets or ability need to mix and match different types of data

What are Different Resource Cost models?

  • Onshore consultants (Data scientists will be in the $250-350 per hour range);  Specialized domains (Risk Analytics) will carry a 30% premium ($300-$600 per hour fees).
  • Also hot geographic areas with lot of startups like San Francisco or New York…the rates may be much higher…. supply vs. demand.
  • China, especially Shanghai, is a good place for analytical talent in my experience.  India also with different Indian Statistical Institutes (where sound engineering firm Bose came from) also has good cheap talent.  We built an actuarial center of excellence in New Delhi which worked well.
  • Offshore analytics consultants (India will be around the $30-$75 per hour range  — pay premium only for IIT and IIM educated personnel; Indian Statistical Institute (ISI) also generates good graduates).

Resource costs depend on domain expertise and analytics niche:  Predictive analytics;  Behavioral analytics;  Risk analytics; Sales & marketing analytics, Social media analytics,  Web analytics.

What are the different Pricing Models in Analytics Outsourcing?

The structure of the pricing for the outsourcing contract can be one of the following:

  • Cost Plus. This approach pays the supplier for its actual costs, plus a predetermined profit percentage. This plan allow little or no flexibility when business objectives and technology change during the life of the contract, nor does it give any incentive for the supplier to perform more effectively.
  • Unit Pricing. This is a set rate determined by the supplier for a particular level of service, and the client pays based on its usage. Paying for desktop maintenance based on the number of users is an example of this approach.
  • Fixed Price. Some buyers think this is the best approach, because they know exactly what the supplier’s price will be, even in the future. But the problem with this approach is that if the buyer does not adequately define the scope of the process and design effective metrics before signing the contract, too often the result will be that the supplier claims a particular service or service level is beyond the scope of the contract and then charges a premium for it.
  • Variable Pricing. This plan involves use of a fixed price at the low end of the supplier’s service, with variances based on higher service levels. Its effectiveness, again, depends on adequately defining scope of process and metrics.
  • Incentive-based (or performance-based) pricing. Here, the buyer provides incentives to encourage the supplier to perform at peak level (or complete a one-time project ahead of time, for example) by offering a bonus reward if the supplier performs well. This same plan works in ensuring that the supplier must pay a penalty if it does not perform to at least the “satisfactory” service level designated in the agreement. This plan is the one to use to ensure the supplier’s excellence in performance.
  • Risk/reward sharing. Here, the buyer and supplier each have an amount of money at risk and each stand to gain a percentage of the profits if the supplier’s performance is optimum and achieves the buyer’s objectives.

The buyer will select a supplier using a pricing model that best fits the business objectives the buyer is trying to accomplish by outsourcing.

What are the Measures of success ?

  • Effort based vs. Outcome based
  • For repeated analytics like Dashboard generation – one can have SLA, Quality and Errors as a measure of success.

How effective are vendors in scaling (upwards – more and downwards – less)?

  • Depends on whether the vendor is an IT vendor like TCS, Big 5 like Deloitte or pure-play analytics vendor like Mu-Sigma.   These vendors can rampup from a standing start to 200 people in a few months.
  • For simple use cases and simple analytics – most vendors can ramp up to 30-50 people easily (made up of data management, cleansing/quality, BI report generation and Dashboards)
  • Vendors can also rampup around technology platforms like SAP, Oracle more easily than around use-cases like marketing analytics.
  • For more challenging use cases like recommendation engines, next best offer which require more sophisticated modeling (simulation, optimization, time series etc.) – most vendors probably can assemble a small team but not be able to scale easily beyond 10.
  • Domain modeling expertise, Architects and skilled project managers tend to be the hardest skills to find.

What are the Expected Benefits of Analytics Outsourcing?

  • Specialization, Focus, Speed-to-market  and Scale – tend to be the expected benefits.
  • Vendors may have proprietary IP and tools (see below for landscape view of different techniques)
  • Lower  cost by leveraging economies of scale  (often the sales pitch but seldom works in execution)
  • Better process quality through forced standardization (vendors force clients to standardize which requires re-engineering the way things are done)

Firms must not expect to outsource analytics and then just assume that the specifics will take care of themselves is a recipe for disaster. Managers must retain enough program management capability to enforce processes, communicate with all parties, and keep track of critical details.

Vertical Industry Specific Domain Expertise

See this blog posting for Use Cases for Big Data and Analytics

Communications

The communications industry is characterized by intense competition and customer attrition, or “churn.” Targeted marketing opportunities and the rapid response to behavior trends are paramount to the success of communications service providers in retaining existing customers and attracting new customers. Customer relationship management, or CRM, analyses need to be constantly and quickly performed, to enable service providers to market to at-risk customers before they churn, offer new products and services to those most likely to buy, and identify and manage key customer relationships. Other key analytical needs of communications service providers include call data record analysis for revenue assurance, billing and least-cost routing, fraud detection and network management.

Digital Media and E-commerce

For online businesses, the process of collecting, analyzing and reporting data about page visits, otherwise known as click stream analysis, is required for constant monitoring of website performance and customer pattern changes. In addition to needing to address the operational and customer relationship challenges faced by traditional retailers, digital media businesses must also analyze hundreds of millions or even billions of click stream data records to track and respond to customer behavior patterns in real time. Additionally, with online advertising becoming a major revenue generator, many digital media businesses and their advertisers need to understand who is looking at the advertisements and their actions as a result of viewing the advertisements. Fast analysis of online activity can enable better cross-selling of products, prevent customers from abandoning shopping carts or leaving the web site, and mitigate click stream fraud.

Retail

With thousands of products and millions of customers, many retailers need sophisticated systems to track, manage and optimize customer and supplier relationships. Targeted marketing programs often require the analysis of millions of customer transactions. To prevent supply shortages large retailers must integrate and analyze customer transaction data, vendor delivery schedules and radio frequency identification supply chain data. Other useful analyses for retail companies include “market basket” analysis of the items customers buy in a given shopping session, customer loyalty programs for frequent buyers, overstock/understock and supply chain optimization.

See this blog posting for KPIs for Retail Industry.

Financial Services

Financial services institutions generate terabytes of data related to millions of client purchases, banking transactions and contacts with marketing, sales and customer service across multiple channels. This data contains crucial business information on client preferences and buying behavior, and can reveal insights that enable stronger customer relationship management and increase the lifetime value of the customer. In addition, risk management and portfolio management applications require analysis of vast amounts of rapidly changing data for fraud prevention and loan analysis. With extensive compliance and regulatory requirements, financial institutions are required to retain an ever-increasing amount of data and need to make this data available for detailed reporting on a periodic basis.

See this blog posting for KPIs for Financial Services Industry.

Government

As some of the largest creators and consumers of data, government agencies around the world need to access, analyze and share vast amounts ofup-to-date data quickly and efficiently. These agencies face a broad range of challenges, including identifying terrorist threats and reducing fraud, waste and abuse. Iterative analysis on many terabytes of data with high performance is crucial for achieving these missions.

Health and Life Sciences

Healthcare providers seek to analyze terabytes of operational and patient care data to measure drug effectiveness and interactions, improve quality of care and streamline operations through more cost-effective services. Pharmaceutical companies rely on data analysis to speed new drug development and increase marketing effectiveness. In the future, these companies plan to incorporate large amounts of genomic data into their analyses in order to tailor drugs for more personalized medicine.

Build information platforms or dataspaces – IT and Storage Industry

The significant growth of enterprise data is fueling a need for additional storage and other information technology infrastructure to maintain and manage it. These technology needs are being further driven by a steady decline in data storage prices, which makes storing large data sets more economical.

As the volume of data continues to grow, enterprises have recognized the value in analyzing such data to significantly improve their operations and competitive position. They have also realized that frequent analysis of data at a more detailed level is more meaningful than periodic analysis of sampled data. In addition, companies are making analytic capabilities more widely available to a broad range of users across the enterprise for both strategic and tactical decision-making.

These factors have driven the demand for next generation data warehouses infrastructure like Hadoop that provide the critical framework for data-driven enterprise decision-making by way of business intelligence.

 

Notes

1) Shared Services is an alternate service delivery model that enables organizations to apply economic principles of demand and supply to internal business processes.  Shared services help consolidate efforts for delivering the same services to different groups within an organization.

Shared Services enables an organization to:  (1) Consolidate efforts for delivering the same services to different groups within an organization – economies of scale & competence; (2)  Be more commercial orientated; measure SSC-customer satisfaction and competitive offering based on service products; (3)  Utilize multiple delivery channels for services depending on the nature of the service, the recipient and the circumstances

2) Best Practices in Implementing  Analytics Outsourcing

  • Baseline performance of processes relevant for outsourcing (or centralization)
  • Harmonize and standardize business processes
  • Automate business processes via technology investments
  • Enable employees and business partners via self services and single-point- of-contact
  • Manage services effectively through a globally consistent service and operating model
  • Implement governance to internal client-provider relationship
 3) The Typical Transformation Journey…. applies to Outsourcing  (source – Charlie Feld)Analytics Journey
Related articles

Topics: analytics, big data, advanced analytics, data-as-a-service, Big Data practicioner, data scientist, analytics as a service, data analytics infrastructure, Big Data Prescriptions, big data visualization presentation, business insights, business perspective solutions

Subscribe to Email Updates

Recent Posts