What's Behind the Surge of Interest in People Analytics?

Knowledge at Wharton

Ask about Knowledge at Wharton

Episode Description

Can a data-driven approach to managing people at work help organizations make better HR decisions? Wharton professors Cade Massey and Adam Grant share their insights. More: http://knlg.net/1CAqeZO πŸ“‚ Human Resources;Technology

Read the full transcriptHide the full transcript
  1. our guests today are Adam gr and Kade Massie who lead Barton's people analytics initiative gentlemen welcome
  2. to knowledge at Wharton thanks thanks for having us so Kate we when we spoke last year about people analytics that
  3. was just before your conference and you have another conference coming up uh and
  4. it seems to me that during this past year that interest in people analytics has really gone up why is people
  5. analytics so hot well I agree with you that it does seem to be blowing up a little bit um it started I feel like it
  6. started in technology more than any other industry and then Finance picked it up and now we see it kind of
  7. everywhere um my sense is that people appreciate that this is a very important function and yet hasn't been approached
  8. very in a very sophisticated way in the past and all of a sudden they realize you can use all these tools that we're
  9. accustomed to using in marketing or Finance we can use them for hiring people and compensating people and
  10. what's better than that given how how um important those things are to an organization so it's the it's the
  11. potential people seeing the potential of this that's making it popular Adam what
  12. are your thoughts on why it's becoming so popular yeah I I didn't even know it existed until Kate and I ended up
  13. working with Google about five years ago and they had built this whole people analytics team um that was a mix of
  14. traditional HR folks Consultants engineers and and folks like us who study organizational behavior and it was
  15. amazing that they were able to take questions that used to be answered based on intuition and actually run
  16. experiments and gather data to figure out what were the right choices to make and you know I think that Google's
  17. gotten a ton of press for all the great work they've done in this area and other
  18. leaders have started thinking why aren't we doing this shouldn't we be making all
  19. of our important decisions based on evidence too yeah should we just be giving glasa Bach credit here because
  20. he's been like an evangelist for this surprisingly he's been out there he's the head of HR at Google and he's always
  21. been very willing to say hey this is what we're doing this is what you should be doing kind of uncharacteristic for
  22. someone to say that essentially to his competitors so one of the things I find very interesting about people analytics
  23. is as as you said Alam how a lot of decisions HR decisions that used to be based on intuition are now sort of
  24. migrating over into datadriven decisions can you give me some examples of say if
  25. you take hiring as the first uh point of Engagement between a company and an employee how is hiring changing because
  26. of people analytics so uh people are very interested now and can we can we identify from objective measures who's
  27. going to work well in our firm so rather than having to bring them in here and talk to them in person can we grab you
  28. know their their GPA in college and where they went to school and who they worked for and predict somehow from
  29. these inputs how they're going to be if you could that'd be great right because you save a lot of time you can process
  30. all these information all these applications real efficiently so that's pretty promising at least that has a lot
  31. of appeal now there's more appeal to to it than substance right now because it's
  32. really hard to do but there that would be great if you can pull it off and it would it would it would be great
  33. um any investment you can make in making that happen is going to have high returns but it's still new so there's no
  34. there there's no silver bullets um but people are drawn to it because it could be great if it happens So based on the
  35. evidence does it matter where you went to school wow this is like a question that
  36. people with high school age kids are forever asking right they're like does it matter if they go to Princeton versus
  37. the state school what do is there good evidence of that I don't know there's good evidence on that right now I mean I
  38. I think it's a debate that continues to rage um but my my favorite research on this uh is Caroline Hawkes and if I
  39. remember correctly what she shows is that it's mostly selection effect so that if you you know if you come out of
  40. an Ivy League school um you typically will end up with a higher income and more job opportunities uh but all of the
  41. characteristics that led you there were visible before University chose you and it was essentially you know bringing in
  42. an ambitious and talented group of students to begin with as opposed to something magical that happened in your
  43. four years um that being said um we like to think that we're doing something of use ex magical happens here at Wharton
  44. NBA magical happens um but you know that the what I what I like to say is that probably Great Schools provide an
  45. advantage through the Network that people get to know maybe through the training but there's it's kind of like
  46. stereotypes there there may be true differences in social categories between people but people believe these
  47. differences are bigger than they actually are and there's huge variation within the category so there's huge
  48. variation in outcomes from people who come and go to pen and there's huge variations and outcomes from people who
  49. go to pen State and there's a lot more overlap between these two things than people think got so so so let's say the
  50. hiring step is over and now you on to this uh next step of onboarding people what can uh people analytics do to
  51. improve the onboarding process so you know we need to be careful not just you know uh law Google at every turn but
  52. they are an organization that has looked at this explicitly and they did it in the best possible way they ran
  53. experiments on let's on board in this way and then manipulate in a different group in a different way to see what
  54. actually makes a difference so it's not just telling stories we're actually doing science here to figure out what
  55. makes the most difference and I I don't I don't know all the details the study this is something they've been doing for
  56. the last couple of years but they recognized the onboarding process as kind of really important and completely
  57. underexplored so they went out and ran and and uh and experiment do you remember the details of this there
  58. there's one finding that jumps out at me which is um when they they looked at all
  59. the things that make a difference in the first few days or first few weeks of your time at Google um probably the most
  60. critical thing to happen is just that you meet your manager on day one and people are busy right um You may have a
  61. lot of direct reports um and maybe also as a new hire that you're being sent to a lot of different places um but based
  62. on that evidence they they said look one of one of our rules for onboarding is you've got to meet your manager on day
  63. one um and that's such a critical part of building a bond between an employee and an employer um it's not to say that
  64. we didn't know it was important for you to meet your manager but I think all of us right myself included really
  65. underestimated how much of an effect that would have on day one and so I think that's that's an example of the
  66. kind of thing we've learned from their work something else I talk about a little bit that seems wise is that a
  67. person's success at a company often depends heavily on who they work for and yet who they work for is essentially
  68. completely outside their control and so this isn't exactly on boarding but it is
  69. early career early stage consideration if things aren't working out you need to be wise about it and not just blame that
  70. person and you probably want to see that person in more than one circumstance before you draw a too strong a
  71. conclusion about this is just they're both examples of being more systematic and scientific about evaluating your
  72. employees or trying to train your employees as opposed to the old school kind of would do this because this is
  73. what we've always done got it so what once you start working in the company increasingly we find that uh more and
  74. more of us are working in teams uh and teams are very often geographically dispersed very often across different
  75. countries uh but also across Generations so you have Baby Boomers and Millennials
  76. sort of having to figure out how to work together what can we learn through people analytics about the creation and
  77. construction of high performance teams MH mhm so um an infinite number of things and this is such a rich area and
  78. Adam I'm sure has his favorite examples one of the ones that I first think about
  79. is recent work by Chris shabri and his colleagues on um Team IQ essentially and they do some really interesting stuff
  80. that looks at the productivity of teams um as a function of their individual characteristics versus what they do
  81. collectively and he finds that there is something they seem to find something like team IQ that is different from the
  82. some of the parts it's not that if you put all the smart people together that they produce the smartest work it's that
  83. they need to be people who understand how to work with each other and work as a part of a team there's something
  84. unique about Team level intelligence that's different from the sum of the individual level
  85. intelligence and I I think to build on that there are probably ways that you can compose a team to enhance the
  86. likelihood right that that they'll be intelligent as a group so one of the things I hear a lot is that diversity is
  87. good and there's no question that we get a lot of value from diversity in terms of people bringing unique perspectives
  88. thoughts skills to the table but when you look at personality research there are some characteristics on which it's
  89. actually helpful to have similarity as opposed to variety so um if you look at the the data extroversion introversion
  90. is the clearest trait where variety is useful um your team of whole extroverts essentially never starts working on the
  91. task team of all introverts um often forget to bond and the data say that the most effective teams have a mix of the
  92. two but don't necessarily stretch that into every other personality trait if you look at a personality trait like
  93. agreeableness for example people who love social harmony one of the worst things you can do is put them on a team
  94. with people who are extremely critical and skeptical um because the disagreeable people are feeling like
  95. they have to walk on eggshells constantly meanwhile the poor agreeable people they have this this catch22 of I
  96. can be really agreeable and act disagreeable like the disagreeable people and then hate myself afterward or
  97. you know I can be really agreeable and then you know it doesn't doesn't quite gel and so there it's actually helpful
  98. to have either similarity in personality or a consistent Norm of how we're going
  99. to interact and so I think we have to be really more thoughtful about composition
  100. than we have been have been in the past probably and one of the things that people analytics brings to that task in
  101. general is just the inclination to study it precisely and ideally to run experiments around it so again we're not
  102. just going to take conventional wisdom we're not going to take you know um something that written by someone who
  103. used to run some teams we're going to actually collect some data and run some experiments and figure ask these
  104. questions and figure them out let's push a little bit further on the diversity uh aspect uh as you know
  105. there's been a lot of some controversial news as well about uh say women and high
  106. technology companies for example uh has people analytics come come up with any evidence that shows uh you know how
  107. gender roles and uh even racial roles are are related to Performance I just wish we had someone who' done some
  108. writing on some gender issues if only somebody don't look at me um sh Sandberg is the
  109. brains behind that operation um I uh I I've learned a ton from working with with Cheryl on gender issues and um she
  110. is a a wonderful researcher Maryann Cooper at Stanford who's um who's collaborated with us on on looking
  111. through what did what did the data really show and I think the probably the the thing that I would say right now is
  112. um there's a lot of academic research that hasn't been leveraged um so we we know a lot about how to design for
  113. example Performance evaluations that actually lead people to judge contributions as opposed to the person
  114. behind them um we know a lot about how to attract more female applicants in the high-tech world for example um turns out
  115. the recruiter that comes and shows up matters a lot um our own Matthew Bidwell here at Wharton has shown this in the
  116. finance realm that one of the reasons there are so few women in finance is that they don't apply um at very high
  117. rates um they actually have a slightly higher odds of getting hired because um Financial Services organizations are
  118. really trying to solve this gender problem and bring in more women but where they they start to get discouraged
  119. is when a bunch of Partners show up who are all men to recruit they say well I'm
  120. never going to get this job why bother trying and I I just think there's a there's a pretty big gap between what
  121. the social science shows on gender and what most organizations are actually doing um it's great to see the Facebooks
  122. and Googles of the world really trying to make Headway on this um we've also seen I think a growing number of
  123. consulting firms um make gender a big priority and their people Analytics work so I know this is a big topic McKenzie
  124. is working on right now um Mercer has a whole initiative about how to create a gender balanced Workforce uh that's
  125. completely data driven and I think that's only going to grow in the next few years broadly how about um
  126. performance evaluations and compensation issues what does uh people analytics have to say about these issues more
  127. broadly so I mean one we should be a little careful about realize we're saying people land LS this and people
  128. land LS this I mean it's it's it's you know it's not a terrifically well- defined space it's mainly just bringing
  129. data where data hasn't been used in before and in kind of a Moneyball spirit it's not taking conventional wisdom
  130. we're going to be evidence-based here kind of regardless so um there there is there is an intersection though with
  131. some Fields like psychology and and the biases that people bring so one of the one of the real motivating factors for
  132. for us because of the worlds we come out of is we can actually improve decision-
  133. making by using these tools and performance evaluation is a classic example because there have been so many
  134. biases that show up in performance evaluation so um PE it's it's giving people analytics maybe too much credit
  135. because it's really just a vehicle to bring in some psychology we've known about for decades but because we're
  136. being more rigorous and trying to and focusing more on how we can improve this process um we're able to far it out some
  137. of those biases so um in in many many many different ways so um trying to keep opinions for example independent so you
  138. don't want people to judge I don't want to judge judge Adam after having had heard you judge Adam we try to get the
  139. opinions independent like that we want to judge as much as possible blind so we don't bring um information about a
  140. person to the table that isn't relevant because we know for a fact from Decades of research that if we know things about
  141. them it's impossible for us to to separate that so I think people in has just kind of help that cause we can't
  142. give them too much credit because we've kind of known it but um it's been a great vehicle to to ride and I think um
  143. Kate actually just touched on something that brings us full circle which is we we talked about the important role
  144. Google has played and and really stimulating interest in this field but I think Moneyball and the way that that
  145. Sports analytics has has taken off was probably the other Catalyst and and Kade was on the the front lines of that at
  146. least what over a decade ago before I even knew it existed yeah we we sport the sports professional sports has been
  147. ahead of um almost the entire non-sports world in using these tools because their
  148. whole existence is the performance of these individuals and they've got better data um they can see inputs they can see
  149. outputs precisely and so you can you can often look at what's going on in sports
  150. around analytics now and know that 10 years from now those tools are going to trickle down and even just the rigor and
  151. the scientific orientation of the people who use the numbers are better literally
  152. because the guys who crunched numbers for baseball um 20 years ago were figuring things out so Google has come
  153. up a couple of times in this conversation are there any other companies uh or organiz ganizations in
  154. uh that that you have been impressed by the work they're doing in this area and what other companies can learn from
  155. their experience well as soon as we open that box we got a lot a long list to go
  156. down um you know across Industries and AD Adam has been very active lately with a lot of these firms but I want to start
  157. out by saying there have been some firms who have focused on this for a long time
  158. so like Delo and touch has had an analytics a Workforce analytics practice for a long time um some of the new folks
  159. in uh in the financial services have been Goldman Sachs has take undertaken a big initiative over the last couple of
  160. years um crit credit Swiss has been very interested with some full-time people but it now it's gotten now we have to
  161. like really talked about everybody Johnson and Johnson is involved Adam's got a longer list I'm sure no I I'll
  162. just add a few you know from from other Industries um Teach for America particularly on their their selection uh
  163. or what they call Admissions um domain I mean they they've been tracking for years what do they need to assess in the
  164. hiring process to figure out who's going to be a star teacher and who's going to
  165. stick with us um Jet Blue has actually made a lot of Headway in this area as well um they're doing work in several
  166. different domains one of my favorites is recognition so how do you actually build
  167. a science of of recognition so that you know when it's important to give people a sense of gratitude and appreciation um
  168. do you make recognition public do you make it individual um there are all sorts of questions that the managers
  169. have have basically answered on intuition for years that now you know the airline industry when there's so
  170. many customer appreciation events that happen every day um is really sort of opening our eyes to how do you do this
  171. more effectively the Teach for America uh is such a great example because you you know as we're talking about Google
  172. and Goldman you wouldn't think necessarily go to the not for-profit world but they are the best we know on
  173. the hiring I think I I was just talking about this at lunch actually that if if I could name one firm that knows the
  174. most about their hiring practices it'd be those guys now they're kind of ideally suited for it because they see
  175. 50 or 60,000 applications for kind of the same job and so it's this perfect stream to get good at but we have
  176. learned I can tell you the Wharton um NBA admissions group has learned and improved their processes because of the
  177. way Teach for America hires people absolutely they they've got a lot to teach a lot of people so what's the
  178. secret ingredient of how do you how do you choose the best people to hire you know you know what it is to recognize
  179. that you're never right and that you're never going to be done those are the two
  180. unbelievable what Teach for America does they say they say you know we say all the time we're never going to be done
  181. this is not a one-time project it's not a one-year project we're never going to be done and the other thing they say
  182. which is amazing is they say you know these are our metrics these are our objectives we know they're not right we
  183. know they're wrong and that leads to an a continuous conversation about okay how
  184. can we refine them what exactly in what way are they wrong and how can we how can we tweak them but they say we know
  185. we know we're wrong that kind of humility is a great um counterbalance to analytics because you can get pretty uh
  186. pretty confident about your model you can get kind of in love with your model you need the humility that says we're
  187. wrong we know we're wrong humility is a good thing overall it is and I I think actually it's part of the founding of of
  188. the evidence-based Management Field that I think people analytics probably belongs to um Jeff Feer and Bob Sutton
  189. have have long said that if you want to do analytics right you need an attitude of wisdom which is in their definition
  190. basically the willingness to act on the best information you have while constantly doubting what you know and
  191. it's it's easy as Kade points out to lose sight of of the doubt part um I would say though there's there's one
  192. other thing from the hiring um perspective that that's been very eye- openening to me which is there a bunch
  193. of data by Rick Jacob and his colleagues suggesting that the costs of a bad hire
  194. are usually about triple the benefits of a good hire and I think a lot of selection is actually more about
  195. screening out um than it is screening in um you're always going to have um you know false positives and false negatives
  196. um but it's it's much more risky to to bring in somebody that than you have to go and replace or do a bunch of cultural
  197. damage repair um and that's I think where probably you want to put more of the emphasis now as if I were to sort of
  198. switch gears and turn to the two of you as researchers uh what are some of the big questions that you are trying to
  199. answer and what has surprised you most about what you learned so far um one of the things that I'm
  200. working on right now is how to is exactly on this stuff is how to get people to be more open to um analytics
  201. so explicitly so in some in some task we need to forecast what's going to happen
  202. it's a market or Price or the performance of an employee and you might have some algorithm and you might have a
  203. good algorithm and in most cases you need to blend that algorithm with some expert judgment it's not person or
  204. computer it's best if you can blend these things and yet people are reluctant to take input from computers
  205. especially the more expert you are in the field the more like you know no I need to use my you know my head as
  206. opposed to that so we're trying to understand the psychology about what what leads people to resist those um
  207. inputs and what can we do to help break that down one of the things that that I've gotten increasingly interested in
  208. is um the the problem of of collaboration creep so to speak where we're constantly having to go to
  209. meetings and answer emails and there's just massive explosion in interdependence and nobody knows how to
  210. handle it everybody thinks collaboration is great uh but everybody is overwhelmed
  211. with the amount of collaboration that they do um so I'm working on a project with Rob cross and Reb Reb right now
  212. that that looks at uh the following question if you do a network analysis of an organization and you ask people who
  213. do you depend on for critical knowledge and advice and expertise um what Rob finds is there's a certain number of
  214. people that can write your name down um and after that number you're at serious risk for Burnout and overload and I
  215. think that of course the unanswered question is exactly where does that number fall um but it it turns out to
  216. actually be quite deadly uh to have everyone depending upon you for expertise um and I'm interested in how
  217. do you redistribute um you know the help um the Insight the connections uh so that it's not all bottleneck in one or
  218. two people right that's that's really interesting and one final question if you were to look at people analytics and
  219. the state of knowledge of the field today where are the biggest knowledge gaps and and what should be done to fill
  220. them um this I would say in in in in being effective not just running better numbers but actually making change in
  221. organization so it's it's one thing to have a fancy regression model or to really have some insight numerically
  222. it's a very different thing to actually translate that into action and um it kind of doesn't matter how good your
  223. model is until you get good at that translation and um it's kind of natural that's going to come later but right now
  224. everyone's enamored with the models and the data and the analysis and it's not going to matter unless they can actually
  225. persuade and change an organization I I think from my perspective the probably the biggest
  226. unanswered question for people analytics uh is what Cade's working on right now which is why don't more organizations do
  227. this and how can you get senior leaders to realize that just because sometimes you know these these variables are hard
  228. to measure doesn't mean you shouldn't bring better science to them and what does it take to to open the minds of
  229. leaders to to recognizing that if we had more data it won't replace our jobs will
  230. actually give us the tools we need to make better judgments great okay Adam thanks so much
  231. for speaking with knowledge at Wharton and good luck with the conference thank you appreciate
  232. it [Music]

Brief Summary

Adam GR and Kade Massie discuss the growing importance of people analytics in hiring, onboarding, and team dynamics.

Key points

  • Google's Influence. Google's pioneering work in people analytics has inspired other organizations to follow suit.
  • The Rise of People Analytics. Interest in people analytics has surged, with organizations recognizing its importance.
  • Onboarding Insights. Meeting your manager on the first day is crucial for new hires' success.
  • Hiring Practices. Teach for America excels in understanding effective hiring practices.
  • Teach for America's Hiring Secrets. Teach for America emphasizes humility and continuous improvement in their hiring processes.
  • The Cost of Bad Hires. Research shows that the costs of a bad hire can be triple that of a good one.

Episode highlights

Tension

40/ 100Low tension

Related episodes