What's Behind the Surge of Interest in People Analytics?
Ask about Knowledge at Wharton
Episode Description
Can a data-driven approach to managing people at work help organizations make better HR decisions? Wharton professors Cade Massey and Adam Grant share their insights. More: http://knlg.net/1CAqeZO π Human Resources;Technology
Read the full transcriptHide the full transcript
- our guests today are Adam gr and Kade Massie who lead Barton's people analytics initiative gentlemen welcome
- to knowledge at Wharton thanks thanks for having us so Kate we when we spoke last year about people analytics that
- was just before your conference and you have another conference coming up uh and
- it seems to me that during this past year that interest in people analytics has really gone up why is people
- analytics so hot well I agree with you that it does seem to be blowing up a little bit um it started I feel like it
- started in technology more than any other industry and then Finance picked it up and now we see it kind of
- everywhere um my sense is that people appreciate that this is a very important function and yet hasn't been approached
- very in a very sophisticated way in the past and all of a sudden they realize you can use all these tools that we're
- accustomed to using in marketing or Finance we can use them for hiring people and compensating people and
- what's better than that given how how um important those things are to an organization so it's the it's the
- potential people seeing the potential of this that's making it popular Adam what
- are your thoughts on why it's becoming so popular yeah I I didn't even know it existed until Kate and I ended up
- working with Google about five years ago and they had built this whole people analytics team um that was a mix of
- traditional HR folks Consultants engineers and and folks like us who study organizational behavior and it was
- amazing that they were able to take questions that used to be answered based on intuition and actually run
- experiments and gather data to figure out what were the right choices to make and you know I think that Google's
- gotten a ton of press for all the great work they've done in this area and other
- leaders have started thinking why aren't we doing this shouldn't we be making all
- of our important decisions based on evidence too yeah should we just be giving glasa Bach credit here because
- he's been like an evangelist for this surprisingly he's been out there he's the head of HR at Google and he's always
- been very willing to say hey this is what we're doing this is what you should be doing kind of uncharacteristic for
- someone to say that essentially to his competitors so one of the things I find very interesting about people analytics
- is as as you said Alam how a lot of decisions HR decisions that used to be based on intuition are now sort of
- migrating over into datadriven decisions can you give me some examples of say if
- you take hiring as the first uh point of Engagement between a company and an employee how is hiring changing because
- of people analytics so uh people are very interested now and can we can we identify from objective measures who's
- going to work well in our firm so rather than having to bring them in here and talk to them in person can we grab you
- know their their GPA in college and where they went to school and who they worked for and predict somehow from
- these inputs how they're going to be if you could that'd be great right because you save a lot of time you can process
- all these information all these applications real efficiently so that's pretty promising at least that has a lot
- of appeal now there's more appeal to to it than substance right now because it's
- really hard to do but there that would be great if you can pull it off and it would it would it would be great
- um any investment you can make in making that happen is going to have high returns but it's still new so there's no
- there there's no silver bullets um but people are drawn to it because it could be great if it happens So based on the
- evidence does it matter where you went to school wow this is like a question that
- people with high school age kids are forever asking right they're like does it matter if they go to Princeton versus
- the state school what do is there good evidence of that I don't know there's good evidence on that right now I mean I
- I think it's a debate that continues to rage um but my my favorite research on this uh is Caroline Hawkes and if I
- remember correctly what she shows is that it's mostly selection effect so that if you you know if you come out of
- an Ivy League school um you typically will end up with a higher income and more job opportunities uh but all of the
- characteristics that led you there were visible before University chose you and it was essentially you know bringing in
- an ambitious and talented group of students to begin with as opposed to something magical that happened in your
- four years um that being said um we like to think that we're doing something of use ex magical happens here at Wharton
- NBA magical happens um but you know that the what I what I like to say is that probably Great Schools provide an
- advantage through the Network that people get to know maybe through the training but there's it's kind of like
- stereotypes there there may be true differences in social categories between people but people believe these
- differences are bigger than they actually are and there's huge variation within the category so there's huge
- variation in outcomes from people who come and go to pen and there's huge variations and outcomes from people who
- go to pen State and there's a lot more overlap between these two things than people think got so so so let's say the
- hiring step is over and now you on to this uh next step of onboarding people what can uh people analytics do to
- improve the onboarding process so you know we need to be careful not just you know uh law Google at every turn but
- they are an organization that has looked at this explicitly and they did it in the best possible way they ran
- experiments on let's on board in this way and then manipulate in a different group in a different way to see what
- actually makes a difference so it's not just telling stories we're actually doing science here to figure out what
- makes the most difference and I I don't I don't know all the details the study this is something they've been doing for
- the last couple of years but they recognized the onboarding process as kind of really important and completely
- underexplored so they went out and ran and and uh and experiment do you remember the details of this there
- there's one finding that jumps out at me which is um when they they looked at all
- the things that make a difference in the first few days or first few weeks of your time at Google um probably the most
- critical thing to happen is just that you meet your manager on day one and people are busy right um You may have a
- lot of direct reports um and maybe also as a new hire that you're being sent to a lot of different places um but based
- on that evidence they they said look one of one of our rules for onboarding is you've got to meet your manager on day
- one um and that's such a critical part of building a bond between an employee and an employer um it's not to say that
- we didn't know it was important for you to meet your manager but I think all of us right myself included really
- underestimated how much of an effect that would have on day one and so I think that's that's an example of the
- kind of thing we've learned from their work something else I talk about a little bit that seems wise is that a
- person's success at a company often depends heavily on who they work for and yet who they work for is essentially
- completely outside their control and so this isn't exactly on boarding but it is
- early career early stage consideration if things aren't working out you need to be wise about it and not just blame that
- person and you probably want to see that person in more than one circumstance before you draw a too strong a
- conclusion about this is just they're both examples of being more systematic and scientific about evaluating your
- employees or trying to train your employees as opposed to the old school kind of would do this because this is
- what we've always done got it so what once you start working in the company increasingly we find that uh more and
- more of us are working in teams uh and teams are very often geographically dispersed very often across different
- countries uh but also across Generations so you have Baby Boomers and Millennials
- sort of having to figure out how to work together what can we learn through people analytics about the creation and
- construction of high performance teams MH mhm so um an infinite number of things and this is such a rich area and
- Adam I'm sure has his favorite examples one of the ones that I first think about
- is recent work by Chris shabri and his colleagues on um Team IQ essentially and they do some really interesting stuff
- that looks at the productivity of teams um as a function of their individual characteristics versus what they do
- collectively and he finds that there is something they seem to find something like team IQ that is different from the
- some of the parts it's not that if you put all the smart people together that they produce the smartest work it's that
- they need to be people who understand how to work with each other and work as a part of a team there's something
- unique about Team level intelligence that's different from the sum of the individual level
- intelligence and I I think to build on that there are probably ways that you can compose a team to enhance the
- likelihood right that that they'll be intelligent as a group so one of the things I hear a lot is that diversity is
- good and there's no question that we get a lot of value from diversity in terms of people bringing unique perspectives
- thoughts skills to the table but when you look at personality research there are some characteristics on which it's
- actually helpful to have similarity as opposed to variety so um if you look at the the data extroversion introversion
- is the clearest trait where variety is useful um your team of whole extroverts essentially never starts working on the
- task team of all introverts um often forget to bond and the data say that the most effective teams have a mix of the
- two but don't necessarily stretch that into every other personality trait if you look at a personality trait like
- agreeableness for example people who love social harmony one of the worst things you can do is put them on a team
- with people who are extremely critical and skeptical um because the disagreeable people are feeling like
- they have to walk on eggshells constantly meanwhile the poor agreeable people they have this this catch22 of I
- can be really agreeable and act disagreeable like the disagreeable people and then hate myself afterward or
- you know I can be really agreeable and then you know it doesn't doesn't quite gel and so there it's actually helpful
- to have either similarity in personality or a consistent Norm of how we're going
- to interact and so I think we have to be really more thoughtful about composition
- than we have been have been in the past probably and one of the things that people analytics brings to that task in
- general is just the inclination to study it precisely and ideally to run experiments around it so again we're not
- just going to take conventional wisdom we're not going to take you know um something that written by someone who
- used to run some teams we're going to actually collect some data and run some experiments and figure ask these
- questions and figure them out let's push a little bit further on the diversity uh aspect uh as you know
- there's been a lot of some controversial news as well about uh say women and high
- technology companies for example uh has people analytics come come up with any evidence that shows uh you know how
- gender roles and uh even racial roles are are related to Performance I just wish we had someone who' done some
- writing on some gender issues if only somebody don't look at me um sh Sandberg is the
- brains behind that operation um I uh I I've learned a ton from working with with Cheryl on gender issues and um she
- is a a wonderful researcher Maryann Cooper at Stanford who's um who's collaborated with us on on looking
- through what did what did the data really show and I think the probably the the thing that I would say right now is
- um there's a lot of academic research that hasn't been leveraged um so we we know a lot about how to design for
- example Performance evaluations that actually lead people to judge contributions as opposed to the person
- behind them um we know a lot about how to attract more female applicants in the high-tech world for example um turns out
- the recruiter that comes and shows up matters a lot um our own Matthew Bidwell here at Wharton has shown this in the
- finance realm that one of the reasons there are so few women in finance is that they don't apply um at very high
- rates um they actually have a slightly higher odds of getting hired because um Financial Services organizations are
- really trying to solve this gender problem and bring in more women but where they they start to get discouraged
- is when a bunch of Partners show up who are all men to recruit they say well I'm
- never going to get this job why bother trying and I I just think there's a there's a pretty big gap between what
- the social science shows on gender and what most organizations are actually doing um it's great to see the Facebooks
- and Googles of the world really trying to make Headway on this um we've also seen I think a growing number of
- consulting firms um make gender a big priority and their people Analytics work so I know this is a big topic McKenzie
- is working on right now um Mercer has a whole initiative about how to create a gender balanced Workforce uh that's
- completely data driven and I think that's only going to grow in the next few years broadly how about um
- performance evaluations and compensation issues what does uh people analytics have to say about these issues more
- broadly so I mean one we should be a little careful about realize we're saying people land LS this and people
- land LS this I mean it's it's it's you know it's not a terrifically well- defined space it's mainly just bringing
- data where data hasn't been used in before and in kind of a Moneyball spirit it's not taking conventional wisdom
- we're going to be evidence-based here kind of regardless so um there there is there is an intersection though with
- some Fields like psychology and and the biases that people bring so one of the one of the real motivating factors for
- for us because of the worlds we come out of is we can actually improve decision-
- making by using these tools and performance evaluation is a classic example because there have been so many
- biases that show up in performance evaluation so um PE it's it's giving people analytics maybe too much credit
- because it's really just a vehicle to bring in some psychology we've known about for decades but because we're
- being more rigorous and trying to and focusing more on how we can improve this process um we're able to far it out some
- of those biases so um in in many many many different ways so um trying to keep opinions for example independent so you
- don't want people to judge I don't want to judge judge Adam after having had heard you judge Adam we try to get the
- opinions independent like that we want to judge as much as possible blind so we don't bring um information about a
- person to the table that isn't relevant because we know for a fact from Decades of research that if we know things about
- them it's impossible for us to to separate that so I think people in has just kind of help that cause we can't
- give them too much credit because we've kind of known it but um it's been a great vehicle to to ride and I think um
- Kate actually just touched on something that brings us full circle which is we we talked about the important role
- Google has played and and really stimulating interest in this field but I think Moneyball and the way that that
- Sports analytics has has taken off was probably the other Catalyst and and Kade was on the the front lines of that at
- least what over a decade ago before I even knew it existed yeah we we sport the sports professional sports has been
- ahead of um almost the entire non-sports world in using these tools because their
- whole existence is the performance of these individuals and they've got better data um they can see inputs they can see
- outputs precisely and so you can you can often look at what's going on in sports
- around analytics now and know that 10 years from now those tools are going to trickle down and even just the rigor and
- the scientific orientation of the people who use the numbers are better literally
- because the guys who crunched numbers for baseball um 20 years ago were figuring things out so Google has come
- up a couple of times in this conversation are there any other companies uh or organiz ganizations in
- uh that that you have been impressed by the work they're doing in this area and what other companies can learn from
- their experience well as soon as we open that box we got a lot a long list to go
- down um you know across Industries and AD Adam has been very active lately with a lot of these firms but I want to start
- out by saying there have been some firms who have focused on this for a long time
- so like Delo and touch has had an analytics a Workforce analytics practice for a long time um some of the new folks
- in uh in the financial services have been Goldman Sachs has take undertaken a big initiative over the last couple of
- years um crit credit Swiss has been very interested with some full-time people but it now it's gotten now we have to
- like really talked about everybody Johnson and Johnson is involved Adam's got a longer list I'm sure no I I'll
- just add a few you know from from other Industries um Teach for America particularly on their their selection uh
- or what they call Admissions um domain I mean they they've been tracking for years what do they need to assess in the
- hiring process to figure out who's going to be a star teacher and who's going to
- stick with us um Jet Blue has actually made a lot of Headway in this area as well um they're doing work in several
- different domains one of my favorites is recognition so how do you actually build
- a science of of recognition so that you know when it's important to give people a sense of gratitude and appreciation um
- do you make recognition public do you make it individual um there are all sorts of questions that the managers
- have have basically answered on intuition for years that now you know the airline industry when there's so
- many customer appreciation events that happen every day um is really sort of opening our eyes to how do you do this
- more effectively the Teach for America uh is such a great example because you you know as we're talking about Google
- and Goldman you wouldn't think necessarily go to the not for-profit world but they are the best we know on
- the hiring I think I I was just talking about this at lunch actually that if if I could name one firm that knows the
- most about their hiring practices it'd be those guys now they're kind of ideally suited for it because they see
- 50 or 60,000 applications for kind of the same job and so it's this perfect stream to get good at but we have
- learned I can tell you the Wharton um NBA admissions group has learned and improved their processes because of the
- way Teach for America hires people absolutely they they've got a lot to teach a lot of people so what's the
- secret ingredient of how do you how do you choose the best people to hire you know you know what it is to recognize
- that you're never right and that you're never going to be done those are the two
- unbelievable what Teach for America does they say they say you know we say all the time we're never going to be done
- this is not a one-time project it's not a one-year project we're never going to be done and the other thing they say
- which is amazing is they say you know these are our metrics these are our objectives we know they're not right we
- know they're wrong and that leads to an a continuous conversation about okay how
- can we refine them what exactly in what way are they wrong and how can we how can we tweak them but they say we know
- we know we're wrong that kind of humility is a great um counterbalance to analytics because you can get pretty uh
- pretty confident about your model you can get kind of in love with your model you need the humility that says we're
- wrong we know we're wrong humility is a good thing overall it is and I I think actually it's part of the founding of of
- the evidence-based Management Field that I think people analytics probably belongs to um Jeff Feer and Bob Sutton
- have have long said that if you want to do analytics right you need an attitude of wisdom which is in their definition
- basically the willingness to act on the best information you have while constantly doubting what you know and
- it's it's easy as Kade points out to lose sight of of the doubt part um I would say though there's there's one
- other thing from the hiring um perspective that that's been very eye- openening to me which is there a bunch
- of data by Rick Jacob and his colleagues suggesting that the costs of a bad hire
- are usually about triple the benefits of a good hire and I think a lot of selection is actually more about
- screening out um than it is screening in um you're always going to have um you know false positives and false negatives
- um but it's it's much more risky to to bring in somebody that than you have to go and replace or do a bunch of cultural
- damage repair um and that's I think where probably you want to put more of the emphasis now as if I were to sort of
- switch gears and turn to the two of you as researchers uh what are some of the big questions that you are trying to
- answer and what has surprised you most about what you learned so far um one of the things that I'm
- working on right now is how to is exactly on this stuff is how to get people to be more open to um analytics
- so explicitly so in some in some task we need to forecast what's going to happen
- it's a market or Price or the performance of an employee and you might have some algorithm and you might have a
- good algorithm and in most cases you need to blend that algorithm with some expert judgment it's not person or
- computer it's best if you can blend these things and yet people are reluctant to take input from computers
- especially the more expert you are in the field the more like you know no I need to use my you know my head as
- opposed to that so we're trying to understand the psychology about what what leads people to resist those um
- inputs and what can we do to help break that down one of the things that that I've gotten increasingly interested in
- is um the the problem of of collaboration creep so to speak where we're constantly having to go to
- meetings and answer emails and there's just massive explosion in interdependence and nobody knows how to
- handle it everybody thinks collaboration is great uh but everybody is overwhelmed
- with the amount of collaboration that they do um so I'm working on a project with Rob cross and Reb Reb right now
- that that looks at uh the following question if you do a network analysis of an organization and you ask people who
- do you depend on for critical knowledge and advice and expertise um what Rob finds is there's a certain number of
- people that can write your name down um and after that number you're at serious risk for Burnout and overload and I
- think that of course the unanswered question is exactly where does that number fall um but it it turns out to
- actually be quite deadly uh to have everyone depending upon you for expertise um and I'm interested in how
- do you redistribute um you know the help um the Insight the connections uh so that it's not all bottleneck in one or
- two people right that's that's really interesting and one final question if you were to look at people analytics and
- the state of knowledge of the field today where are the biggest knowledge gaps and and what should be done to fill
- them um this I would say in in in in being effective not just running better numbers but actually making change in
- organization so it's it's one thing to have a fancy regression model or to really have some insight numerically
- it's a very different thing to actually translate that into action and um it kind of doesn't matter how good your
- model is until you get good at that translation and um it's kind of natural that's going to come later but right now
- everyone's enamored with the models and the data and the analysis and it's not going to matter unless they can actually
- persuade and change an organization I I think from my perspective the probably the biggest
- unanswered question for people analytics uh is what Cade's working on right now which is why don't more organizations do
- this and how can you get senior leaders to realize that just because sometimes you know these these variables are hard
- to measure doesn't mean you shouldn't bring better science to them and what does it take to to open the minds of
- leaders to to recognizing that if we had more data it won't replace our jobs will
- actually give us the tools we need to make better judgments great okay Adam thanks so much
- for speaking with knowledge at Wharton and good luck with the conference thank you appreciate
- it [Music]
Brief Summary
Adam GR and Kade Massie discuss the growing importance of people analytics in hiring, onboarding, and team dynamics.
Key points
- Google's Influence. Google's pioneering work in people analytics has inspired other organizations to follow suit.
- The Rise of People Analytics. Interest in people analytics has surged, with organizations recognizing its importance.
- Onboarding Insights. Meeting your manager on the first day is crucial for new hires' success.
- Hiring Practices. Teach for America excels in understanding effective hiring practices.
- Teach for America's Hiring Secrets. Teach for America emphasizes humility and continuous improvement in their hiring processes.
- The Cost of Bad Hires. Research shows that the costs of a bad hire can be triple that of a good one.
Episode highlights
- Google's InfluenceGoogle's pioneering work in people analytics has inspired other organizations to follow suit.βIt started in technology more than any other industry.β0:34Apr 10, 2015
- The Rise of People AnalyticsInterest in people analytics has surged, with organizations recognizing its importance.βPeople appreciate that this is a very important function.β0:43Apr 10, 2015
- Onboarding InsightsMeeting your manager on the first day is crucial for new hires' success.βThe most critical thing is just that you meet your manager on day one.β5:48Apr 10, 2015
- Hiring PracticesTeach for America excels in understanding effective hiring practices.βIf I could name one firm that knows the most about their hiring practices, itβd be those guys.β16:45Apr 10, 2015
- Teach for America's Hiring SecretsTeach for America emphasizes humility and continuous improvement in their hiring processes.βWe know we're wrong; that kind of humility is a great counterbalance to analytics.β17:44Apr 10, 2015
- The Cost of Bad HiresResearch shows that the costs of a bad hire can be triple that of a good one.βThe costs of a bad hire are usually about triple the benefits of a good hire.β18:31Apr 10, 2015
- Collaboration CreepThe explosion of collaboration can lead to burnout and overload in organizations.βEveryone is overwhelmed with the amount of collaboration that they do.β20:13Apr 10, 2015
- Translating Data into ActionHaving great models is not enough; organizations must translate insights into action.βItβs not going to matter unless they can actually persuade and change an organization.β21:47Apr 10, 2015
Episode quotes
Tension
40/ 100Low tension





