How Data Mining Can Help Advertisers Hit Their Targets
Ask about Knowledge at Wharton
Episode Description
New research from Wharton senior fellow Shawndra Hill looks at how “second screening” impacts consumer response to TV ads. More: http://knlg.net/2kz8i01 📂 Marketing 🏷️ Research
Read the full transcriptHide the full transcript
- we're here today with Wharton senior fellow Chandra Hill to talk about her new research which focuses on TV ads
- online search and the connections between them Chandra thank you for being here today
- thank you for having me first of all could you give us a short description of what you looked at in this research
- absolutely so what we aim to achieve is to find new ways to measure tv-out effectiveness so let me take a step back
- and kind of talk a little bit about how people typically measure effectiveness large brand advertisers will usually ask
- another company to survey consumers and ask them questions like did you see the ad would you like to recommend the
- product that was advertised to your friends how did you feel about the ad so questions about their attitudes they
- might also look at sales data and correlate that with the amount of spent that they've made what we hope to do is
- look at more granular data that reveals itself in the searches people post on large search engines and so what we're
- hoping to do or have done is link TV ad data at an aggregate level where they you know can tell us precisely which
- television show what time which locations an ad was shown and then we look at search data around that TV ad
- before and after to see whether there was an impact on the search behavior and what we're actually trying to do is look
- at the ability to coordinate advertising efforts so not just on television but also on digital platforms like sponsored
- search so what we do is combine data from TV ads so the location of those ads so where they were shown not just the
- location in terms of geography but also which shows they were shown in and then we link that to the search data not just
- the searches but also conditioned on somebody making a search did they click on a sponsored search ad or not and we
- combine data from all of these sources to make causal claims about the impact of TV ads on digital behaviors towards
- measuring the effectiveness of TV ads so this features kind of capitalizes on a phenomenon that's going on then that
- last couple years called second screaming in that no longer do we watch TV and just look at the TV but often
- we're sitting on the couch looking at the TV and then also scrolling through our phones the whole
- time so tell me like when you looked at this a little more closely what were some of the key takeaways that you found
- um so first of all that's a great observation and I should probably take a step back and tell you the research
- questions that we were interested in so the number one research question we're interested in is just that like how does
- behaviors in response to TV ad manifest themselves via these second screens and what we found was that the response that
- we were seeing so we do in fact see that there's an increase in search behavior after a TV ad is shown but that's
- manifesting itself primarily on smartphones so the smaller device the more likely someone is to respond
- directly after a TV ad digitally and we also were interested in because we have very granular level search data not just
- in you know whether people are searching more but as I mentioned this interaction
- with the sponsored search ads and then finally we wanted to look at how the TV ads impacted different users in various
- ways so for instance we're interested in heterogeneous effects on demographics so
- age and gender so do certain genders respond differently to a particular creative that's shown in a particular
- television show similarly we looked at device and that's how we were able to discern that the
- response was coming primarily from the mobile phone so what were some of the findings that were most surprising to
- you I know one thing that I kind of stood out to me is this idea that you found that really when people are when
- this increase in searching on your phone is going on it's basically only amounts
- to about three minutes that's right so you hit the nail on the head in terms of that three surprising I mean well the
- surprising findings so there were two that I think are obvious in hindsight but we didn't necessarily anticipate so
- the first one was one that we already talked about by disaggregating the data and looking at different cohorts of
- people searching from smart phones versus tablets versus PCs we were able to see that the significant effect in
- terms of the bounce and searches after TV ad was happening only on mobile phone right so that's the first thing that was
- surprising to us although in hindsight it makes sense right if you're sitting in front of the television you're not
- going to bring your desktop - you know probably watch a television right and then the second one was because we're
- looking at very fine-grained windows so really for the first time are we doing this sort of granular response to TV ads
- minute by minute we were able to see the dynamic change in how people search after TV ad and as you mentioned we
- found that really we're seeing it either in the first second or third minute after the TV on and at first were like
- wow we expected this thing to sort of slow down but maybe tell off and the reason is we suspect is that TV ad
- segments are almost always exactly three minutes and so people are probably switching their attention back to the
- television show after the TV and TV ads are aired so if I am an advertiser you're looking at you have this three
- minute window people are on their phones they're looking at these ads what can i
- what can I do with this information how can I use this and maybe synchronize first of all are people even
- synchronizing now with in this way like trying to make sure if someone sees an ad on TV they may also see it on mobile
- and if not what can I do to kind of capitalize on this information that you find right so the implications of our
- work I think are many right so the first one is that because we're finding that the search response to television ads is
- manifesting itself primarily on mobile phones and from prior research not ours we know that people are more likely to
- click on the first ad only on a mobile phone when compared to say a PC or desktop and that's primarily because of
- the footprint right so you only see the first ad so what that suggests is if people really are moving to mobile phone
- when they're watching television that if you're an advertiser and you really want
- to keep their attention you should spend the money to make sure you're the first
- ad that shows up for the advertiser so that's the first one but then I think the work has even broader implications
- so because we can see who is responding right so let's just say let's take two examples let's say you have only one ad
- creative like one TV ad one commercial and you want to know sort of for this let's
- say it's a new product who's responding you can launch that TV on and basically you know look at the response in the way
- that we have and see which types of customers are responding and we're like which geographies are responding and
- that can help you sort of optimize your other your other advertising efforts to do more here or less there depending
- upon what you find the other example I wanted to point out is if instead you have many ad creatives you don't know in
- advance like maybe you've done some focus test and you know which one small groups like but you don't know in
- advance what the broader audience will respond best to you can launch all four of those or however many ads and see who
- is responding the best and then you know adjust how you present those ads over time so what this approach allows for is
- to do near real time optimization of ads with very aggregate level data now you asked a question of like what are people
- doing now right so for the most part people are measuring advertising effectiveness in the ways that I
- mentioned when we first started so asking you know people via surveys did they see the ad or looking at sales data
- but the future is quite different in that now there are solutions for TV networks and and even sort of solutions
- that sit outside of TV networks that allow people to buy advertisement programmatically so right now we're not
- all the way there so there's gonna be programmatic buys that more advertisers will do as well as something called
- addressable TV where people can actually advertise to individual households that
- they know information right so if you could do that then looking at this aggregate level data kind of is
- unnecessary but until we get there this way is a good way to begin to optimize campaigns this sort of is a beginning of
- saying that my Pretty Little Liars crowd is maybe a little different than my scandal crowd which is maybe different
- than my Monday Night Football exactly now speaking of that what were there some interesting things that you found
- in terms of demographic differences and how people reacted to this we did and that was one thing that we thought would
- be interested to advertisers so because you can see who's responding with respect to
- we looked at really just age and gender but still that's enough to give an advertiser insights we could match the
- demographics of the TV show for instance if you look at sporting events those tend to skew male and then ask when an
- advertisement is shown in a sporting event who what audience members are most likely to respond and we found perhaps
- obviously in hindsight that when a TV ad is shown in a sporting event men are much more likely to respond to it then
- when an ad is shown in a sporting event women really don't respond more than they would otherwise so the idea is
- maybe that your ads the the audience you might want to go after with these ads are the people that are already watching
- anyway which I assume they know but then also that it transfers over to online searches as well that's right and so and
- you can just check right so two things right so one you can check that the people that you're targeting are
- actually the ones responding so that's kind of like a validity check that your strategy is a good one
- but then in addition to that if you have two types of shows that let's just say men because we use that example are
- likely to watch you can compare and see like which type of show when an ad is placed in it are men most likely to
- respond to that ad because there could be all kinds of things going on perhaps in some shows people are more engaged
- with the show and are less likely to turn away from the commercials for instance or you know get up and maybe
- they're a longer show and they get up and do other things so you can look at the match between the type of show and
- the audience that's responding and it has two implications now just this research play into also the idea that
- more and more people are maybe turning away from broadcast TV and going more towards streaming for example because I
- mean I know when I watch Hulu for example because I have the kind where you do get ads with it is that it's
- asking me do I want the experience of this or do I want here or do I want to learn about do I want to travel video
- about California or do I want something about a cleaner I mean can this also be applied to other like be on broadcast TV
- so it can be applied to other advertising strategies where you have a specific time stamp associated
- with the event so that could be you know sort of placing a billboard in a particular location and then taking it
- away it could be a you have a radio advertisement and it has a certain time so the type of methodology that we
- actually advocate for is one that allows us to tease out the causality between an
- event that has a specific time and behavior that happens you know after that event by comparing it not only to
- what happened before but also to some control group that we come up with but so any event based advertising it would
- work but to answer your question about Hulu and let's say Netflix those those solutions for sort of media consumption
- or a little bit different in that they know who you are right like they have your information so what they can do is
- closer to the addressable television example that I mentioned earlier where people can sort of now advertise
- directly to individual household so companies like Hulu and Netflix have the ability already to do sort of one-to-one
- advertising and they can use your your behavior either on their own site or by matching their data with third parties
- to target to you directly now what is their guess what sets this research apart from other research
- that's been conducted on this topic so there are a few things that set it apart right so the one thing is the
- granularity of the data so because of the scale of the data we were able to look at minute by minute response by
- different locations so that's one thing the second thing is that for these searchers we also have as I mentioned
- demographics very crude high level demographics but we were able to then look at these heterogeneous treatment
- effects at four demographics and then also by device type which no one's done before and then finally this combination
- between not just looking at search response but looking at the clicks so conditioned on a search looking at the
- sponsored ad clicks is something that's also novel so looking at how firms might
- begin to coordinate their advertising efforts something that hasn't yet been done
- before when looking at response to TV ads and what's next for this research I know you've done a lot with social TV in
- the past couple years but where were you gonna go with this next so there are a number of sort of obvious extensions so
- we want to well and we are have already started to bring in just organic search so we focused in the first paper on
- sponsored search and we can look at well you know when an organic search response
- actually is for the brands or not like does that make a difference in their likelihood to click after an ad and
- we're also looking at other types of digital responses not just search so we're looking at clicks on webpages
- associated with the brand and also looking at where people are coming in from when they make those clicks asking
- questions around which specific advertising platforms might be most effective right after a TV ad campaign
- and now after sort of those things that we're already working on what we plan to
- look at are assigning people to different categories so instead of thinking about it instead of assigning
- them to demographics like male or female we assign them to a place on the purchase funnel so are they ready to buy
- are they just seeking information are they doing comparison shopping and we want to know whether the TV ad is more
- or less effective depending upon where people are in that purchase funnel other things that we'd like to do but we'll
- you know need some convincing for a partner or we have used observational data techniques and we feel pretty
- strongly that our method for teasing out the causality the relation the causal relationship between the TV ads and the
- search response is pretty solid however what we'd really like to do is run an experiment while TV ads are running to
- make sure that what we're finding for this with the sponsored search results are it's really true that in fact there
- is the impact on sponsored search results that we're seeing and I guess the pie in the sky you know kind of
- future work would be to actually run experiments using addressable TV right so our work I think will last
- for quite a while because although addressable TV exists today they're not that many advertisers that have adopted
- right away but what we want to see again is whether these different combinations
- of advertising lead to sort of more or less spend more or less clicks more or less search for information and in using
- addressable TV solutions in combination with experiment on sponsored research you can get precisely at that answer
- Chandra thanks so much for being with us today thanks Rito you [Music]
Brief Summary
Chandra Hill discusses her research on TV ads' impact on online search behavior and the importance of mobile synchronization for advertisers.
Key points
- Three-Minute Search Spike. After a TV ad, search behavior spikes for about three minutes, primarily on smartphones.
- Impact of TV Ads on Digital Behavior. Chandra Hill reveals how TV ads primarily drive search behavior on mobile devices.
- Demographic Insights on Ad Responses. Research shows that men respond more to ads during sporting events than women.
Episode highlights
- Three-Minute Search SpikeAfter a TV ad, search behavior spikes for about three minutes, primarily on smartphones.“We found that the increase in searching on your phone lasts about three minutes.”4:00Mar 8, 2017
- Impact of TV Ads on Digital BehaviorChandra Hill reveals how TV ads primarily drive search behavior on mobile devices.“The response to TV ads is primarily on mobile phones.”5:50Mar 8, 2017
- Demographic Insights on Ad ResponsesResearch shows that men respond more to ads during sporting events than women.“When a TV ad is shown in a sporting event, men are much more likely to respond.”9:30Mar 8, 2017
Tension
45/ 100Some tension





