Digital and Mobile Commerce
Loading...
Paper Number
1043
Paper Type
Completed
Description
Observing the organically evolving Facebook advertising marketplace, this paper sets out to study how the adoption of randomized control trials (RCTs) for policy evaluation impacts firms’ behavior and performance on the platform. Findings indicate strong positive effects from the adoption of RCTs: After or in coincidence with RCT adoption, firms increase their investment in demand generation, at stable or higher levels of performance, as measured by customer purchases achieved per advertising dollar spent. A human expert provided to firms by the platform is also able to induce increases in investment but smaller ones, and, importantly, performance gains appear to exclusively materialize after the adoption of RCTs for policy evaluation, and not through human expertise alone. By means of the unbiased causal estimates obtained through RCTs, firms may be able to uniquely reduce their uncertainty about the environment and identify effective policies to exploit it with certainty.
Recommended Citation
Runge, Julian M R and Nair, Harikesh, "The Role of Randomized Control Trials in Online Demand Generation: Exploratory Evidence from Facebook" (2021). ICIS 2021 Proceedings. 1.
https://aisel.aisnet.org/icis2021/digital_commerce/digital_commerce/1
The Role of Randomized Control Trials in Online Demand Generation: Exploratory Evidence from Facebook
Observing the organically evolving Facebook advertising marketplace, this paper sets out to study how the adoption of randomized control trials (RCTs) for policy evaluation impacts firms’ behavior and performance on the platform. Findings indicate strong positive effects from the adoption of RCTs: After or in coincidence with RCT adoption, firms increase their investment in demand generation, at stable or higher levels of performance, as measured by customer purchases achieved per advertising dollar spent. A human expert provided to firms by the platform is also able to induce increases in investment but smaller ones, and, importantly, performance gains appear to exclusively materialize after the adoption of RCTs for policy evaluation, and not through human expertise alone. By means of the unbiased causal estimates obtained through RCTs, firms may be able to uniquely reduce their uncertainty about the environment and identify effective policies to exploit it with certainty.
When commenting on articles, please be friendly, welcoming, respectful and abide by the AIS eLibrary Discussion Thread Code of Conduct posted here.
Comments
22-Digital