Filter Results
:
(862)
Show Results For
-
All HBS Web
(3,656)
- Faculty Publications (862)
Show Results For
-
All HBS Web
(3,656)
- Faculty Publications (862)
Methods →
Page 1 of
862
Results
→
- March 2024
- Case
Ava DuVernay's Array: Disrupting the Hollywood Film Industry
By: Anita Elberse and Morgan Brewton-Johnson
In February 2023 acclaimed filmmaker Ava DuVernay is filming her latest movie, Origin, a daring adaptation of Isabel Wilkerson’s book Caste: The Origins of Our Discontents. With Origin, DuVernay is pioneering a method to finance the endeavor—through a combination of...
View Details
Elberse, Anita, and Morgan Brewton-Johnson. "Ava DuVernay's Array: Disrupting the Hollywood Film Industry." Harvard Business School Case 524-071, March 2024.
- 2023
- Working Paper
An Experimental Design for Anytime-Valid Causal Inference on Multi-Armed Bandits
By: Biyonka Liang and Iavor I. Bojinov
Typically, multi-armed bandit (MAB) experiments are analyzed at the end of the study and thus require the analyst to specify a fixed sample size in advance. However, in many online learning applications, it is advantageous to continuously produce inference on the...
View Details
Liang, Biyonka, and Iavor I. Bojinov. "An Experimental Design for Anytime-Valid Causal Inference on Multi-Armed Bandits." Harvard Business School Working Paper, No. 24-057, March 2024.
- 2024
- Working Paper
Anytime-Valid Inference in Linear Models and Regression-Adjusted Causal Inference
By: Michael Lindon, Dae Woong Ham, Martin Tingley and Iavor I. Bojinov
Linear regression adjustment is commonly used to analyze randomized controlled experiments due to its efficiency and robustness against model misspecification. Current testing and interval estimation procedures leverage the asymptotic distribution of such estimators to...
View Details
Lindon, Michael, Dae Woong Ham, Martin Tingley, and Iavor I. Bojinov. "Anytime-Valid Inference in Linear Models and Regression-Adjusted Causal Inference." Harvard Business School Working Paper, No. 24-060, March 2024.
- 2023
- Working Paper
Design-Based Inference for Multi-arm Bandits
By: Dae Woong Ham, Iavor I. Bojinov, Michael Lindon and Martin Tingley
Multi-arm bandits are gaining popularity as they enable real-world sequential decision-making across application areas, including clinical trials, recommender systems, and online decision-making. Consequently, there is an increased desire to use the available...
View Details
Ham, Dae Woong, Iavor I. Bojinov, Michael Lindon, and Martin Tingley. "Design-Based Inference for Multi-arm Bandits." Harvard Business School Working Paper, No. 24-056, March 2024.
- February 2024
- Article
Fifty Shades of QE: Robust Evidence
By: Brian Fabo, Marina Jančoková, Elisabeth Kempf and Ľuboš Pástor
Fabo et al. (2021) show that papers written by central bank researchers find quantitative easing (QE) to be more effective than papers written by academics. Weale and Wieladek (2022) show that a subset of these results lose statistical significance when OLS regressions...
View Details
Keywords:
Quantitative Easing;
Research;
Mathematical Methods;
Perception;
Banks and Banking;
Body of Literature
Fabo, Brian, Marina Jančoková, Elisabeth Kempf, and Ľuboš Pástor. "Fifty Shades of QE: Robust Evidence." Art. 107065. Journal of Banking & Finance 159 (February 2024).
- 2024
- Working Paper
Bootstrap Diagnostics for Irregular Estimators
By: Isaiah Andrews and Jesse M. Shapiro
Empirical researchers frequently rely on normal approximations in order to summarize and communicate uncertainty about their findings to their scientific audience. When such approximations are unreliable, they can lead the audience to make misguided decisions. We...
View Details
Andrews, Isaiah, and Jesse M. Shapiro. "Bootstrap Diagnostics for Irregular Estimators." NBER Working Paper Series, No. 32038, January 2024.
- January 2024
- Article
Subset Scanning for Multi-Trait Analysis Using GWAS Summary Statistics
By: Rui Cao, Evan Olawsky, Edward McFowland III, Erin Marcotte, Logan Spector and Tianzhong Yang
Multi-trait analysis has been shown to have greater statistical power than single-trait analysis. Most of the existing multi-trait analysis methods only work with a limited number of traits and usually prioritize high statistical power over identifying relevant traits,...
View Details
Cao, Rui, Evan Olawsky, Edward McFowland III, Erin Marcotte, Logan Spector, and Tianzhong Yang. "Subset Scanning for Multi-Trait Analysis Using GWAS Summary Statistics." Bioinformatics 40, no. 1 (January 2024).
- 2023
- Working Paper
Debiasing Treatment Effect Estimation for Privacy-Protected Data: A Model Auditing and Calibration Approach
By: Ta-Wei Huang and Eva Ascarza
Data-driven targeted interventions have become a powerful tool for organizations to optimize business outcomes
by utilizing individual-level data from experiments. A key element of this process is the estimation
of Conditional Average Treatment Effects (CATE), which...
View Details
Huang, Ta-Wei, and Eva Ascarza. "Debiasing Treatment Effect Estimation for Privacy-Protected Data: A Model Auditing and Calibration Approach." Harvard Business School Working Paper, No. 24-034, December 2023.
- 2023
- Working Paper
Estimating Productivity in the Presence of Spillovers: Firm-Level Evidence from the U.S. Production Network
By: Ebehi Iyoha
This paper examines the extent to which productivity gains are transmitted across U.S. firms through buyer-supplier relationships. Many empirical studies measure firm-to-firm spillovers using firm-level productivity estimates derived from control function approaches....
View Details
Iyoha, Ebehi. "Estimating Productivity in the Presence of Spillovers: Firm-Level Evidence from the U.S. Production Network." Harvard Business School Working Paper, No. 24-033, December 2023. (Winner of the Young Economists' Essay Award at the 2021 Annual Conference of the European Association for Research in Industrial Economics (EARIE))
- 2023
- Article
Balancing Risk and Reward: An Automated Phased Release Strategy
By: Yufan Li, Jialiang Mao and Iavor Bojinov
Phased releases are a common strategy in the technology industry for gradually releasing new products or updates through a sequence of A/B tests in which the number of treated units gradually grows until full deployment or deprecation. Performing phased releases in a...
View Details
Li, Yufan, Jialiang Mao, and Iavor Bojinov. "Balancing Risk and Reward: An Automated Phased Release Strategy." Advances in Neural Information Processing Systems (NeurIPS) (2023).
- 2023
- Article
Dynamic HTA for Digital Health Solutions: Opportunities and Challenges for Patient-Centered Evaluation
By: Jan B. Brönneke, Annika Herr, Simon Reif and Ariel D. Stern
Germany’s 2019 Digital Healthcare Act (Digitale-Versorgung-Gesetz, or DVG) created a number of opportunities for the digital transformation of the health care delivery system. Key among these was the creation of a reimbursement pathway for patient-centered digital...
View Details
Keywords:
Digital Transformation;
Applications and Software;
Product Development;
Insurance;
Policy;
Health Industry;
Germany
Brönneke, Jan B., Annika Herr, Simon Reif, and Ariel D. Stern. "Dynamic HTA for Digital Health Solutions: Opportunities and Challenges for Patient-Centered Evaluation." International Journal of Technology Assessment in Health Care 39, no. 1 (2023).
- 2023
- Article
M4: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities, and Models
By: Himabindu Lakkaraju, Xuhong Li, Mengnan Du, Jiamin Chen, Yekun Chai and Haoyi Xiong
While Explainable Artificial Intelligence (XAI) techniques have been widely studied to explain predictions made by deep neural networks, the way to evaluate the faithfulness of explanation results remains challenging, due to the heterogeneity of explanations for...
View Details
Keywords:
AI and Machine Learning
Lakkaraju, Himabindu, Xuhong Li, Mengnan Du, Jiamin Chen, Yekun Chai, and Haoyi Xiong. "M4: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities, and Models." Advances in Neural Information Processing Systems (NeurIPS) (2023).
- 2023
- Article
MoPe: Model Perturbation-based Privacy Attacks on Language Models
By: Marvin Li, Jason Wang, Jeffrey Wang and Seth Neel
Recent work has shown that Large Language Models (LLMs) can unintentionally leak sensitive information present in their training data. In this paper, we present Model Perturbations (MoPe), a new method to identify with high confidence if a given text is in the training...
View Details
Li, Marvin, Jason Wang, Jeffrey Wang, and Seth Neel. "MoPe: Model Perturbation-based Privacy Attacks on Language Models." Proceedings of the Conference on Empirical Methods in Natural Language Processing (2023): 13647–13660.
- 2023
- Article
Post Hoc Explanations of Language Models Can Improve Language Models
By: Satyapriya Krishna, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh and Himabindu Lakkaraju
Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex tasks. Moreover, recent research has shown that incorporating human-annotated rationales (e.g., Chain-of-Thought prompting) during in-context learning can significantly enhance...
View Details
Krishna, Satyapriya, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh, and Himabindu Lakkaraju. "Post Hoc Explanations of Language Models Can Improve Language Models." Advances in Neural Information Processing Systems (NeurIPS) (2023).
- 2023
- Other Article
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications
By: Mirac Suzgun, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers and Stuart Shieber
Innovation is a major driver of economic and social development, and information about many kinds of innovation is embedded in semi-structured data from patents and patent applications. Though the impact and novelty of innovations expressed in patent data are difficult...
View Details
Keywords:
USPTO;
Natural Language Processing;
Classification;
Summarization;
Patent Novelty;
Patent Trolls;
Patent Enforceability;
Patents;
Innovation and Invention;
Intellectual Property;
AI and Machine Learning;
Analytics and Data Science
Suzgun, Mirac, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers, and Stuart Shieber. "The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications." Conference on Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track 36 (2023).
- 2023
- Article
Verifiable Feature Attributions: A Bridge between Post Hoc Explainability and Inherent Interpretability
By: Usha Bhalla, Suraj Srinivas and Himabindu Lakkaraju
With the increased deployment of machine learning models in various real-world applications, researchers and practitioners alike have emphasized the need for explanations of model behaviour. To this end, two broad strategies have been outlined in prior literature to...
View Details
Bhalla, Usha, Suraj Srinivas, and Himabindu Lakkaraju. "Verifiable Feature Attributions: A Bridge between Post Hoc Explainability and Inherent Interpretability." Advances in Neural Information Processing Systems (NeurIPS) (2023).
- 2023
- Article
Which Models Have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness
By: Suraj Srinivas, Sebastian Bordt and Himabindu Lakkaraju
One of the remarkable properties of robust computer vision models is that their input-gradients are often aligned with human perception, referred to in the literature as perceptually-aligned gradients (PAGs). Despite only being trained for classification, PAGs cause...
View Details
Srinivas, Suraj, Sebastian Bordt, and Himabindu Lakkaraju. "Which Models Have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness." Advances in Neural Information Processing Systems (NeurIPS) (2023).
- Working Paper
An AI Method to Score Celebrity Visual Potential from Human Faces
By: Flora Feng, Shunyuan Zhang, Xiao Liu, Kannan Srinivasan and Cait Lamberton
Celebrities have extraordinary abilities to attract and influence others. Predicting celebrity visual potential is important in the domains of business, politics, media, and entertainment. Can we use human faces to predict celebrity visual potential? If so, which...
View Details
Feng, Flora, Shunyuan Zhang, Xiao Liu, Kannan Srinivasan, and Cait Lamberton. "An AI Method to Score Celebrity Visual Potential from Human Faces." SSRN Working Paper Series, No. 4071188, November 2023.
- November–December 2023
- Article
Iterative Coordination and Innovation: Prioritizing Value over Novelty
By: Sourobh Ghosh and Andy Wu
An innovating organization faces the challenge of how to prioritize distinct goals of novelty and value, both of which underlie innovation. Popular practitioner frameworks like Agile management suggest that organizations can adopt an iterative approach of frequent...
View Details
Keywords:
Innovation;
Novelty;
Goals;
Specialization;
Coordination;
Field Experiment;
Software Development;
Agile;
Scrum;
Iteration;
Iterative;
Organizations;
Innovation and Invention;
Value;
Goals and Objectives;
Integration;
Applications and Software
Ghosh, Sourobh, and Andy Wu. "Iterative Coordination and Innovation: Prioritizing Value over Novelty." Organization Science 34, no. 6 (November–December 2023): 2182–2206.
- 2023
- Working Paper
Causal Interpretation of Structural IV Estimands
By: Isaiah Andrews, Nano Barahona, Matthew Gentzkow, Ashesh Rambachan and Jesse M. Shapiro
We study the causal interpretation of instrumental variables (IV) estimands of nonlinear, multivariate structural models with respect to rich forms of model misspecification. We focus on guaranteeing that the researcher's estimator is sharp zero consistent, meaning...
View Details
Keywords:
Mathematical Methods
Andrews, Isaiah, Nano Barahona, Matthew Gentzkow, Ashesh Rambachan, and Jesse M. Shapiro. "Causal Interpretation of Structural IV Estimands." NBER Working Paper Series, No. 31799, October 2023.