Filter Results
:
(301)
Show Results For
-
All HBS Web
(838)
- Faculty Publications (301)
Show Results For
-
All HBS Web
(838)
- Faculty Publications (301)
- 2023
- Article
M4: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities, and Models
By: Himabindu Lakkaraju, Xuhong Li, Mengnan Du, Jiamin Chen, Yekun Chai and Haoyi Xiong
While Explainable Artificial Intelligence (XAI) techniques have been widely studied to explain predictions made by deep neural networks, the way to evaluate the faithfulness of explanation results remains challenging, due to the heterogeneity of explanations for...
View Details
Keywords:
AI and Machine Learning
Lakkaraju, Himabindu, Xuhong Li, Mengnan Du, Jiamin Chen, Yekun Chai, and Haoyi Xiong. "M4: A Unified XAI Benchmark for Faithfulness Evaluation of Feature Attribution Methods across Metrics, Modalities, and Models." Advances in Neural Information Processing Systems (NeurIPS) (2023).
- 2023
- Article
Post Hoc Explanations of Language Models Can Improve Language Models
By: Satyapriya Krishna, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh and Himabindu Lakkaraju
Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex tasks. Moreover, recent research has shown that incorporating human-annotated rationales (e.g., Chain-of-Thought prompting) during in-context learning can significantly enhance...
View Details
Krishna, Satyapriya, Jiaqi Ma, Dylan Slack, Asma Ghandeharioun, Sameer Singh, and Himabindu Lakkaraju. "Post Hoc Explanations of Language Models Can Improve Language Models." Advances in Neural Information Processing Systems (NeurIPS) (2023).
- December 2023
- Article
Self-Orienting in Human and Machine Learning
By: Julian De Freitas, Ahmet Uğuralp, Zeliha Uğuralp, Laurie Paul, Joshua B. Tenenbaum and T. Ullman
A current proposal for a computational notion of self is a representation of one’s body in a specific time and place, which includes the recognition of that representation as the agent. This turns self-representation into a process of self-orientation, a challenging...
View Details
De Freitas, Julian, Ahmet Uğuralp, Zeliha Uğuralp, Laurie Paul, Joshua B. Tenenbaum, and T. Ullman. "Self-Orienting in Human and Machine Learning." Nature Human Behaviour 7, no. 12 (December 2023): 2126–2139.
- 2023
- Other Article
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications
By: Mirac Suzgun, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers and Stuart Shieber
Innovation is a major driver of economic and social development, and information about many kinds of innovation is embedded in semi-structured data from patents and patent applications. Though the impact and novelty of innovations expressed in patent data are difficult...
View Details
Keywords:
USPTO;
Natural Language Processing;
Classification;
Summarization;
Patent Novelty;
Patent Trolls;
Patent Enforceability;
Patents;
Innovation and Invention;
Intellectual Property;
AI and Machine Learning;
Analytics and Data Science
Suzgun, Mirac, Luke Melas-Kyriazi, Suproteem K. Sarkar, Scott Duke Kominers, and Stuart Shieber. "The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications." Conference on Neural Information Processing Systems (NeurIPS), Datasets and Benchmarks Track 36 (2023).
- 2023
- Working Paper
The Uneven Impact of Generative AI on Entrepreneurial Performance
By: Nicholas G. Otis, Rowan Clarke, Solène Delecourt, David Holtz and Rembrand Koning
There is a growing belief that scalable and low-cost AI assistance can improve firm
decision-making and economic performance. However, running a business involves
a myriad of open-ended problems, making it hard to generalize from recent studies
showing that...
View Details
Keywords:
AI and Machine Learning;
Performance Improvement;
Small Business;
Decision Choices and Conditions;
Kenya
Otis, Nicholas G., Rowan Clarke, Solène Delecourt, David Holtz, and Rembrand Koning. "The Uneven Impact of Generative AI on Entrepreneurial Performance." Harvard Business School Working Paper, No. 24-042, December 2023.
- 2023
- Article
Verifiable Feature Attributions: A Bridge between Post Hoc Explainability and Inherent Interpretability
By: Usha Bhalla, Suraj Srinivas and Himabindu Lakkaraju
With the increased deployment of machine learning models in various real-world applications, researchers and practitioners alike have emphasized the need for explanations of model behaviour. To this end, two broad strategies have been outlined in prior literature to...
View Details
Bhalla, Usha, Suraj Srinivas, and Himabindu Lakkaraju. "Verifiable Feature Attributions: A Bridge between Post Hoc Explainability and Inherent Interpretability." Advances in Neural Information Processing Systems (NeurIPS) (2023).
- 2023
- Article
Which Models Have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness
By: Suraj Srinivas, Sebastian Bordt and Himabindu Lakkaraju
One of the remarkable properties of robust computer vision models is that their input-gradients are often aligned with human perception, referred to in the literature as perceptually-aligned gradients (PAGs). Despite only being trained for classification, PAGs cause...
View Details
Srinivas, Suraj, Sebastian Bordt, and Himabindu Lakkaraju. "Which Models Have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness." Advances in Neural Information Processing Systems (NeurIPS) (2023).
- November 2023
- Case
Riiid: Scaling AI Educational Services Globally
By: John Jong-Hyun Kim, Nancy Dai and Ruru Hoong
This article explores the definition and evolution of AI, its applications in education, and the role of AI, particularly in K-12 education. It discusses the founding of Riiid, an AI-driven educational technology company, and its journey in the education sector, with a...
View Details
Keywords:
AI and Machine Learning;
Economic Sectors;
Technological Innovation;
Education Industry;
South Korea;
Asia
Kim, John Jong-Hyun, Nancy Dai, and Ruru Hoong. "Riiid: Scaling AI Educational Services Globally." Harvard Business School Case 324-030, November 2023.
- November 2023
- Case
Copilot(s): Generative AI at Microsoft and GitHub
This case tells the story of Microsoft’s 2018 acquisition of GitHub and the subsequent launch of GitHub Copilot, a tool that uses generative artificial intelligence to suggest snippets of code to software developers in real time. Set in late 2021, when Copilot was...
View Details
Keywords:
Business Ventures;
Strategy;
AI and Machine Learning;
Applications and Software;
Product Launch;
Information Technology Industry;
Technology Industry;
Web Services Industry;
United States;
California
Nagle, Frank, Shane Greenstein, Maria P. Roche, Nataliya Langburd Wright, and Sarah Mehta. "Copilot(s): Generative AI at Microsoft and GitHub." Harvard Business School Case 624-010, November 2023.
- November 2023
- Case
Zest AI: Machine Learning and Credit Access
By: David S. Scharfstein and Ryan Gilland
Scharfstein, David S., and Ryan Gilland. "Zest AI: Machine Learning and Credit Access." Harvard Business School Case 224-033, November 2023.
- Working Paper
An AI Method to Score Celebrity Visual Potential from Human Faces
By: Flora Feng, Shunyuan Zhang, Xiao Liu, Kannan Srinivasan and Cait Lamberton
Celebrities have extraordinary abilities to attract and influence others. Predicting celebrity visual potential is important in the domains of business, politics, media, and entertainment. Can we use human faces to predict celebrity visual potential? If so, which...
View Details
Feng, Flora, Shunyuan Zhang, Xiao Liu, Kannan Srinivasan, and Cait Lamberton. "An AI Method to Score Celebrity Visual Potential from Human Faces." SSRN Working Paper Series, No. 4071188, November 2023.
- November–December 2023
- Article
Keep Your AI Projects on Track
By: Iavor Bojinov
AI—and especially its newest star, generative AI—is today a central theme in corporate boardrooms, leadership discussions, and casual exchanges among employees eager to supercharge their productivity. Sadly, beneath the aspirational headlines and tantalizing potential...
View Details
Keywords:
Generative Models;
AI and Machine Learning;
Success;
Failure;
Product Development;
Technology Adoption
Bojinov, Iavor. "Keep Your AI Projects on Track." Harvard Business Review 101, no. 6 (November–December 2023): 53–59.
- November 2023
- Article
Psychological Factors Underlying Attitudes toward AI Tools
By: Julian De Freitas, Stuti Agarwal, B. Schmitt and N. Haslam
What are the psychological factors driving attitudes toward AI tools, and how can resistance to AI systems be overcome when they are beneficial? In this perspective, we first organize the main sources of resistance into five main categories: opacity, emotionlessness,...
View Details
De Freitas, Julian, Stuti Agarwal, B. Schmitt, and N. Haslam. "Psychological Factors Underlying Attitudes toward AI Tools." Nature Human Behaviour 7, no. 11 (November 2023): 1845–1854.
- 2023
- Working Paper
The Optimal Stock Valuation Ratio
By: Sebastian Hillenbrand and Odhrain McCarthy
Trailing price ratios, such as the price-dividend and the price-earnings ratio, scale prices by trailing cash flow measures. They theoretically contain expected returns, yet, their performance in predicting stock market returns is poor. This is because of an omitted...
View Details
Keywords:
Price;
Investment Return;
AI and Machine Learning;
Valuation;
Cash Flow;
Forecasting and Prediction
Hillenbrand, Sebastian, and Odhrain McCarthy. "The Optimal Stock Valuation Ratio." Working Paper, November 2023.
- October 2023
- Teaching Note
Timnit Gebru: 'SILENCED No More' on AI Bias and The Harms of Large Language Models
By: Tsedal Neeley and Tim Englehart
Teaching Note for HBS Case No. 422-085. Dr. Timnit Gebru—a leading artificial intelligence (AI) computer scientist and co-lead of Google’s Ethical AI team—was messaging with one of her colleagues when she saw the words: “Did you resign?? Megan sent an email saying that...
View Details
- October 2023
- Case
ReUp Education: Can AI Help Learners Return to College?
By: Kris Ferreira, Christopher Thomas Ryan and Sarah Mehta
Founded in 2015, ReUp Education helps “stopped out students”—learners who have stopped making progress towards graduation—achieve their college completion goals. The company relies on a team of success coaches to engage with learners and help them reenroll. In 2019,...
View Details
Keywords:
AI;
Algorithms;
Machine Learning;
Edtech;
Education Technology;
Analysis;
Higher Education;
AI and Machine Learning;
Customization and Personalization;
Failure;
Education Industry;
Technology Industry;
United States
Ferreira, Kris, Christopher Thomas Ryan, and Sarah Mehta. "ReUp Education: Can AI Help Learners Return to College?" Harvard Business School Case 624-007, October 2023.
- October 2023
- Case
Fixie and Conversational AI Sidekicks
By: Jeffrey J. Bussgang and Carin-Isabel Knoop
In March 2023, Fixie Co-Founder and Chief Architect Matt Welsh and co-founders had the kind of meeting no founders want to have. The president of leading artificial intelligence (AI) research and deployment firm OpenAI, which had catapulted into fame with its ChatGPT...
View Details
- October 2023
- Article
Improving Regulatory Effectiveness Through Better Targeting: Evidence from OSHA: Profiled in the Regulatory Review
By: Matthew S. Johnson, David I. Levine and Michael W. Toffel
We study how a regulator can best target inspections. Our case study is a U.S. Occupational Safety and Health Administration (OSHA) program that randomly allocated some inspections. On average, each inspection averted 2.4 serious injuries (9%) over the next five years....
View Details
Keywords:
Safety Regulations;
Regulations;
Regulatory Enforcement;
Machine Learning Models;
Safety;
Operations;
Service Operations;
Production;
Forecasting and Prediction;
Decisions;
United States
Johnson, Matthew S., David I. Levine, and Michael W. Toffel. Improving Regulatory Effectiveness Through Better Targeting: Evidence from OSHA: Profiled in the Regulatory Review. American Economic Journal: Applied Economics 15, no. 4 (October 2023): 30–67.
- 2023
- Working Paper
The Impact of Input Inaccuracy on Leveraging AI Tools: Evidence from Algorithmic Labor Scheduling
Are the inputs used by your AI tool correct and up to date? In this paper, we show that the answer to this question: (i) is frequently a “no” in real business contexts, and (ii) has significant implications on the performance of AI tools. In the context of algorithmic...
View Details
Kwon, Caleb, Antonio Moreno, and Ananth Raman. "The Impact of Input Inaccuracy on Leveraging AI Tools: Evidence from Algorithmic Labor Scheduling." Working Paper, October 2023.
- October 14, 2023
- Article
Will Consumers Buy Selfish Self-Driving Cars?
De Freitas, Julian. "Will Consumers Buy Selfish Self-Driving Cars?" Wall Street Journal (October 14, 2023), C5.