#  Fine-tuning Games 

 



####  calendar\_today Date and Time 

 **November 3, 2023** 

 01:30PM - 02:30PM EDT 

####  pin\_drop Location 

 **SEC 1.413**  



 

 



 

 **Speaker:** Benjamin Laufer (Cornell Tech)

 **Talk Title:** [Fine-tuning Games](https://urldefense.proofpoint.com/v2/url?u=https-3A__arxiv.org_pdf_2308.04399.pdf&d=DwMFaQ&c=WO-RGvefibhHBZq3fL85hQ&r=ZOP6tLIqLOHbdgCvrXjUlPta0tw7K_-ivqiItQhh6LQ&m=jHIfmGo1va9aKPTKX3bijNtRTpO7c8M3zvlStZGJ9sOiLdJi_aP6VfZiTPHUqpAV&s=UE0QvH5OsP6FDd2WSKFbNWhBbQDV9l7L-Go24xRKhL4&e=)  
  
**Abstract:** Major advances in Machine Learning (ML) and Artificial Intelligence (AI) increasingly take the form of developing and releasing general-purpose models. These models are designed to be adapted by other businesses and agencies to perform a particular, domain-specific function. This process has become known as adaptation or fine-tuning. This talk will offer a model of the fine-tuning process where a Generalist brings the technological product (here an ML model) to a certain level of performance, and one or more Domain-specialist(s) adapts it for use in a particular domain. Both entities are profit-seeking and incur costs when they invest in the technology, and they must reach a bargaining agreement on how to share the revenue for the technology to reach the market. For a relatively general class of cost and revenue functions, we characterize the conditions under which the fine-tuning game yields a profit-sharing solution. We observe that any potential domain-specialization will either "contribute," "free-ride," or "abstain" in their uptake of the technology, and we provide conditions yielding these different strategies. We show how methods based on bargaining solutions and sub-game perfect equilibria provide insights into the strategic behavior of firms in these types of interactions, and we find that profit-sharing can still arise even when one firm has significantly higher costs than another. We also provide methods for identifying Pareto-optimal bargaining arrangements for a general set of utility functions. Finally, we will discuss some extensions of this model to questions about regulation, liability, and harms in AI systems.  
  
**Shorter description:** In this work, we provide a model of the strategic dynamics implicit in domain adaptation of a general-purpose AI/ML technology. We do some analysis suggesting whether/which/how domains will adapt a general-purpose model. For example, depending on the cost of investment, a domain might either "abstain," "contribute," or "free-ride." We will discuss current findings as well as present work extending the model to questions around regulation, liability, and harms in AI systems.



 

 



 

 See also:- [ Fall 2023 EconCS Seminars ](/taxonomycalendarseminar/seminars-2023-fall)
- [ Seminar history ](/taxonomycalendarseminar/seminar-history)
 
 

 Share on:- [     Facebook ](#)
- [     Twitter ](#)
- [     Linkedin ](#)
 


 Save: [ Add to calendar calendar\_today ](https://econcs.seas.harvard.edu/node/1771471/event-feed.ics)  Copy link link