Looking forward to #FutureLaw2023 tomorrow @CodeXStanford — because it is an jam packed agenda — we do not have time to cover everything but I have collected much of my current thoughts on Generative AI + LAW ... HERE - speakerdeck.com/danielkatz/g… #FutureLaw #LegalData #LegalTech #LLM #GPT4 #LegalInnovation @StanfordLaw @ChicagoKentLaw

“GPT-4 Passes the Bar Exam” paper is now available on SSRN ...SSRN LINK HERE —  papers.ssrn.com/sol3/papers.… ABSTRACT: In this paper, we experimentally evaluate the zero-shot performance of a preliminary version of GPT-4 against prior generations of GPT on the entire Uniform Bar Examination (UBE), including not only the multiple-choice Multistate Bar Examination (MBE), but also the open-ended Multistate Essay Exam (MEE) and Multistate Performance Test (MPT) components. On the MBE, GPT-4 significantly outperforms both human test-takers and prior models, demonstrating a 26% increase over ChatGPT and beating humans in five of seven subject areas. On the MEE and MPT, which have not previously been evaluated by scholars, GPT-4 scores an average of 4.2/6.0 as compared to much lower scores for ChatGPT. Graded across the UBE components, in the manner in which a human tast-taker would be, GPT-4 scores approximately 297 points, significantly in excess of the passing threshold for all UBE jurisdictions. These findings document not just the rapid and remarkable advance of large language model performance generally, but also the potential for such models to support the delivery of legal services in society. #GPT4 #NLProc #LegalTech Great to work with @mjbommar Shang Gao and @tweetatpablo on this paper !

🚨NEW PAPER VERSION🚨 — ‘Natural Language Processing in the Legal Domain’ — Today we release a VERSION 2.01 — now with a new section on Reproducibility and Data Availability … ABSTRACT: In this paper, we summarize the current state of the field of NLP & Law with a specific focus on recent technical and substantive developments. To support our analysis, we construct and analyze a nearly complete corpus of more than six hundred NLP & Law related papers published over the past decade. Our analysis highlights several major trends. Namely, we document an increasing number of papers written, tasks undertaken, and languages covered over the course of the past decade. We observe an increase in the sophistication of the methods which researchers deployed in this applied context. Slowly but surely, Legal NLP is beginning to match not only the methodological sophistication of general NLP but also the professional standards of data availability and code reproducibility observed within the broader scientific community. We believe all of these trends bode well for the future of the field, but many questions in both the academic and commercial sphere still remain open. 🚀 PAPER HERE 🚀 papers.ssrn.com/sol3/papers.… #LegalData #NLP #NLProc #LegalNLP #LegalAnalytics #Evaluation #AI #LegalEngineering #LegalScience #Engineering #GPT #ChatGPT #NeuralNLP #LegalTech #LegalAI #Law #Science

Today - @mjbommar and I are cited / quoted in the Canadian Bar Association Magazine about all things GPT. Thanks to @JulieSobowale for the story ! nationalmagazine.ca/en-ca/ar… #LegalData #LegalTech #GPT #ChatGPT #LegalAI

Now Posted Version 2.01- 'GPT Takes the Bar Exam' - in this draft - we report Passing Scores for both Evidence and Torts - we discuss Prompt Engineering + Hyperparameter Optimization undertaken - #Law #BarExam #GPT3 #ChatGPT #LegalNLP #LegalTech papers.ssrn.com/sol3/papers.… @mjbommar

Yesterday - I had the pleasure of providing a keynote address to the 800+ Bankruptcy / Restructuring Lawyers at the 2022 @INSOLIntl INSOL International Conference in London … #INSOLLondon2022 #Insolvency #Restructuring #legalinnovation #law #legaltech @ChicagoKentLaw

Prepping Class + Refreshing my old content on Brand Building for Law Students (+Lawyers)-Got to get @heyitsalexsu in the mix here for sure-he is killing it w/ fresh content- @jboehmig @maryshenocarro1 @ironclad_inc Old Deck Here (New one Soon) tinyurl.com/2p83wkmu #LegalTech