This 20-min episode comes from our friend Nathaniel Whittemore's excellent daily podcast The AI Breakdown Podcast. This episode aired on June 1, 2023, and covers the latest developments from OpenAI, including new features, a cybersecurity grant program, and their new process rewards model for trading. We hope you enjoy it as much as we do. Subscribe to The AI Breakdown podcast: https://pod.link/1680633614 Subscribe to The AI Breakdown on YouTube: https://www.youtube.com/@TheAIBreakdown

Nathan and Erik analyze the moats of the most powerful companies in AI. The paradigm-shifting technology has led to a flourishing open-source community with market share. Yet, the big players have key competitive advantages that can be examined from many different angles. LINKS: Nathan’s Twitter thread on AI moats that sparked this discussion: https://twitter.com/labenz/status/1654853321876815872 Read about the 9 moats at length in our newsletter: https://cognitiverevolution.substack.com/p/the-leaked-google-memo-and-a Leaderboard for AI rankings: https://lmsys.org/ PODCAST RECOMMENDATION: The AI Breakdown: https://pod.link/1680633614 As anyone in AI knows, the pace of progress of new releases is relentless. The AI Breakdown is a daily podcast (10-20min long) that helps us ensure we don't miss anything important by curating news and analysis. TIMESTAMPS: (00:00) Episode Preview (01:36) Where are the moats in AI? (07:31) Open source vs. closed (15:24) Recommendation: The AI Breakdown Podcast (16:39) Sponsor: Omneky (20:46) AI Safety (33:00) Which players are going to win? 9 Moats. TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Today’s episode is a deep dive into the collision of AI and the future of entertainment, against the backdrop of the still-raging Writers Guild of America (WGA) strike. Nathan Labenz sits down with Trey Kollmer, Sophia Lear, and Garrett Schabb – all seasoned television writers and Guild members – to discuss the labor dispute. While the strike encompasses many dynamics, the timely intersection with a rapidly changing AI landscape has the writers entwined in the wild possibilities and existential threats of paradigm-shifting technology. Other entertainment guilds and labor unions are watching closely. Note: Nathan kicks off this episode with a longer-than-usual introduction and analysis as the subject matter of this episode requires some added context. If you would prefer to dive straight into the interviews, follow the timecodes below to skip ahead (and maybe give the intro a listen when you finish!) More about our guests Trey Kollmer, Sophia Lear, and Garrett Schabb and their work: Trey Kollmer, currently co-executive producer for the TV show Ghosts, was described to me as perhaps the single most knowledgeable guild member on the topic of AI. Follow him at @treyko on Twitter. Sophia Lear has been a writer for TV shows including Ghosts, The Unicorn, and New Girl, and was also previously an assistant literary editor for the New Republic. Garrett Schabb has written for shows including Tosh.0 and Suits (of Meghan Markle fame), and has also written for Crooked Media.  Follow him at @garrettschabb PODCAST RECOMMENDATION: The AI Breakdown: https://pod.link/1680633614 As anyone in AI knows, the pace of progress of new releases is relentless. The AI Breakdown is a daily podcast (10-20min long) that helps us ensure we don't miss anything important by curating news and analysis. TIMESTAMPS: (00:00) Preview (01:54) Introduction and analysis for this episode  (09:02) Trey Kollmer breaks down the dynamics of compensation, ownership and crediting for WGA writers, issues at the heart of the strike (14:52) Sponsor: Omneky (15:09) Recommendation: The AI Breakdown (17:16) What are the attitudes and implementation of AI in the writer’s room? (22:42) Usefulness of AI for script writing (and will better training out of jailbreaks make it less useful?)  (30:59) The main two AI-related demands of the labor dispute (34:44) Is there any way to police or standardize use? (42:48) Writers’ diverse reactions to AI, from hostility to experimentation (50:00) Picturing a long term Utopian future (57:46) Sophia Lear breaks down sentiments around GPT-4, AI-generated scripts and the previous eras of crappy sitcoms and bad streaming series (written by humans) (1:08:19) Dissecting quality  (1:11:27) Whose jobs are safe? (1:17:03) Garrett Schabb breaks down dystopian/realistic view of studio’s incentives (1:20:33) How Garrett uses ChatGPT (1:27:37) Ethical boundaries of using the model to write like your favorite writers (1;32:16) The two types of storytelling in the future, UBI and decoupling writing from a profession TWITTER: @CogRev_Podcast @treyko (Trey) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan Labenz sits down with Andrew Feldman, CEO and Co-Founder of Cerebras Systems, a company building a new class of computer system for accelerating AI and changing the future of work. Cerebras Systems is the creator of the world’s largest chip, at 2.6 trillion transistors. In this episode, they discuss the founding story of Cerebras, the experience of creating the world’s largest chip, and the process that goes into chip design and manufacturing for an AI-focused chip.  This episode is the first part of our hardware exploration series focused on the people building at the forefront of hardware applications in AI. LINKS: Cerebras: https://www.cerebras.net/ Book: The Chip War by Chris Miller PODCAST RECOMMENDATION: The AI Breakdown: https://pod.link/1680633614 As anyone in AI knows, the pace of progress of new releases is relentless. The AI Breakdown is a daily podcast (10-20min long) that helps us ensure we don't miss anything important by curating news and analysis. TIMESTAMPS (00:00) Preview (04:27) Andrew’s story of creating the world’s largest chip and Cerebras (07:19) What is a chip? (08:14) The diversity of chips and what they can accomplish (09:47) What is it like to design a 2.5 trillion transistor chip? (12:41) The founding story of Cerebras and building the team (14:20) Sponsor: Omneky (23:00) What was the hardest part about building the company? (26:11) What happens after designing the chip’s blueprint? (27:29) The tradeoffs needed in chipmaking  (34:08) The comparison between chips and neural networks (38:31) The generalization vs specialization of a chip  (40:11) Sparse compute vs dense compute (43:55) Ghost in the machine (46:54) Supply chain challenges of the Cerebras chip (54:59) The future for chips (58:19) Building chip clusters (58:57) The Cerebras business model (01:00:41) Building a chip cluster vs using a Cerebras chip (01:02:57) Giant chips on the edge (01:05:32) What is the edge?  (01:08:04) Andrew’s favorite AI products (01:10:08) Would Andrew get a Neuralink implant? (01:14:16) Consciousness and chips (01:17:50) AI hopes and fears TWITTER: @CogRev_Podcast @andrewdfeldman (Andrew) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan Labenz sits down with engineer Shreya Rajpal, the creator of Guardrails AI, a new Python library that allows developers to add a layer of output, validation and correction to their code. Practically guardrails can ensure a reliable interface between language models and more traditional deterministic software systems. At the same time, mind-bending and potentially risky use case frameworks like Guardrails allow developers to ask and answer entirely new kinds of questions. Talking to Shreya really reinforced just how early we are in LLM’s impact on the software industry. We were introduced to Shreya’s work when recording our interview with Matt Welsh, the CEO of Fixie.AI (Ep 19: How AI Agents Will Change How We Work). LINKS: Guardrails AI: https://shreyar.github.io/guardrails/ RECOMMENDED PODCASTS: Upstream: https://link.chtbl.com/Upstream TIMESTAMPS: (00:00) Episode preview (05:00) Why Shreya built Guardrails AI (08:33) Common ways LMs can “go off the rails” and how Guardrails can correct it (13:45) Discussion of validators (15:31) Sponsor: Omneky (18:48) Business and creative use cases of Guardrails AI (25:00) What can be achieved by Guardrails AI that cannot be achieved by traditional code (32:44) How agents work vs how Guardrails works (35:34) AI as shepherd vs delegating to AI and the role of human understanding (39:54) Trust deficit and risks (46:33) Is it realistic to imagine GPT-4 using Guardrails? (52:00) How Shreya thinks about security (57:02) How Shreya thinks about embeddings (1:05:05) How Shreya thinks about problemsolving with LMs (1:07:50) Shreya on OpenAI’s Evals Library, Anthropic’s Constitutional AI (1:12:55) Discussion of determinism (1:15:00) Recommendations for developers to minimize overhead (1:26:00) Predictions about providers in the space of LMs (1:29:30) Shreya’s favorite AI tools (1:30:00) Would Shreya get a neuralink implant (1:31:50) Biggest hopes and fears for AI TWITTER: @CogRev_Podcast @ShreyaR (Shreya) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan sits down with Vivek Natarajan, research scientist at Google Health. Vivek leads the Google Brain moonshot behind Med-PaLM, Google’s flagship medical large language model, featured in The Economist, The Scientific American, CNBC, and Forbes. In this episode, they discuss the foundational models that Vivek and team built before Med-PaLM, the techniques used to develop Med-PaLM which will be of interest to anyone developing AI systems for high-stakes use cases, and the capabilities for Med-PaLM to equalize access to medical knowledge and care. This episode is part of a series centered on talking to the people at the cutting edge of building AI-driven solutions in medicine. PODCAST RECOMMENDATION: Upstream: https://link.chtbl.com/Upstream LINKS: https://sites.research.google/med-palm/ FEEDBACK / COLLABORATE WITH NATHAN: Email: TCR@turpentine.co TIMESTAMPS: (00:00) Episode preview (03:43) The story of how Med-PaLM came to be (09:41) Building Med-PaLM’s infrastructure (13:10) The US medical licensing exam as a measure of AI progress (15:23) Sponsor: Omneky (18:17) Practicality of benchmarking in real-world usage (21:39) Overcoming the shortfalls of Flan-PaLM with Med-PaLM (25:08) Choosing to use soft prompting over few shot prompting (30:36) The process of training Flan-PaLM (37:31) A curriculum approach to soft-prompting (38:43) Layperson vs expert interactions with LLMs (43:54) How did the Google team facilitate user exploration of the model’s capabilities? (46:58) Shift in techniques from Med-PaLM to Med-PaLM2 (50:21) Using different prompting strategies with Med-PaLM2 (57:33) Is Med-PaLM 2 preferred over clinicians? (01:02:28) Will there be a multimodal version of Med-PaLM? (01:04:52) Breakthroughs required for AI to further advance human potential (01:10:23) The Med-PaLM business plan (01:12:08) Is there a vision for a consumer product? (01:15:46) The pros and cons of pre-training a model (01:19:45) Vivek’s favorite AI products (01:21:01) Would Vivek get a Neuralink implant? (01:23:08) AI hopes and fears TWITTER: @CogRev_Podcast @vivnat (Vivek) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

[Bonus Episode] Future of Life Institute Podcast host Gus Docker interviews Conjecture CEO Connor Leahy to discuss GPT-4, magic, cognitive emulation, demand for human-like AI, and aligning superintelligence. You can read more about Connor's work at https://conjecture.dev Future of Life Institute is the organization that recently published an open letter calling for a six-month pause on training new AI systems. FLI was founded by Jann Tallinn who we interviewed in Episode 16 of The Cognitive Revolution. We think their podcast is excellent. They frequently interview critical thinkers in AI like Neel Nanda, Ajeya Cotra, and Connor Leahy - an episode we found particularly fascinating and is airing for our audience today. The FLI Podcast also recently interviewed Nathan Labenz for a 2-part episode: https://futureoflife.org/podcast/nathan-labenz-on-how-ai-will-transform-the-economy/ SUBSCRIBE: Future of Life Institute Podcast: Apple: https://podcasts.apple.com/us/podcast/future-of-life-institute-podcast/id1170991978 Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP TIMESTAMPS: (00:00) Episode introduction (01:55) GPT-4  (18:30) "Magic" in machine learning  (29:43) Cognitive emulations  (40:00) Machine learning VS explainability  (49:50) Human data = human AI?  (1:01:50) Analogies for cognitive emulations  (1:28:10) Demand for human-like AI  (1:33:50) Aligning superintelligence  If you'd like to listen to Part 2 of this interview with Connor Leahy, you can head here:  https://podcasts.apple.com/us/podcast/connor-leahy-on-the-state-of-ai-and-alignment-research/id1170991978?i=1000609972001

Nathan and Erik sit down with Neal Khosla, founder of Curai Health, a venture-backed virtual care startup using AI to provide low-cost primary healthcare. Prior to his current role at Curai, Neal was a machine learning researcher at Google and Stanford. In this episode, they discuss the current state of AI in medicine, what the future patient experience may look like, and how developments in AI healthcare may interact with different regulatory and social forces across the globe.  FEEDBACK  We'd love to hear your feedback or answer any listener questions live on an upcoming episode. DM @labenz on Twitter or email us at Info@turpentine.co with "TCR" in the subject line. We'd appreciate it immensely if you left us a review on Apple Podcasts or a rating on Spotify! TIMESTAMPS (00:00) Preview (04:32) The future of AI in medicine (12:50) Patient experience in AI-driven medicine and the current state of AI in medicine (15:04) Sponsor: Omneky (20:34) Building the LLM architecture for medicine (25:25) Current state of the art for AI in medicine (28:54) Evaluating LLM performance in medicine (31:49) Benchmarking LLMs in medicine (39:17) Using the Socratic method in training LLMs (43:57) Multimodal systems and deploying multiple models in medicine  (51:30) The future of LLM creation and usage (59:47) The interaction of AI medicine with social and regulatory forces (01:11:00) AI adoption in countries with centralized healthcare systems (01:13:37) How should we regulate the usage of AI in medicine? (01:16:57) AI-first systems in medicine (01:18:19) Is there an obligation to deploy AI in medicine in its current state? (01:20:48) Neal’s favorite AI products (01:22:21) Would Neal get a Neuralink implant? (01:24:54) AI hopes and fears TWITTER: @CogRev_Podcast @nealkhosla (Neal) @labenz (Nathan) RECOMMENDED PODCASTS: Upstream: https://link.chtbl.com/Upstream SPONSOR: Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan sits down with Professor Zak Kohane, the Chair of the Department of Biomedical Informatics at Harvard Medical School, and co-author of the new book, The AI Revolution in Medicine, for which Sam Altman, OpenAI’s CEO wrote the foreword to the book. Professor Kohane was among a select few people to receive early preview and research access to GPT-4 in the fall of 2022, and his approach to exploring and characterizing how AI is about to transform medicine.  The book is out May 13, 2023 and can be ordered here (or on Amazon by searching for "The AI Revolution in Medicine") Regardless of the field you're in, Dr. Kohane's combination of deep immersion, enthusiastic exploration, pragmatic optimism, risk awareness, realism, and forward-thinking vision make this a worthy example for others to study and emulate. PODCAST RECOMMENDATION: Youtube: @UpstreamwithErikTorenberg  Audio: https://link.chtbl.com/Upstream TIMESTAMPS: (00:00) Episode preview (05:29) Dr. Isaac Kohane’s story (15:00) Sponsor: Omneky (16:29) Advice to others thinking of applying AI to their own disciplines (20:33) The tension of using AI in medicine (25:04) The Trial Paradigm of AI  (31:15) Is it possible to use GPT as a healthcare provider in population studies? (34:14) The Trainee Paradigm of AI (36:09) The Partner Paradigm of AI and how doctors should use AI (40:33) AI provided interaction and how that can improve patient care (42:26) The Torchbearer Paradigm of AI (42:59) Can GPT independently conduct medical research? (46:58) The future for impactful use cases of AI in medicine (51:04) Integrating AlphaFold into language models (54:10) AI-alignment and patient data in medicine TWITTER: @CogRev_Podcast @labenz (Nathan) @zakkohane (Isaac) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: cognitiverevolution.substack.com

Nathan Labenz sits down with prominent – and notably prescient – AI media figures Robert Scoble and Ben Tossell. They discuss what the work of being an AI scout looks like, how to bring the mainstream along with emerging AI developments, and their predictions and hopes for AI. Robert Scoble is a long-time Silicon Valley technology explorer and connector, a futurist who's met so many technology legends in their primes that he's now also something of a historian. https://scobleizer.blog/ Ben Tossell is the creator of Ben's Bites, an AI round up newsletter meant to be read in 5 minutes or less, read by over 90,000 subscribers. https://www.bensbites.co/ This episode caps off our series centered on talking to rising voices in AI media: people who are now only working overtime to understand everything going on in AI, but also creating thought leadership and educational content meant to help others get up to speed as well. BOOK RECOMMENDATION: The Scout Mindset from author Julia Galef PODCAST RECOMMENDATION: Upstream with Erik Torenberg: https://link.chtbl.com/Upstream TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) @Scobleizer (Robert) @bentossell (Ben Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More original content from Nathan is published in our Substack: https://cognitiverevolution.substack.com/

Nathan Labenz sits down with Rachel Woods, founder of The AI Exchange, an AI education platform with over 130,000 subscribers on TikTok. They discuss Rachel’s experience consulting for public and private companies on AI strategy, how teams should think about their AI strategy, and how Rachel uses AI in her own business. Rachel was previously a data scientist at Meta, and a founder of a venture-backed e-commerce startup, where she began to use chatGPT in her startup operations. This episode is the second in a series centered on talking to rising voices in AI media: people who are now only working overtime to understand everything going on in AI, but also creating thought leadership and educational content meant to help others get up to speed as well. TIMESTAMPS: (00:00) Episode preview (02:59) Rachel Woods’ story (04:30) State of the public who comes across videos (9:49): How do you frame AI to business owners and how should they use it? (15:29) Sponsor: Omneky (18:58) How should teams set up their AI strategy for success? (26:41) The leap from GPT 3.5 to GPT-4 (30:42) Step changes of AI and public perception of capabilities (35:17) Common misconceptions people have about AI (36:22) How Rachel uses AI in her business (44:09) What’s your style of prompt engineering for content creation? (46:01) How AI will change the way we use a computer in the next year? (49:34) Bing launch and how companies launch AI products (54:15) AI safety and restraint (1:00:11) Alpaca and LLaMA (1:04:16) Rachel’s favorite products in AI (1:05:24) Would Rachel get a Neuralink implant? (1:07:55) AI hopes and fears RECOMMENDED PODCAST: Upstream: https://link.chtbl.com/Upstream TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) @rachel_l_woods (Rachel) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

Nathan Labenz and Erik Torenberg sit down with Sarah Guo and Elad Gil, notable investors and co-hosts of the AI-focused No Priors podcast. They discuss how Sarah and Elad are approaching AI investment opportunities right now, how that differs from how they've thought about investing in the past, where in the stack from hardware to applications they expect to see value accrue, what modes of human-AI interaction they are most interested in, and more. Sarah is the founder of $100M AI-focused venture fund Conviction VC, which she launched last fall. She was previously General Partner at Greylock. Elad is a serial entrepreneur and a startup investor. He has invested in over 40 companies now worth $1B or more each, and is also author of the High Growth Handbook. This episode is the first in a series centered on talking to rising voices in AI media, people who are now only working overtime to understand everything going on in AI, but also creating thought leadership and educational content meant to help others get up to speed as well. We highly recommend Erik Torenberg’s interview show "Upstream". Guests include Ezra Klein, Balaji Srinivasan, David Sacks, and Marc Andreessen. Subscribe here: Spotify: https://open.spotify.com/show/7wHYcVRmMP6rWQL9lVQJlL Apple: https://podcasts.apple.com/us/podcast/upstream-with-erik-torenberg/id1678893467 LINKS: No Priors Podcast on Spotify: https://open.spotify.com/show/0O65xhqvGVhpgdIrrdlEYk No Priors on Apple Podcast: https://podcasts.apple.com/us/podcast/no-priors-artificial-intelligence-machine-learning/id1668002688 Elad Gil's blog: https://blog.eladgil.com/ Sarah Guo's blog: https://sarahguo.com/blog TIMESTAMPS: (00:00) Episode preview (04:43) What is software 3.0 (09:14) Disruption coming from startups or incumbents? (13:42) Sarah and Elad identify overlooked investment opportunities in AI (15:19) Sponsor: Omneky (15:46) Future of social media (22:45) AI agents & personal co-pilots (25:32) Where to invest in AI? (31:11) How our kids will interact with AI (34:50) How to gain conviction as an investor in AI (45:07) When should founders raise money and when should they bootstrap? (46:28) How should startups spend their capital now that we have AI capabilities? (48:10) Sarah & Elad’s favorite products in AI (51:39) Would Sarah & Elad get a neuralink implant? (53:41) AI hopes and fears TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) @sarahnormous (Sarah) @eladgil (Elad) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

Raza Habib is on the front lines of LLM implementation as CEO of Humanloop, a Y Combinator backed startup that helps companies of all kinds, small and large bridge the gap from API access to successful LLM deployment. Nathan sat down with Raza to hear what he has learned in the process of helping so many companies on their LLM implementation journeys – and he did not disappoint – as you'll hear, he shared a bunch of concrete examples of customer use cases, practical challenges that people face, and the strategies they use to overcome them. Also, check out the Hackaprompt 2023 competition. There are $40,000 worth of cash and AI credit prizes available.  The competition begins on May 5 and will run for 3 weeks, after which we'll have the organizer Sander Schulhoff, who is also the creator of LearnPrompting.org, on the show to talk about the results. Head to this link to sign up: https://www.aicrowd.com/challenges/hackaprompt-2023 Also, we recommend Erik Torenberg’s interview show "Upstream". Guests include Ezra Klein, Balaji Srinivasan, David Sacks, and Marc Andreessen. Subscribe here: [Apple Podcasts] bit.ly/3z8TldL [Spotify] bit.ly/40letd0 TIMESTAMPS: (00:00) Preview of episode (07:00) Humanloop’s mission and surprising customer base (12:10) Why a language model is so advantageous (15:00) Customization and understanding model performance (18:14) Sponsor: Omneky (18:35) Users graduating from playground experimentation to develop robust implementations  (23:25) Raza’s two mental models for using AI (27:50) How customers are actually integrating API (31:50) Challenge of evaluation and feedback (43:33) Prediction: more fine tuning in the immediate future (47:00) RLHF myth-busting (57:12) Robust agents need feedback loops (1:02:27) AI productization challenges (01:07:32) Adopt or die moment for incumbents (01:11:19) Fast iteration cycles (1:15:45) Rapid fire questions for The Cognitive Revolution guests TWITTER: @CogRev_Podcast @RazRazcle (Raza) @labenz (Nathan) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

Nathan Labenz sits down with Matt Welsh, the CEO and co-founder of Fixie.AI which just raised $17M in seed funding. The technology world's attention has turned en masse to AI agents over the last month, but Matt, a former Harvard professor and ex-Google, has been focused on AI agents for longer over at Fixie. The platform is currently in developer preview mode, where developers can build agents and end users can try them. Agents hold the promise of handling not only the core cognitive work, but many of the messy implementation details as well – the searching & finding, sorting through & scanning, signing in & navigating, reading documentation & using APIs – all the manual ad hoc routing of information for which we act today as human plumbing. TIMESTAMPS: (00:00) Preview of the episode (02:08) Why AI Agents are so topical right now, and Matt's prescience with Fixie (06:40) How Matt started Fixie (10:55) How AI Agents "figure out the plumbing" (15:57) How Matt envisions work changing in the near term + concrete examples (22:40) Building your own agent (26:00) New threat model and guardrails of this new paradigm (34:48) Synthetic memories in autonomous agents (42:39) Examples of incredible use cases (48:00) Single sign on idea (51:00) Form factor for AI-assisted living (54:32) Matt's hopes and fears for AI TWITTER: @CogRev_Podcast @mdwelsh (Matt) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. https://www.omneky.com/ More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com Also, check out the debut of co-host Erik's new long-form interview podcast Upstream, whose guests include David Sacks. Ezra Klein, Balaji Srinivasan, and Marc Andreessen. Subscribe: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 Music Credit: OpenAI's Jukebox

Nathan dives in with Alex Albert, a 22-year-old computer science student at the University of Washington, who has become a prolific creator of Jailbreakchat.com and author over at The Prompt Report.com. This is Alex's first podcast appearance! Please enjoy this thought-provoking conversation with Alex Albert as part of 'Prompt Engineering Week' at The Cognitive Revolution. Thank you to everyone for listening, and shout out to those who commented to let us know how you discovered the show – it was interesting to see the responses across platforms. We'd appreciate you leaving us a review in the Apple Podcasts Store: https://podcasts.apple.com/us/podcast/id1669813431 TIMESTAMPS: (0:00) Preview of Alex on this episode (6:00) How Alex lent structure to his jailbreaking activities early on (8:00) AI is fun and interesting and it's being overshadowed by hype and confusion (12:15) Does Alex see cases of jailbreaking for utility? (16:13) Sponsor: Omneky (25:59) GPT-4 is best for jailbreaking (33:20) Role-play jailbreaks can work (43:59) How to think about exploring black box technology (45:19) Training models to override bad behavior (54:55) Content filters are a band-aid (1:07:14) AI safety (1:13:02) AI models require scrutiny. (1:19:39) Optimism - humans will figure it out TWITTER: @CogRev_Podcast @alexalbert__ (Alex) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. https://www.omneky.com/ More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com Also, check out the debut of co-host Erik's new long-form interview podcast Upstream, whose guests include David Sacks. Ezra Klein, Balaji Srinivasan, and Marc Andreessen. Subscribe: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 Music Credit: OpenAI's Jukebox

For anyone who discovered this show on Twitter, Riley (@goodside) likely needs no introduction – after all, he spent most of 2022 posting his explorations of OpenAI's text-davinci-002, and quickly became one of the must-follow accounts in AI. Riley Goodside is the world's first Staff Prompt Engineer at Scale AI, and is an expert in prompting large language models and integrating them into AI-powered applications. Few have spent as much time on the language model frontier, so I hope you enjoy this unique conversation with Riley Goodside. Also, check out the debut of Erik Torenberg's new long-form interview podcast "Upstream". Guests include Ezra Klein, Balaji Srinivasan, David Sacks, and Marc Andreessen. Subscribe here: (Apple Podcasts) bit.ly/3z8TldL (Spotify) bit.ly/40letd0 TIMESTAMPS: (0:00) Preview of the episode (05:13) Riley's unique background (11:24) Riley's original narrow moat (15:07) Sponsors: Omneky (17:02) LLMs can take on ncreasingly complex instructions (27:41) Language models can do math (30:05) Models can learn from context (37:29) Fine-tune models for tasks (38:47) Automate instruction following (44:34) Large language models are alien text prediction (52:27) Avoid mode collapse by framing (59:05) Composing AI capabilities like Lego bricks (1:00:37) Language models solve tasks (1:05:37) GPT-3 solves real-world tasks (1:15:03) GPT-4's amazing capabilities (1:17:03) Multimodal abilities unlock possibilities (1:25:03) Compare models for best task fit (1:26:24) Compare models using trial and error (1:36:15) AI and the future of work (1:42:29) GPT-4 can provide second opinions (1:45:06) AI safety discussion (1:50:20) AI permeates society cautiously (1:55:26) The AI revolution underway TWITTER: @CogRev_Podcast @Goodside (Riley) @scale_AI (Scale) @labenz (Nathan) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

Nathan Labenz dives in with Jaan Tallinn, a technologist, entrepreneur (Kazaa, Skype), and investor (DeepMind and more) whose unique life journey has intersected with some of the most important social and technological events of our collective lifetime. Jaan has since invested in nearly 180 startups, including dozens of AI application layer companies and some half dozen startup labs that focus on fundamental AI research, all in an effort to support the teams that he believes most likely to lead us to AI safety, and to have a seat at the table at organizations that he worries might take on too much risk. He's also founded several philanthropic nonprofits, including the Future of Life Institute, which recently published the open letter calling for a six-month pause on training new AI systems. In this discussion, we focused on: - the current state of AI development and safety -Jan's expectations for possible economic transformation - what catastrophic failure modes worry him most in the near term - How big of a bullet we dodged with the training of GPT-4 - Which organizations really matter for immediate-term pause purposes - How AI race dynamics are likely to evolve over the next couple of years Also, check out the debut of co-host Erik's new long-form interview podcast Upstream, whose guests in the first three episodes were Ezra Klein, Balaji Srinivasan, and Marc Andreessen. This coming season will feature interviews with David Sacks, Katherine Boyle, and more. Subscribe here: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 LINKS REFERENCED IN THE EPISODE: Future of Life's open letter: https://futureoflife.org/open-letter/pause-giant-ai-experiments/ Eliezer Yudkowsky's TIME article: https://time.com/6266923/ai-eliezer-yudkowsky-open-letter-not-enough/ Podcast: Daniela and Dario Amodei on Anthropic- https://podcasts.apple.com/ie/podcast/daniela-and-dario-amodei-on-anthropic/id1170991978?i=1000552976406 Zvi on the pause: https://thezvi.substack.com/p/on-the-fli-ai-risk-open-letter TIMESTAMPS: (0:00) Episode Preview (1:30) Jaan's impressive entrepreneurial career and his role in the recent AI Open Letter (3:26) AI safety and Future of Life Institute (6:55) Jaan's first meeting with Eliezer Yudkowsky and the founding of the Future of Life Institute (13:00) Future of AI evolution (15:55) Sponsor: Omneky (17:20) Jaan's investments in AI companies (24:22) The emerging danger paradigm (28:10) Economic transformation with AI (33:48) AI supervising itself (35:23) Language models and validation (40:06) Evolution, useful heuristics, and lack of insight into selection process (43:13) Current estimate for life-ending catastrophe (46:09) Inverse scaling law (54:20) Our luck given the softness of language models (56:24) Future of Language Models (1:01:00) The Moore’s law of mad science (1:03:02) GPT-5 type project (1:09:00) The AI race dynamics (1:11:00) AI alignment with the latest models (1:14:31) AI research investment and safety (1:21:00) What a six month pause buys us (1:27:01) AI’s Turing Test Passing (1:29:33) AI safety and risk (1:33:18) Responsible AI development. (1:41:20) Neuralink implant technology

Nathan Labenz and Erik Torenberg delve into the upcoming economic transformation and the future of work in light of the threshold crossed by GPT-4. Also, check out the debut of Erik's new long-form interview podcast "Upstream" with Erik Torenberg whose guests in the first three episodes were Ezra Klein, Balaji Srinivasan, and Marc Andreessen. This coming season will feature interviews with David Sacks, Katherine Boyle, and more. Subscribe here: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 LINKS REFERENCED IN THE EPISODE: Microsoft research paper: https://arxiv.org/abs/2303.12712 TIMESTAMPS: (0:00) Preview (1:56) Unpacking "There will be economic transformation," Nathan’s reflection after red teaming GPT-4 (4:55) A cross-section of prompts Nathan ran through GPT-4 (17:00) Sponsor: Omneky (18:00) Future of business and a new style of Taylorism of knowledge work (28:00) The “shrinking category of work” and a new definition of work (36:00) A future of “Muggles” and the 1000x developer (51:15) Are we facing a bifurcated economy and regulations from special interest groups? (58:30) Upcoming morale shift of white-collar workers and predictions TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

We've looked forward to today's episode since we launched the show! Andreas Stuhlmuller and Jungwon Byun are the co-founders of Ought, a product-driven research lab that develops mechanisms for delegating open-ended thinking to advanced machine learning systems. Their flagship product, Elicit (elicit.org), is an AI research assistant that helps researchers accelerate time-consuming workflows, starting with literature review. Also, check out the debut of Erik's new long-form interview podcast Upstream, whose guests in the first two episodes were Balaji Srinivasan and Marc Andreessen. This coming season will feature interviews with Ezra Klein, David Sacks, Katherine Boyle, and more. Subscribe here: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 LINKS REFERENCED IN EPISODE: Ought: https://ought.org/ Elicit: https://elicit.org/ TIMESTAMPS: (0:00) Preview (2:00) Nathan introduces the founders of Ought (4:20) Why doesn't AI serve better reasoning? (6:55) What limits the current paradigm (8:40) Reflections on the last six years of Ought’s research experiments of "composable thinking" (13:10) Error elimination mechanism is a shared challenge between human and AI systems (16:45) Sponsor: Omneky (18:00) Interpretability by construction product philosophy (25:00) Nathan’s personal experience using Elicit as a research assistant (30:00) Explicit concerns about model reasonings, and the importance of going a step further (36:00) What customers of OpenAI Foundry should consider (43:15) Evaluation challenges (48:15) Embeddings challenges (51:00) Vision for a knowledge work assembly line corporate paradigm (56:00) Ought's short-term approach to building: Understanding human ways of teaching the model to be more helpful (59:00) Wishful thinking versus real helpfulness (1:03:00) What's next for Elicit: expansion and new workflows (1:17:00) Zapier for reasoning (1:23:00) What are the most fundamental "magic questions" for all domains? (1:31:43) Significant impact of GPT4 (1:36:00) How people are using Elicit (1:44:00) AI Uncertainty and reason for hope (1:48:00) 3 lightning-round questions TWITTER: @CogRev_Podcast @jungofthewon @stuhlmueller @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

Anton Troynikov of Chroma and Flo Crivello of Lindy AI join The Cognitive Revolution cohosts Nathan Labenz and Erik Torenberg to debate the issues raised in the AI open letter, which advocates for a 6-month pause on AI system trainings. This episode was recorded on March 31st and was first released as a Moment of Zen episode (airing April 1). Subscribe to Moment of Zen for more timely debates like this one! Also, check out the debut of Erik's new long-form interview podcast Upstream, whose guests in the first two episodes were Balaji Srinivasan and Marc Andreessen. This coming season will feature interviews with Ezra Klein, David Sacks, Katherine Boyle, and more. Subscribe here: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 LINKS REFERENCED IN EPISODE:  Open letter: https://futureoflife.org/open-letter/pause-giant-ai-experiments/ Scott Aronson blog post: https://scottaaronson.blog/ TIMESTAMPS: (0:00) Preview of debate (3:10) Introduction from Nathan and explanation of the AI open letter (8:50) Anton’s skepticism of the open letter (12:14) Flo’s skepticism of the open letter (16:35) Nathan’s support for the open letter (22:52) Sponsor: Omneky (28:00) Differences between Flo and Anton’s positions (34:00) GPT4 is still dangerous (42:30) Luddites/“Pausers” are on the wrong side of history (47:44) Why not pause for 6 months? (56:30) Anton and Flo debate robotics (1:04:30) What we’re all scared of with AI (1:27:45) Is there an asymmetric risk with pausing or not pausing? TWITTER: @CogRev_Podcast @atroyn (Anton) @labenz (Nathan) @eriktorenberg (Erik) @altimor (Flo) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/ Thank you to Graham Bessellieu for production.

Nathan Labenz talks to Google Robotics researcher Keerthana Gopalakrishnan (@keerthanpg) about how they train robots at Google, and how robots contextualize their environment and complete tasks through supervised learning. They go deep on integrating language models for commands and how to approach translating them, as well as the importance of robotics safety. Keerthana also shares how we’re using robots to better understand ourselves, personal experiences using AI, and her hopes and fears about AI's impact on society. This episode provides valuable insights into the current state and potential future of robotics and AI, with Keerthana's expertise offering unique perspectives on these fascinating topics. (0:00) Preview to episode (0:51) Sponsor (1:09) Intro (5:20) GPT analogy for robotics (6:51) Domestic robots (10:53) Description of Google robotics (15:17) Controlling robots and supervised learning (18:50) How robots complete tasks (26:17) Using data to train robots (30:45) Data operability  (36:02) Integrating language models for commands (38:58) How to approach translating commands (42:49) How robots contextualize their environment (47:02) Approach to robotics safety (51:02) Tasks that robots can’t/shouldn’t do (54:08) The hard bounds of robotics (59:17) Frequency of inference (1:03:50) Form factor in robotics (1:08:38) Using robots to better understand ourselves (1:12:23) Having robot friends and spouses (1:17:44) Inference and latency (1:19:17) The Google Robotics team (1:21:07) AI tools Keerthana uses in her personal life *Thank you Omneky* for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Twitter: @CogRev_Podcast @keerthanpg (Keerthana) @labenz (Nathan) Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack Websites: cognitivervolution.ai omneky.com https://research.google/research-areas/robotics/ https://research.google/teams/brain/

In this episode, hosts Nathan Labenz and Erik Torenberg delve into the exciting and concerning aspects of GPT4, the latest large multimodal model from OpenAI. Nathan, who was a Red Teamer for GPT4, shares his experience working with the model, using it for real-life scenarios, and how he found it to be human-level rather than human-like intelligence. Nathan also highlights some of its fundamental weaknesses and limitations and shares the most concerning elements of GPT4. They end the episode pondering the arrival of GPT5 and whether we are in AI's "goldilocks moment." Check out the debut of Erik Torenberg's new podcast Upstream. This coming season features interviews with Marc Andreessen (Episode 1 live now), David Sacks, Ezra Klein, Balaji Srinivasan, Katherine Boyle, and more. Subscribe here: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 Timestamps for E11: Nathan Labenz and Erik Torenberg of The Cognitive Revolution Podcast (0:00) Preview of Nathan on this episode (1:13) Upstream: Erik's new interview show (1:41) Intro (5:40) Nathan's experience as a GPT4 Red Teamer (11:22) Catching the AI wave (14:30) Using GPT4 for real-life scenarios (17:33) Sponsor: Omneky (21:00) Human-level, not human-like intelligence (26:00) GPT4 weaknesses (28:14) More real-life use cases for GPT4 (35:25) Teaching AI to communicate within itself (40:25) GPT4’s limitations (44:32) Nathan's learnings from using GPT4 (46:56) Nathan joining the Red Team (47:29) The most concerning thing about GPT4 (1:05:42) GPT5 (1:06:42) Open AI's regulatory breadcrumbs (1:13:52) AI's goldilocks moment Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Twitter: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack

The development of ultra-realistic human voices is upon us, and Mahmoud Felfel's company Play.ht is leading the next generation of text-to-voice models. In this episode, we discuss the challenges and opportunities of automating a more human voice, as well as concerns about deep fakes and user safety. Also, you might be interested to check out the debut of Erik Torenberg's new podcast "Upstream". This coming season features interviews with Marc Andreessen (Episode 1 is out now), David Sacks, Ezra Klein, Balaji Srinivasan, Katherine Boyle, and more. Subscribe here: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 Timestamps: (0:00) Preview of Mahmoud on this episode  (0:55) Sponsor: Omneky.com  (1:45) Nathan clones his voice using Play.ht  (6:11) Why Mahmoud started Play.ht and the problem they tried to solve (13:08) The job to be done for Play.ht & how they’re thinking about APIs and models (24:45) Mahmoud breaks down the architecture of Play.ht (29:30) How the use cases have evolved  (30:00) New markets and opportunities with creators (37:00) Are we all about to become prompt engineers/directors? (44:50) Roadmap to other languages beyond English (48:00) Managing the compute(52:00) If AI-generated voices becomes a commodity, what will happen? (55:00) Why bigger companies are late adopters of AI tools (56:30) The long-term moat of Play.ht and other applications (1:00:00) Controversial voice-cloning and potential for societal abuse (1:10:32) Commonly abused voices (1:12:36) Rapid fire questions *Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.* Twitter: @CogRev_Podcast @_mfelfel (Mahmoud) @labenz (Nathan) Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack Websites: cognitivervolution.ai play.ht omneky.com

People have long been imagining AI assistants. Flo Crivello (founder of Teamflow) is turning that dream into a reality with the ambitious project Lindy. Flo sits down with Nathan on Lindy's announcement day to talk about this unique moment in AI, Lindy's capabilities, single-use apps, and how he sees the global impact that AI-powered employees can have on the future of work.  Anyone who mentions "The Cognitive Revolution" when signing up for the Lindy beta will get priority access.  (0:00) Preview  (1:05) Sponsor: Omneky  (4:50) Flo demos Lindy (9:21) Security and user experience  (11:55) How this AI moment compares to the Industrial Revolution and single use apps  (15:00) The dream AI assistant (19:54) Competition and advantages of startups  (24:28) Cost vs Quality  (31:19) How Lindy uses user data  (32:37) Context and data injection  (28:11) Comfort with ambiguity  (43:10) Use of guardrails and trust concerns  (47:26) AI safety and edge cases  (49:16) Impact on labor markets  (50:27) Economic resilience  (52:09) Future of work  (55:49) Rapid fire questions    *Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.  Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack  Websites:  lindy.ai *mention "The Cognitive Revolution" when you sign up for the waitlist to get priority access*  thecognitiverevolution.ai  Twitter:  @CogRev_Podcast  @labenz (Nathan)  @Altimor (Flo)

How will GPT4 change the world? How will US-China 'racing dynamics' play out and what are the implications for AI safety? Nathan Labenz was invited to record a special "emergency" episode of ChinaTalk podcast this week to discuss the implications GPT4 will have for policy, economics, and society. Thanks to Jordan Schneider of ChinaTalk, and fellow "AI justice league" guests Zvi Mowshowitz of 'Don't Worry About the Vase' and Matthew Mittelsteadt of Mercatus.    (0:00) Intro (2:09) GPT-4 emergency podcast (9:26) GPT-4 use cases (22:51) What GPT-4 can and can’t do (35:50) AI safety (45:38) OpenAI v. Anthropic  (48:54) Governments’ role in AI (55:50) AI will improve physical health and healthcare the most (59:19) Facebook’s LLaMA model (01:05:55) VR/AR (01:08:59) Concerns with GPT4 (01:15:26) GPT-5 and GPT-6 (01:18:45) Optimism in the AI revolution Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.   Twitter: @CogRev_Podcast @labenz (Nathan) @jordanschnyc (Jordan)  Websites: cognitivervolution.ai

We talked to Aravind Srinivas about competing with the tech giants, Perplexity's product philosophy and obsession with maximizing value delivered to the user per unit time, and the features that makes Perplexity unique. (0:00) Preview (1:31) Introduction & Context (08:06) Aravind’s vision for Perplexity as the world’s most truth-centric company (9:29) Raising the average IQ of the world (12:00) Aravind’s favorite tech entrepreneur (15:12) “Anthropics” - Building your own model vs user experience (33:00) Why is perplexity free (43:00) Talking shop: Perplexity’s tech stack and speed (1:06:00) Perplexity’s stance on guardrails on search (1:19:48) Forecasting weakly general AGI: The four criteria (1:28:00) Aravind’s perspective on OpenAI and the future of AGI (1:39:00) The Cognitive Revolution’s rapid fire questions: Neuralink implant? Most used AI tools? AI hopes and fears? Twitter handles: @CogRev_Podcast @AravSrinivas (Aravind) @labenz (Nathan) @eriktorenberg (Erik)  Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com/  References & Shownotes: Flamingo: https://www.deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model Decision Transformer Paper: https://arxiv.org/abs/2106.01345 Aravind on TalkRL Podcast: https://www.talkrl.com/episodes/aravind-srinivas-2 Weakly General AGI Criteria: https://www.metaculus.com/questions/3479/date-weakly-general-ai-is-publicly-known/

As recently as January 2021, the challenge of "interpreting what is going on in a photograph" was considered "nowhere near solved." Today's guests Junnan Li and Dongxu Li changed that with their publication and open-sourcing of BLIP, which delivered state-of-the-art performance on image captioning and other vision-language tasks. BLIP became the #18 most-cited AI paper of 2022, and now Junnan and Dongxu are back with BLIP-2, this time showing how small models can harness the power of existing foundation models to do multi-modal tasks. We talked to Junnan and Dongxu about their research and how they see the trend toward connector models shaping the future. Timestamps: (00:00) Preview (01:17) Sponsor (01:35) Intro (05:50) Convergence of AI techniques (07:33) Evolution of BLIP to BLIP-2 (08:12) How BLIP-2 unlocked multimodal functionality (12:43) The size, training dynamics, and optimization function of BLIP (20:15) Practical/Business applications of BLIP (29:43) Efficiency of BLIP-2 compared to other models (41:52) Two-stage pre-training (47:11) Architecture of Blip-2’s connector model (58:52) Language models as the executive function of the brain (01:07:32) Vision for an ultimate multimodal system and democratized pre-training for models (01:12:59) Useful AI tools in these researchers’ day-to-day (01:14:56) Upcoming projects   *Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.   Twitter: @CogRev_Podcast @LiJunnan0409 (Junnan Li) @DongxuLi_(Dongxu Li) @labenz (Nathan) @eriktorenberg (Erik)   Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com   Websites: Episode transcript at Cognitivervolution.ai huggingface.co/spaces/Salesforce/BLIP huggingface.co/spaces/Salesforce/BLIP2   Show Notes: - Original BLIP demo - BLIP 2 demo - BLIP is the #18 most highly-cited paper in AI - Image captioning comparison tool - Understanding images with AI - for use in language models and image generation - Image Aesthetics - Product & Model Reviews

(0:00) Preview (1:17) Sponsor  (4:00) Anton breaks down the advantages of vector databases (4:45) How embeddings have created an AI-native way to represent data (11:50) Anton identifies the watershed moment and step changes in AI (12:55) Open AI’s pricing (18:50) How chroma works (33:04) Stable Attribution and systematic bias (36:48) How latent diffusion models work (51:26) How AI is like the early days of aviation (56:01) How Disney inspired the release of Stable Attribution (59:53):Why noise can lead to generalization (1:01:04) Nathan’s KPI for The Cognitive Revolution (1:01:59) Other use cases for embedding (1:03: 19) Anton touches on the applications for biotech (1:04:35) Anton on doomerism hysteria and what actually worries him (1:11:43) - Nathan sums up a plausible doomer scenario (1:20:17)What AI tools does Anton use and why? (1:22:55) Anton’s hopes *Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.   Twitter: @CogRev_Podcast @atroyn (Anton) @labenz (Nathan) @eriktorenberg (Erik) Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com/ Websites: cognitivervolution.ai trychroma.com/ omneky.com   Show Notes & references: -https://same.energy/ (Beta) -Wright Brothers Bio (https://www.amazon.com/Wright-Brothers-David-McCullough/dp/1476728755) -Ajeya Cotra article in Less Wrong (https://www.lesswrong.com/posts/pRkFkzwKZ2zfa3R6H/without-specific-countermeasures-the-easiest-path-to)

(0:00) Preview of the debate (2:23) Sponsor (3:10) Flo’s take on the AI moment and AGI (5:45) Amjad’s take on the AI moment (8:03) Antonio's skepticism about transhumanism (9:10) Human tendencies color the debate about agency (11:25) The inflection point is a jump in generality (13:14) AI's effect on coding (16:57) Weakness in current models (19:18) Bounties and the future of work (21:48) Antonio's skepticism around bounties (25:00) Who will capture value, incumbents or startups? (27:26) "All knowledge work will be automated in 20 years" (30:10) Who will be the biggest beneficiaries of this shift? (31:50) What AI companies should VCs invest in? (32:26) SponsorThank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data, to generate personalized experiences at scale.  Twitter: @CogRev_Podcast @amasad (Amjad) @antoniogm (Antonio) @altimor (Flo) @dwr (Dan) @eriktorenberg (Erik) @labenz (Nathan) Subscribe to our Substack: https://cognitiverevolution.substack.com/  Websites: cognitivervolution.ai replit.com teamflowhq.com omneky.com   Show Notes & references: Eliezer Yudkowsky: https://www.lesswrong.com/posts/FKNtgZrGYwgsz3nHT/bankless-podcast-159-we-re-all-gonna-die-with-eliezer Paul Christiano: https://paulfchristiano.com/ AI Feedback: https://www.anthropic.com/constitutional.pdf  

(01:08) Sponsor (01:37) Introducing Eugenia  (03:25) Replika’s controversial choice to limit erotic roleplay functionality (04:25) Eugenia's vision for Replika (05:58) Augmented Reality is the Ultimate Modality (07:52) Using Replika (13:11) Profound stories about virtual assistants (15:55) Eugenia on why Replika is more than just a painkiller or vitamin (28:50) Replika's business model and profitability (34:12) Users want their Replika to surprise them (36:12) Why ChatGPT is not a conversational model (49:26) Eugenia's prediction for the "next Iphone of personal AI" (1:03:00) Eugenia’s AI tools/stack   (1:15:00) Eugenia comes back to discuss Erotic Roleplay controversy  (1:18:00) Replika’s first reaction to users ERP (1: 22:00) How the product evolved from 90% scripts & retrieval models (1:24:00) The definitive focus for Replika to stay in a PG13 zone (1:26:00) “Normal” evolution given sci-fi depictions of AI romances (1:30:00) Current AI ethics on sexuality (1:37:07) Response to journalists misportrayal (1:40:29) Sponsor Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale. Twitter: @CogRev_Podcast @eriktorenberg (Erik) @labenz (Nathan) @ekuyda (Eugenia)   Websites: cognitivervolution.ai https://replika.ai/

00:00 Coming Up 01:00 The Cognitive Revolution 01:20 Sponsor 01:39 Intro 02:09 Nathan’s path to AI  04:27 Founding Waymark 06:56 The future of AI is just starting  10:00 AI dramatically enhances human capabilities  10:50 Why we started The Cognitive Revolution and what to expect 14:55 Which guests will appear on the show and topics that will be discussed 18:59 Being replaced by an AI host 20:42 Unpacking the future of AI with “no new breakthroughs”  32:21 What’s underhyped and overhyped 43:46 The dangers of AI 44:51 Applying AI safely  52:19 Losing faith in technology 53:38 A new AI ecology 55:14 Facebook, Google and Open AI 58:00 Upside and downside case for AI  58:18 Sam Altman’s case for AI 01:09:25 Starting an AI company 01:18:22 Closing 01:18:46 Sponsor   Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.   Twitter: @CogRev_Podcast @eriktorenberg (Erik) @labenz (Nathan)   Websites: cognitivervolution.ai waymark.com

00:00 Intro 00:30: Image technology breakthroughs 00:45 The Cognitive Revolution 03:10 Intro to Suhail 03:43 Sponsor 07:04 Suhail’s path to AI 12:57 Suhail’s vision for Playground 17:58 Suhail’s cancellation on Twitter 19:06 AI artists are artists 20:25 Non-AI artists feel threatened by AI 26:47 Suhail on defensibility at AI companies 30:30 Playground’s product roadmap 33:01 Suhail on good design 35:55 Latent space 44:04 Building Playground with lessons learned from Mighty 53:55 Monitoring led to 2x improvement in the product 55:53 How people use Playground 1:03:48 AI is having it’s mobile moment 01:15:12 Finding, investing and building durable AI companies 01:22:06 Suhail’s kid’s best friends may be AI characters   01:23:20 AI religion 01:24:16 Conclusion   Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.   Twitter: @CogRev_Podcast @eriktorenberg (Erik) @suhail (Suhail) @labenz (Nathan)   Websites: playgroundai.com mixpanel.com  waymark.com