Episodes

  • From black holes to AI in mathematics: AI Innovation in Mathematics and Health with Yaron Hadad
    Feb 4 2025

    In this episode, we chat with Yaron Hadad, a fascinating individual who transitioned from theoretical physics to entrepreneurship.

    We explore his groundbreaking work on black holes and gravitational waves, and learn about the Ramanujan Machine - an algorithmic system he helped develop that discovers new mathematical formulas and democratizes mathematical research. We'll hear about the scientific community's mixed reactions to this innovative approach.

    The conversation then shifts to his work with Neutrino, a company he founded that uses AI and continuous monitoring devices to understand how food affects individual health. We delve into the complexities of nutrition science, the challenges of processing multiple data streams, and the future of personalized health monitoring.

    Throughout the episode, Yaron shares insights on bridging theoretical research with practical applications, and the role of AI in advancing both pure mathematics and healthcare.

    00:00 Yaron Hadad's Journey: From Physics to AI in Healthcare
    04:50 The Complexity of Einstein's Equations and Their Solutions
    10:12 AI in Mathematics: The Ramanujan Machine and Conjectures
    15:41 Navigating Criticism: The Scientific Community's Response to Innovation
    29:24 The Impact of Algorithms in Mathematics
    35:30 The Planck Machine: A New Approach
    41:15 Neutrino: A Personal Journey in Nutrition
    50:11 Connecting Food Complexity to Health Metrics

    Show More Show Less
    59 mins
  • Building a Native Search Engine in PostgreSQL: ParadeDB's Journey to Replace Elasticsearch with Philippe Noël
    Jan 16 2025

    In this episode, we chat with Philippe Noël, founder of ParadeDB, about building an Elasticsearch alternative natively on PostgreSQL.

    We explore the challenges and benefits of extending PostgreSQL versus building a separate system, diving into topics like full-text search, faceted analytics, and why organizations need these capabilities.

    We discuss the emerging bring-your-own-cloud deployment model, the state of the PostgreSQL extension ecosystem, and what makes a truly production-ready database extension.

    Philippe shares insights on the future of search technology and how recent AI developments are actually increasing the demand for traditional search capabilities.

    The conversation also covers the misconceptions around PostgreSQL's scalability and the trade-offs between multi-tenant and single-tenant architectures in modern data infrastructure.

    Chapters

    00:00 Introduction to ParadeDB and Its Mission
    06:35 User-Facing Search and Analytics
    11:45 The Role of Postgres in Modern Data Solutions
    17:30 Future of Multimodal Databases
    31:04 The Rise of Fintech and Data Integrity
    36:36 Deployment Models: BYOC and Control Plane
    43:41 The Evolution of Cloud Infrastructure and Serverless Databases
    49:38 The Future of Search and Community Engagement

    Click here to view the episode transcript.

    Show More Show Less
    1 hr
  • Optimizing SQL with LLMs: Building Verified AI Systems at Espresso AI with Ben Lerner
    Jan 3 2025

    In this episode, we chat with Ben, founder of Espresso AI, about his journey from building Excel Python integrations to optimizing data warehouse compute costs.

    We explore his experience at companies like Uber and Google, where he worked on everything from distributed systems to ML and storage infrastructure.

    We learn about the evolution of his latest venture, which started as a C++ compiler optimization project and transformed into a system for optimizing Snowflake workloads using ML.

    Ben shares insights about applying LLMs to SQL optimization, the challenges of verified code transformation, and the importance of formal verification in ML systems. Finally, we discuss his practical approach to choosing ML models and the critical lesson he learned about talking to users before building products.

    Chapters

    00:00 Ben's Journey: From Startups to Big Tech
    13:00 The Importance of Timing in Entrepreneurship
    19:22 Consulting Insights: Learning from Clients
    23:32 Transitioning to Big Tech: Experiences at Uber and Google
    30:58 The Future of AI: End-to-End Systems and Data Utilization
    35:53 Transitioning Between Domains: From ML to Distributed Systems
    44:24 Espresso's Mission: Optimizing SQL with ML
    51:26 The Future of Code Optimization and AI

    Click here to view the episode transcript.

    Show More Show Less
    1 hr and 6 mins
  • Security as Code: Building Developer-First Security Tools with David Mytton
    Dec 19 2024

    In this episode, we chat with David Mytton, founder and CEO of Arcjet and creator of console.dev.

    We explore his journey from building a cloud monitoring startup to founding a security-as-code company. David shares fascinating insights about bot detection, the challenges of securing modern applications, and why traditional security approaches often fail to meet developers' needs.

    We discuss the innovative use of WebAssembly for high-performance security checks, the importance of developer experience in security tools, and the delicate balance between security and latency.

    The conversation also covers his work on environmental technology and cloud computing sustainability, as well as his experience reviewing developer tools for console.dev, where he emphasizes the critical role of documentation in distinguishing great developer tools from mediocre ones.

    Chapters

    00:00 Introduction to David Mytton and Arcjet
    07:09 The Evolution of Observability
    12:37 The Future of Observability Tools
    18:19 Innovations in Data Storage for Observability
    23:57 Challenges in AI Implementation
    31:33 The Dichotomy of AI and Human Involvement
    36:17 Detecting Bots: Techniques and Challenges
    42:46 AI's Role in Enhancing Security
    47:52 Latency and Decision-Making in Security
    52:40 Managing Software Lifecycle and Observability
    58:58 The Role of Documentation in Developer Tools

    Click here to view the episode transcript.

    Show More Show Less
    1 hr and 4 mins
  • Dev Environments in the AI Era: Standardizing Development Infrastructure with Daytona's Ivan
    Dec 4 2024

    In this episode, we chat with Ivan, co-founder and CEO of Daytona, about the evolution of developer environments and tooling.

    We explore his journey from founding CodeAnywhere in 2009, one of the first browser-based IDEs, to creating the popular Shift developer conference, and now building Daytona's dev environment automation platform. We discuss the changing landscape of development environments, from local-only setups to today's complex hybrid configurations, and why managing these environments has become increasingly challenging.

    Ivan shares insights about open source business models, the distinction between users and buyers in dev tools, and what the future holds for AI-assisted development. We also learn about Daytona's unique approach to solving dev environment complexity through standardization and automation, and get Ivan's perspective on the future of IDE companies in an AI-driven world.

    Chapters

    00:00 Introduction to Ivan and Daytona
    07:22 Understanding Development Environments
    13:59 The User vs. Buyer Dilemma
    22:20 Open Source Strategy and Community Building
    29:22 How Daytona Works and Its Value Proposition
    37:44 Emerging Trends in Collaborative Coding
    44:38 Latency Challenges in AI-Assisted Development
    50:41 The Future of Developer Tooling Companies
    01:02:29 Lessons from Organizing Conferences

    Show More Show Less
    1 hr and 9 mins
  • Evolving Data Infrastructure for the AI Era: AWS, Meta, and Beyond with Roy Ben-Alta
    Nov 21 2024

    In this episode, we chat with Roy Ben-Alta, co-founder of Oakminer AI and former director at Meta AI Research, about his fascinating journey through the evolution of data infrastructure and AI. We explore his early days at AWS when cloud adoption was still controversial, his experience building large language models at Meta, and the challenges of training and deploying AI systems at scale. Roy shares valuable insights about the future of data warehouses, the emergence of knowledge-centric systems, and the critical role of data engineering in AI. We'll also hear his practical advice on building AI companies today, including thoughts on model evaluation frameworks, vendor lock-in, and the eternal "build vs. buy" decision. Drawing from his extensive experience across Amazon, Meta, and now as a founder, Roy offers a unique perspective on how AI is transforming traditional data infrastructure and what it means for the future of enterprise software.

    Chapters

    00:00 Introduction to Roy Benalta and AI Background
    04:07 Warren Buffett Experience and MBA Insights
    06:45 Lessons from Amazon and Meta Leadership
    09:15 Early Days of AWS and Cloud Adoption
    12:12 Redshift vs. Snowflake: A Data Warehouse Perspective
    14:49 Navigating Complex Data Systems in Organizations
    31:21 The Future of Personalized Software Solutions
    32:19 Building Large Language Models at Meta
    39:27 Evolution of Data Platforms and Infrastructure
    50:50 Engineering Knowledge and LLMs
    58:27 Build vs. Buy: Strategic Decisions for Startups

    Show More Show Less
    1 hr and 3 mins
  • From Functions to Full Applications: How Serverless Evolved Beyond AWS Lambda with Nitzan Shapira
    Nov 6 2024

    In this episode, we chat with Nitzan Shapira, co-founder and former CEO of Epsagon, which was acquired by Cisco in 2021. We explore Nitzan's journey from working in cybersecurity to building an observability platform for cloud applications, particularly focused on serverless architectures. We learn about the early days of serverless adoption, the challenges in making observability tools developer-friendly, and why distributed tracing was a key differentiator for Epsagon. We discuss the evolution of observability tools, the future impact of AI on both observability and software development, and the changing landscape of serverless computing. Finally, we hear Nitzan's current perspective on enterprise AI adoption from his role at Cisco, where he helps evaluate and build new AI-focused business lines.

    03:17 Transition from Security to Observability
    09:52 Exploring Ideas and Choosing Serverless
    16:43 Adoption of Distributed Tracing
    20:54 The Future of Observability
    25:26 Building a Product that Developers Love
    31:03 Challenges in Observability and Data Costs
    32:47 The Excitement and Evolution of Serverless
    35:44 Serverless as a Horizontal Platform
    37:15 The Future of Serverless and No-Code/Low-Code Tools
    38:15 Technical Limits and the Future of Serverless
    40:38 Navigating Near-Death Moments and Go-to-Market Challenges
    48:36 Cisco's Gen .AI Ecosystem and New Business Lines
    50:25 The State of the AI Ecosystem and Enterprise Adoption
    53:54 Using AI to Enhance Engineering and Product Development
    55:02 Using AI in Go-to-Market Strategies

    Show More Show Less
    58 mins
  • From GPU Compilers to architecting Kubernetes: A Conversation with Brian Grant
    Oct 22 2024

    From GPU computing pioneer to Kubernetes architect, Brian Grant takes us on a fascinating journey through his career at the forefront of systems engineering. In this episode, we explore his early work on GPU compilers in the pre-CUDA era, where he tackled unique challenges in high-performance computing when graphics cards weren't yet designed for general computation. Brian then shares insights from his time at Google, where he helped develop Borg and later became the original lead architect of Kubernetes. He explains key architectural decisions that shaped Kubernetes, from its extensible resource model to its approach to service discovery, and why they chose to create a rich set of abstractions rather than a minimal interface. The conversation concludes with Brian's thoughts on standardization challenges in cloud infrastructure and his vision for moving beyond infrastructure as code, offering valuable perspective on both the history and future of distributed systems.

    Links:
    Brian Grant LI

    Chapters

    00:00 Introduction and Background
    03:11 Early Work in High-Performance Computing
    06:21 Challenges of Building Compilers for GPUs
    13:14 Influential Innovations in Compilers
    31:46 The Future of Compilers
    33:11 The Rise of Niche Programming Languages
    34:01 The Evolution of Google's Borg and Kubernetes
    39:06 Challenges of Managing Applications in a Dynamically Scheduled Environment
    48:12 The Need for Standardization in Application Interfaces and Management Systems
    01:00:55 Driving Network Effects and Creating Cohesive Ecosystems

    Click here to view the episode transcript.

    Show More Show Less
    1 hr and 2 mins