Join us as we sit down with Joe Reis, live at Big Data LDN (London) 2024. Joe shares his partnership with DeepLearning.ai and AWS through his new course on Data Engineering. Joe’s new course promises to elevate your data skills with hands-on exercises that marry foundational knowledge with cutting-edge practices. We dive into how this course complements his seminal book, “Fundamentals of Data Engineering,” and why certification is valuable for those looking for foundational, hands-on knowledge to be a data practitioner.

But that’s not all; we also dissect the hurdles of adopting modern data architectures like data mesh in traditionally siloed companies. Using Conway’s Law as a lens, Joe discuss why businesses struggle to transition from outdated infrastructures to decentralized systems and how cross-disciplinary skills—a concept inspired by mixed martial arts—are crucial in this endeavor as he cleverly calls it ‘Mixed Model Arts’.

Check out Joe’s Work:

Fundamentals of Data Engineering book on Amazon: https://a.co/d/8yvabfO
New Coursera courses by Joe Reis: https://www.coursera.org/instructor/j…

What’s New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What’s New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Can AI really make your data analysis as easy as talking to a friend? Join us for an enlightening conversation with Ethan Ding, the co-founder and CEO of TextQL, as he shares his journey from Berkeley graduate to pioneering the text-to-SQL technology that’s transforming how businesses interact with their data. Discover how natural language queries are breaking down barriers, making data analysis accessible to everyone, regardless of technical skill. Ethan delves into the historical hurdles and the game-changing advancements that are pushing the boundaries of AI and large language models in data querying.

Ever wondered how the quest for full autonomy in self-driving cars relates to data querying? We draw fascinating parallels between these two cutting-edge fields, emphasizing the importance of structured systems over chaotic, AI-driven approaches. This chapter reveals the often-overlooked limitations of current data management practices and underscores the critical need for high-quality data and robust modeling. Through a comparison of traditional business intelligence tools and advanced AI-driven solutions, we explore what truly makes data querying effective and insightful.

Hear from Ethan Deng, co-founder and CEO of TextQL, as he explains how their innovative tool integrates seamlessly with existing BI infrastructures, boosting productivity without the need for disruptive overhauls. Tune in to find out how TextQL is making data-driven decisions faster and smarter, paving the way for a future where data is everyone’s best friend.

Follow Ethan Ding and TextQL at:

• Ethan’s LinkedIn: / theethanding
• Ethan’s Twitter: https://x.com/TheEthanDing
• TextQL’s LinkedIn: / textql
• TextQL’s Twitter: https://x.com/textql
• TextQL’s website: https://www.textql.com/

What makes MotherDuck and DuckDB a game-changer for data analytics? Join us as we sit down with Jacob Matson, a renowned expert in SQL Server, dbt, and Excel, who recently became a developer advocate at MotherDuck.

During this episode, Jacob shares his compelling journey to MotherDuck, driven by his frequent use of DuckDB for solving data challenges. We explore the unique attributes of DuckDB, comparing it to SQLite for analytics, and uncover its architectural benefits, such as utilizing multi-core machines for parallel query execution. Jacob also sheds light on how MotherDuck is pushing the envelope with their innovative concept of multiplayer analytics.

Our discussion takes a deep dive into MotherDuck’s innovative tenancy model and how it impacts database workloads, highlighting the use of DuckDB format in Wasm for enhanced data visualization. Jacob explains how this approach offers significant compression and faster query performance, making data visualization more interactive. We also touch on the potential and limitations of replacing traditional BI tools with Mosaic, and where MotherDuck stands in the modern data stack landscape, especially for organizations that don’t require the scale of BigQuery or Snowflake. Plus, get a sneak peek into the upcoming Small Data Conference in San Francisco on September 23rd, where we’ll explore how small data solutions can address significant problems without relying on big data. Don’t miss this episode packed with insights on DuckDB and MotherDuck innovations!

Small Data SF Signup
Discount Code: MATSON100

Prepare to transform your understanding of data and cloud architecture with visionary CEO Alex Gallego of Redpanda. Discover how Alex’s journey from building racing motorcycles and tattoo machines as a child led him to revolutionize stream processing and cloud infrastructure. This episode promises invaluable insights into the shift from batch to real-time data processing, and the practical applications across multiple industries that make this transition not just beneficial but necessary.

Explore the intricate challenges and groundbreaking innovations in data storage and streaming. From Kafka’s distributed logs to the pioneering Redpanda, Alex shares the operational advantages of streaming over traditional batch processing. Learn about the core concepts of stream processing through real-world examples, such as fraud detection and real-time reward systems, and see how Redpanda is simplifying these complex distributed systems to make real-time data processing more accessible and efficient for engineers everywhere.

Finally, we delve into emerging trends that are reshaping the landscape of data infrastructure. Examine how lightweight, embedded databases are revolutionizing edge computing environments and the growing emphasis on data sovereignty and “Bring Your Own Cloud” solutions. Get a glimpse into the future of data ownership and AI, where local inferencing and traceability of AI models are becoming paramount. Join us for this compelling conversation that not only highlights the evolution from Kafka to Redpanda but paints a visionary picture of the future of real-time systems and data architecture.

What’s New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What’s New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Imagine losing your most important digital keys and leaving your entire kingdom vulnerable to attacks. In this episode, we promise to equip you with the knowledge to prevent such disasters. Join us as we sit down with Brian Vallelunga, the CEO and founder of Doppler, to unravel the critical importance of secrets management in software development. Brian shares his deep expertise on what secrets are—those crucial digital keys that unlock access to sensitive data—and illustrates through a personal story the severe consequences of failing to protect them. Discover how data breaches can wreak havoc, leading to brand reputation damage, customer churn, legal battles, and even personal distress.

But it’s not all doom and gloom. Brian introduces us to Doppler, a game-changing tool that simplifies the tedious process of secrets management, making it an integral part of the modern development workflow. Learn how Doppler empowers developers to secure sensitive data efficiently, eliminating common headaches like managing environment files and manual secret updates. We also delve into practical implementation timelines, showing that effective secrets management is achievable for companies of all sizes with the right tools. Brian provides actionable advice for engineering teams on securing secrets within applications and highlights valuable resources for further learning. Tune in to safeguard your company’s digital assets and fortify your secrets management strategy.

Follow Brian on:
– doppler.com
– X (Twitter) – @vallelungabrian

What’s New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What’s New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

What’s New in Data’s Live Recording from the Salesforce Tower during Snowflake Summit

Imagine a world where real-time data processing is the norm, not the exception. In this episode, we bring you a fascinating conversation with Sanjeev Mohan, former VP at Gartner, who unpacks the seismic shifts in the data processing landscape. You’ll learn about the convergence of structured and unstructured data, driven by Generative AI, and why streaming is becoming the default method for data processing. Sanjeev highlights the significance of innovations like Iceberg, which create a common table format essential for decision-making across a variety of applications.

We then traverse the cutting-edge realm of real-time data streaming platforms, spotlighting technologies and companies such as Materialize and Apache Grid Gain. Sanjeev explains the essential design criteria for these platforms, including scalability, cost performance, and fault tolerance. He also discusses the pivotal role of Kafka and its implementations across major cloud providers. This episode is a treasure trove of insights into how platforms like Snowflake are being utilized beyond their traditional roles to act as streaming databases, redefining the boundaries of data management.

In our final segments, we accelerate into the future, examining the rapid advancements in streaming technology and its interplay with AI. Sanjeev reflects on how applications like Tesla and Uber are driving innovation and demonstrates the complexities of handling real-time data replication with tools like Snowpipe Streaming. We also explore the potential for real-time training of Large Language Models (LLMs) and the ever-evolving landscape of data management. Packed with expert analysis and future-forward thinking, this episode is your guide to understanding the groundbreaking technologies shaping the world of data.

Can high-quality data be the key to unlocking the full potential of generative AI? Join us for an enlightening discussion with Nicola Askham, the Data Governance Coach, as she takes us on a journey from her early days at a large British bank to becoming a leading figure in data governance. Nicola sheds light on the current landscape of data governance, the unique challenges data teams face today, and the indispensable role it plays in the success of advanced technologies like generative AI. Through her expert lens, we examine how integrating AI governance and adhering to data privacy and security standards are not just important but essential for leveraging AI effectively.

In the second half of our conversation, Nicola shares actionable strategies to implement data governance in your organization. Discover how to identify real data problems and engage senior stakeholders by demonstrating data gaps. Learn about the power of collaborative workshops in creating conceptual data models and fostering a sense of ownership among business users. Nicola also guides us through the evolution from technical role-based access control to a holistic enterprise-wide data governance approach. Plus, hear her take on the exciting potential of generative AI to enhance data quality processes, making the dream of accessible and effective data governance a reality.

Follow Nicola at:

– Data Governance Coach website: https://www.nicolaaskham.com/

– LinkedIn:   / nicolaaskham  

– The Data Governance Podcast: https://www.nicolaaskham.com/podcast

Ever wondered how to turn data into actionable insights? Join us as we sit down with Elena Dyachkova, the head of data at Bubble, who has an impressive background leading data teams at industry giants like Peloton and Spring Health. Elena walks us through her inspiring journey from economics to product analytics, shedding light on the critical role data plays in decision-making. She shares how simple analytics methods can be just as impactful as complex models, making this a must-listen for anyone looking to improve their analytical skills.

Data accuracy and reliability are paramount, especially when working with business applications like Stripe. Elena provides a deep dive into the challenges data teams face, from API changes to schema updates, and stresses the importance of proactive monitoring and observability. We discuss how to build strong heuristics and set realistic expectations with stakeholders to ensure seamless data flows. This segment is packed with practical advice for data professionals looking to navigate the complexities of modern data environments.

Continuous learning is at the heart of effective product analytics. Elena reflects on the evolution of education in this field, pointing out the gap that once existed and how diverse courses on business metrics, growth strategy, and experimentation have filled it. We explore the significance of data collection, structure, and engineer collaboration, all essential for robust product analysis. Elena also discusses the importance of maintaining a mindset geared towards iterative testing and learning, helping you avoid the dreaded analysis paralysis. Don’t miss her references to key figures and literature that have influenced her journey.

Follow Elena on:

LinkedIn –   / edyachkova  

X – @ElenaRunsNYC

Substack Blog: Dramatic Analyst – https://dramaticanalyst.substack.com/

UpLimit Course: Product Analytics – https://uplimit.com/course/product-an…

What’s New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What’s New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Unlock the secrets of AI’s transformative power with latest episode live from Google Next, where UPS’s story takes center stage. Joined by AI trailblazers like Bruno Aziza of CapitalG and Pinaki Mitra from UPS, we delve into how UPS is tackling package theft and reshaping package delivery. This isn’t just another discussion; it’s a firsthand look at how AI and data analytics converge to solve real-world challenges, improving security and efficiency in the e-commerce landscape.

Ever wonder how AI can streamline your business operations? Our panelists, including Sanjeev Mohan of Sanjmo and Alok Pareek from Striim, reveal the nuts and bolts of integrating AI into supply chain processes and the pivotal role of data lifecycle management. From enhancing address validation to offering insights for small and medium enterprises, we uncover the practical benefits of AI and the importance of a meticulous approach to data management. Get ready to be inspired by the parallels drawn between packet delivery and data event observability, and the critical steps for aligning AI with your business strategy.

We wrap up by exploring the broad implications of generative AI across industries, with case studies that will alter your perspective on AI’s potential. Whether it’s summarizing legal documents or mining data for pharmaceutical insights, the versatility of AI is showcased in its full glory.

We extend our heartfelt thanks to our live audience and listeners, encouraging you to engage with the innovative ideas shared at Google Cloud Next and reminding you of the importance of robust data foundations in harnessing AI’s full potential.

Join us for a conversation that promises not just to inform but to transform the way you view the intersection of AI and business.

“UPS AI Battle Porch Pirates.” ABC News, Good Morning America. Accessed April 10th, 2024. https://abcnews.go.com/GMA/News/video….

What’s New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What’s New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.

Discover the unexpected pathways that can lead to a thriving career in data science as Lindsay Pettingill, PhD, and Director of Data Science at Replit, joins us for a riveting conversation. Lindsay’s journey—from a Fulbright scholar teaching in Germany to shaping Airbnb’s hyper-growth period—is a testament to the value of curiosity and an analytical mindset. Her insights promise to guide and inspire, whether you’re a seasoned professional or just starting out in the data world.

We get to the heart of what truly powers data science: curiosity and intuition. Lindsay advocates for a holistic approach to data, stressing the need for professionals to develop insights and propose business hypotheses. This fascinating discussion also covers how personal traits, such as proactivity shown through cold outreach, are becoming indispensable as technical tasks undergo automation. Lindsay’s experiences underscore the evolution of the data scientist’s role, from crunching numbers to being a strategic business influencer.

Finishing on a high note, our episode focuses on the delicate dance of data-driven decision-making within organizations. Lindsay reflects on her leadership experiences, particularly during the turbulent times at Airbnb, and shares her evolved perspective on leadership in product strategy. She emphasizes the need for data teams to contribute meaningfully to their organizations, beyond technical expertise, and offers insights on how to empower data professionals to make a significant business impact. Tune in to gain valuable lessons from a leader who has successfully navigated the waves of change in the data science industry.

Follow Lindsay on:

Twitter: @iam_lpettingill

Website: https://lindsaypettingill.com/

What’s New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What’s New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.