AM3: Data Lake Architecture: Evolving from the Data Warehouse to Big Data Analytics

Traditional data warehouses were built with online transaction processing (OLTP) technology and architecture that today can be 15-20 years old. These data warehouses were right for the time, but not designed to handle the volume, variety and velocity of information that businesses are faced with today. Over the years we tried to fit more and more data into these warehouses, and the result has been an over-burdened system offering a not very optimal way to access data in today’s data-driven world.

Companies can benefit from new technologies and innovative approaches to modernizing the warehouse for improved performance. There are new and existing technologies that, when blended effectively, can deepen business understanding through data analytics and support business needs. Moving to the data lake paradigm can mean scalable, agile performance and storage, and processing solutions for all data – whether structured, semi-structured, or even streaming data. In this session, I share:

Strategies to move from traditional data warehouse culture to the Big Data Lake
Guidance for designing a process for how the EDW can respond to the Big Data Analytics need
Understanding and maximizing the relationship of big data, Hadoop, and analytics
Steps for Using the Data Lake to “Put it all Together” - Ingest, Organize/Define/Complete, Blend and Learn, Report
Case study examples of how establishing a Data Lake can be a game-changer for today’s organization
Lessons Learned from client engagements

Joe Caserta is a celebrated big data strategy consultant, author, educator and CEO of Caserta Concepts, an award-winning strategic consulting and innovation technology implementation firm. His company specializes in Transformative Data Strategies, Modern Data Engineering, Advanced Analytics, Strategic Consulting & Technical Architecture, and Design & Build Solutions. Joe is the co-author of the industry best-selling book, The Data Warehouse ETL Toolkit (Wiley 2004), a contributor to industry publications, and frequent keynote speaker and expert panelist at conferences and events. He also serves on the advisory boards of financial and technical institutions, and is the organizer and host of the Big Data Warehousing Meetup Group in NYC.

Greg Wells is the Director of Business Solutions at Caserta Concepts, an award-winning strategic consulting and innovation technology implementation firm. He is well versed in data best practices, industry trends and competitor offerings. He also maintains the firm’s business partner relationships. With more than two decades of career expertise in data solutions, digital marketing & business development, Greg's primary role is to create, grow and retain client relationships by meeting with companies to discuss current business challenges and analytics needs. He also collaborates with the Caserta marketing team on client development materials, industry events, annual conferences and social media efforts.