Data Lake Development with Big Data

Data Lake Development with Big Data
Author :
Publisher : Packt Publishing Ltd
Total Pages : 164
Release :
ISBN-10 : 9781785881664
ISBN-13 : 1785881663
Rating : 4/5 (663 Downloads)

Book Synopsis Data Lake Development with Big Data by : Pradeep Pasupuleti

Download or read book Data Lake Development with Big Data written by Pradeep Pasupuleti and published by Packt Publishing Ltd. This book was released on 2015-11-26 with total page 164 pages. Available in PDF, EPUB and Kindle. Book excerpt: Explore architectural approaches to building Data Lakes that ingest, index, manage, and analyze massive amounts of data using Big Data technologies About This Book Comprehend the intricacies of architecting a Data Lake and build a data strategy around your current data architecture Efficiently manage vast amounts of data and deliver it to multiple applications and systems with a high degree of performance and scalability Packed with industry best practices and use-case scenarios to get you up-and-running Who This Book Is For This book is for architects and senior managers who are responsible for building a strategy around their current data architecture, helping them identify the need for a Data Lake implementation in an enterprise context. The reader will need a good knowledge of master data management and information lifecycle management, and experience of Big Data technologies. What You Will Learn Identify the need for a Data Lake in your enterprise context and learn to architect a Data Lake Learn to build various tiers of a Data Lake, such as data intake, management, consumption, and governance, with a focus on practical implementation scenarios Find out the key considerations to be taken into account while building each tier of the Data Lake Understand Hadoop-oriented data transfer mechanism to ingest data in batch, micro-batch, and real-time modes Explore various data integration needs and learn how to perform data enrichment and data transformations using Big Data technologies Enable data discovery on the Data Lake to allow users to discover the data Discover how data is packaged and provisioned for consumption Comprehend the importance of including data governance disciplines while building a Data Lake In Detail A Data Lake is a highly scalable platform for storing huge volumes of multistructured data from disparate sources with centralized data management services. This book explores the potential of Data Lakes and explores architectural approaches to building data lakes that ingest, index, manage, and analyze massive amounts of data using batch and real-time processing frameworks. It guides you on how to go about building a Data Lake that is managed by Hadoop and accessed as required by other Big Data applications. This book will guide readers (using best practices) in developing Data Lake's capabilities. It will focus on architect data governance, security, data quality, data lineage tracking, metadata management, and semantic data tagging. By the end of this book, you will have a good understanding of building a Data Lake for Big Data. Style and approach Data Lake Development with Big Data provides architectural approaches to building a Data Lake. It follows a use case-based approach where practical implementation scenarios of each key component are explained. It also helps you understand how these use cases are implemented in a Data Lake. The chapters are organized in a way that mimics the sequential data flow evidenced in a Data Lake.


Data Lake Development with Big Data Related Books

Data Lake Development with Big Data
Language: en
Pages: 164
Authors: Pradeep Pasupuleti
Categories: Computers
Type: BOOK - Published: 2015-11-26 - Publisher: Packt Publishing Ltd

GET EBOOK

Explore architectural approaches to building Data Lakes that ingest, index, manage, and analyze massive amounts of data using Big Data technologies About This B
The Enterprise Big Data Lake
Language: en
Pages: 232
Authors: Alex Gorelik
Categories: Computers
Type: BOOK - Published: 2019-02-21 - Publisher: "O'Reilly Media, Inc."

GET EBOOK

The data lake is a daring new approach for harnessing the power of big data technology and providing convenient self-service capabilities. But is it right for y
Data Lake Analytics on Microsoft Azure
Language: en
Pages: 228
Authors: Harsh Chawla
Categories: Computers
Type: BOOK - Published: 2020-11-15 - Publisher: Apress

GET EBOOK

Get a 360-degree view of how the journey of data analytics solutions has evolved from monolithic data stores and enterprise data warehouses to data lakes and mo
Practical Enterprise Data Lake Insights
Language: en
Pages: 335
Authors: Saurabh Gupta
Categories: Computers
Type: BOOK - Published: 2018-07-29 - Publisher: Apress

GET EBOOK

Use this practical guide to successfully handle the challenges encountered when designing an enterprise data lake and learn industry best practices to resolve i
Big Data Applications in Industry 4.0
Language: en
Pages: 447
Authors: P. Kaliraj
Categories: Business & Economics
Type: BOOK - Published: 2022-02-09 - Publisher: CRC Press

GET EBOOK

Industry 4.0 is the latest technological innovation in manufacturing with the goal to increase productivity in a flexible and efficient manner. Changing the way