{"product_id":"data-engineering-with-databricks-cookbook-build-effective-data-and-ai-solutions-using-apache-spark-databricks-and-delta-lake-paperback","title":"Data Engineering with Databricks Cookbook: Build effective data and AI solutions using Apache Spark, Databricks, and Delta Lake - Paperback","description":"\u003cp\u003eby \u003cb\u003ePulkit Chadha\u003c\/b\u003e (Author)\u003c\/p\u003e\u003cp\u003e\u003c\/p\u003e\u003cp\u003e\u003cstrong\u003eWork through 70 recipes for implementing reliable data pipelines with Apache Spark, optimally store and process structured and unstructured data in Delta Lake, and use Databricks to orchestrate and govern your data\u003c\/strong\u003e\u003c\/p\u003eKey Features\u003col\u003e\n\u003cli\u003eLearn data ingestion, data transformation, and data management techniques using Apache Spark and Delta Lake\u003c\/li\u003e\n\u003cli\u003eGain practical guidance on using Delta Lake tables and orchestrating data pipelines\u003c\/li\u003e\n\u003cli\u003eImplement reliable DataOps and DevOps practices, and enforce data governance policies on Databricks\u003c\/li\u003e\n\u003cli\u003ePurchase of the print or Kindle book includes a free PDF eBook\u003c\/li\u003e\n\u003c\/ol\u003eBook Description\u003cp\u003eData Engineering with Databricks Cookbook will guide you through recipes to effectively use Apache Spark, Delta Lake, and Databricks for data engineering, beginning with an introduction to data ingestion and loading with Apache Spark.\u003c\/p\u003e\u003cp\u003eAs you progress, you'll be introduced to various data manipulation and data transformation solutions that can be applied to data. You'll find out how to manage and optimize Delta tables, as well as how to ingest and process streaming data. The book will also show you how to improve the performance problems of Apache Spark apps and Delta Lake. Later chapters will show you how to use Databricks to implement DataOps and DevOps practices and teach you how to orchestrate and schedule data pipelines using Databricks Workflows. Finally, you'll understand how to set up and configure Unity Catalog for data governance.\u003c\/p\u003e\u003cp\u003eBy the end of this book, you'll be well-versed in building reliable and scalable data pipelines using modern data engineering technologies.\u003c\/p\u003eWhat you will learn\u003col\u003e\n\u003cli\u003ePerform data loading, ingestion, and processing with Apache Spark\u003c\/li\u003e\n\u003cli\u003eDiscover data transformation techniques and custom user-defined functions (UDFs) in Apache Spark\u003c\/li\u003e\n\u003cli\u003eManage and optimize Delta tables with Apache Spark and Delta Lake APIs\u003c\/li\u003e\n\u003cli\u003eUse Spark Structured Streaming for real-time data processing\u003c\/li\u003e\n\u003cli\u003eOptimize Apache Spark application and Delta table query performance\u003c\/li\u003e\n\u003cli\u003eImplement DataOps and DevOps practices on Databricks\u003c\/li\u003e\n\u003cli\u003eOrchestrate data pipelines with Delta Live Tables and Databricks Workflows\u003c\/li\u003e\n\u003cli\u003eImplement data governance policies with Unity Catalog\u003c\/li\u003e\n\u003c\/ol\u003eWho this book is for\u003cp\u003eThis book is for data engineers, data scientists, and data practitioners who want to learn how to build efficient and scalable data pipelines using Apache Spark, Delta Lake, and Databricks. To get the most out of this book, you should have basic knowledge of data architecture, SQL, and Python programming.\u003c\/p\u003e\u003cdiv\u003e\n\u003cstrong\u003eNumber of Pages:\u003c\/strong\u003e 438\u003c\/div\u003e\u003cdiv\u003e\n\u003cstrong\u003eDimensions:\u003c\/strong\u003e 0.89 x 9.25 x 7.5 IN\u003c\/div\u003e\u003cdiv\u003e\n\u003cstrong\u003ePublication Date:\u003c\/strong\u003e May 31, 2024\u003c\/div\u003e","brand":"Books by splitShops","offers":[{"title":"Default Title","offer_id":47404179652786,"sku":"9781837633357","price":71.98,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0770\/3891\/1666\/files\/7d45d5b8e276f8c2861b2d610b053cf4.webp?v=1778154055","url":"https:\/\/box.dadyminds.org\/products\/data-engineering-with-databricks-cookbook-build-effective-data-and-ai-solutions-using-apache-spark-databricks-and-delta-lake-paperback","provider":"DADYMINDS BOX","version":"1.0","type":"link"}