Data Engineering Design Patterns Amit Kulkarni, Santosh Hegde
- Autorzy:
- Amit Kulkarni, Santosh Hegde
- Wydawnictwo:
- BPB Publications
- Ocena:
- Stron:
- 346
- Dostępne formaty:
-
ePubMobi
Opis
książki
:
Data Engineering Design Patterns
Data engineering has gained even more relevance than before, and data engineering patterns are key to the successful implementation of data engineering projects. This book enables a data engineer to not only become familiar with data engineering patterns but also understand their application in real world use cases.
This book presents a comprehensive collection of data engineering patterns, each illustrated with relevant enterprise use cases to highlight their value and simplicity. It showcases both open-source and cloud technologies, guiding readers in building data systems for on-premise and cloud environments. The book covers patterns for data ingestion, transformation, storage, and serving, while also offering insights into performance engineering for data pipelines. Once we understand fundamental data engineering patterns, we then shift focus to patterns that help us build high-performance low latency data systems. We cover data caching, partitioning, replication, and how to select the technology stack for building out the patterns in this book.
By the end of the book, readers will have a deep understanding of various data engineering use cases and will be able to map the appropriate patterns to address them. They will also be equipped to choose the right technical stack for implementing these patterns, enabling them to create robust and efficient data systems in a secure and a cost-effective manner. What you will learn
Key data engineering patterns.
Data ingestion and processing patterns.
Modern architectures like Lambda.
Explore time-tested data patterns of ETL and ELT.
Modern data systems like data lake and medallion architectures.
Domain-specific patterns and also on data orchestration, observability, and security.
Overcoming performance challenges in building complex data systems. Who this book is for
This book is designed for data engineers with beginner to intermediate experience in building enterprise-grade data systems. ETL developers transitioning into data engineering roles will also find this book valuable for understanding essential data engineering patterns. The code snippets provided throughout the book are written in Python or Scala, so a basic understanding of either language will help readers more easily grasp the concepts presented. Table of Contents
1. Understanding Data Engineering
2. Data Engineering Patterns, Terminologies, and Technical Stack
3. Batch Ingestion and Processing
4. Real-time Ingestion and Processing
5. Micro-batching
6. Lambda Architecture
7. ETL and ELT
8. Data Fundamentals
9. Databases and Transactional Data
10. Data Warehouse and Data Analytics
11. Data Lake and Medallion Architecture
12. Data Replication and Partitioning
13. Hot Versus Cold Data Storage
14. Data Caching and Low Latency Serving
15. Data Search Patterns
16. Domain Specific Patterns
17. Data Security Patterns
18. Data Observability and Monitoring Patterns
19. Idempotency and Deduplication Patterns
20. Data Orchestration Patterns
21. Common Performance Pitfalls
22. Technology and Infrastructure Selection
23. Recap and Next Steps
Wybrane bestsellery
-
A practical guide to building secure, self-service engineering platforms that boost developer experience. Learn to streamline delivery with automation, AI-driven features, and tools developers actually want to use.W przygotowaniu
Powiadom mnie, gdy książka będzie dostępna -
Leverage the power of ESQL for faster search, aggregations, and visualizations, and gain insights on real-time data processing.W przygotowaniu
Powiadom mnie, gdy książka będzie dostępna -
Learn Linux Device Drivers guides you through writing char, platform, I²C, PCI(e), NIC, USB, input, and block drivers with the modern Linux Device Model. Packed with hands-on examples, it helps you master driver development on Linux 6.x.W przygotowaniu
Powiadom mnie, gdy książka będzie dostępna -
Master PostgreSQL 18 to build AI-driven enterprise apps with speed and intelligence. Learn with real-world examples, proven architectures, and advanced techniques for transactional, analytical, and AI workloads. Innovate. Scale. Win.W przygotowaniu
Powiadom mnie, gdy książka będzie dostępna -
Build scalable, secure data solutions on Azure Databricks. Learn ingestion, transformation, real-time streaming, Unity Catalog governance, and ML workflows to make Databricks your central data engineering platform.W przygotowaniu
Powiadom mnie, gdy książka będzie dostępna -
A practitioner-focused, leadership-ready guide that translates AI ethics and data governance into clear, actionable frameworks for executive decision-making, without abstract theory or overly technical detail.W przygotowaniu
Powiadom mnie, gdy książka będzie dostępna -
A fully updated second edition that bridges NLP fundamentals with the latest in AI. New chapters on LLMs, RAG, LangChain, and autonomous agents help you build advanced language solutions with hands-on Python examples.W przygotowaniu
Powiadom mnie, gdy książka będzie dostępna -
Pass the GCP Professional Data Engineer exam with expert guidance, real-world scenarios, and web-based study aids designed to build your skills and boost your confidence.W przygotowaniu
Powiadom mnie, gdy książka będzie dostępna -
This hands-on guide helps you build, run, and secure containers from scratch using Podman, Buildah, and Skopeo. Learn to integrate with system services, manage Kubernetes resources, and streamline containerized AI/ML workflows using Podman Desktop.W przygotowaniu
Powiadom mnie, gdy książka będzie dostępna -
As more evidence emerges that AI has the potential to perpetuate and even cause discrimination, it is imperative for modelers to address this issue head-on. In this book, we use the most popular machine learning language – Python – to teach the skills that modelers need to explain, identify, and remedy potential discrimination and bias.Building Responsible AI with Python. Learn to identify and mitigate bias with hands-on code examples
W przygotowaniu
Powiadom mnie, gdy książka będzie dostępna
Szczegóły książki
- ISBN Ebooka:
- 978-93-658-9176-8, 9789365891768
- Data wydania ebooka :
-
2025-09-23
Data wydania ebooka często jest dniem wprowadzenia tytułu do sprzedaży i może nie być równoznaczna
z datą wydania książki papierowej. Dodatkowe informacje możesz znaleźć w darmowym fragmencie.
Jeśli masz wątpliwości skontaktuj się z nami sklep@ebookpoint.pl.
- Język publikacji:
- angielski
- Rozmiar pliku ePub:
- 4.6MB
- Rozmiar pliku Mobi:
- 4.6MB
BPB Publications - inne książki
-
Description There has been a rise in demand for cybersecurity professionals who can identify vulnerabilities proactively in applications and infrastructure and offer their skills and expertise in the form of remedial actions to plug these vulnerabilities. CPENT is one such examination testing the skills and expertise of a penetration testing profes-
- ePub + Mobi 85 pkt
(85,49 zł najniższa cena z 30 dni)
85.49 zł
99.90 zł (-14%) -
-
Description Microsoft 365 is a subscription service that brings together a suite of productivity apps, cloud services, and security solutions. The service is constantly updated with new features and security enhancements, making it a comprehensive solution for both individuals and businesses to work, create, and connect from anywhere. This book ser-
- ePub + Mobi 85 pkt
(85,49 zł najniższa cena z 30 dni)
85.49 zł
99.90 zł (-14%) -
-
Description The adoption of the Cloud brings many security challenges. Securing identities, data, and workloads while trying to stay on the right side of compliance regulations has become a priority for organizations. Mastering Azure Security is your essential handbook for defending applications and data against a complex threat landscape. Starting-
- ePub + Mobi 85 pkt
(85,49 zł najniższa cena z 30 dni)
85.49 zł
99.90 zł (-14%) -
-
Description Salesforce has become the leading platform for customer relationship management, but true mastery comes from applying its power to real-world business needs. In this book, you will look into its two flagship products, Sales Cloud and Service Cloud. You will also be exploring the broader Salesforce ecosystem, from hidden gems to powerful-
- ePub + Mobi 85 pkt
(85,49 zł najniższa cena z 30 dni)
85.49 zł
99.90 zł (-14%) -
-
Description An MVP is the most innovative way for startups to test ideas rapidly and avoid building products that miss customer expectations. A strong product mindset helps teams stay focused on real problems, move faster, and adapt with clarity. This book provides a systematic journey, beginning with the foundational principles of MVP and lean sta-
- ePub + Mobi 85 pkt
(85,49 zł najniższa cena z 30 dni)
85.49 zł
99.90 zł (-14%) -
-
Description Cloud platforms like Google Cloud are essential for delivering scalable and reliable systems, but with increased speed comes greater security risk. As threats grow more complex, securing cloud-native workloads has become a vital skill for developers, engineers, and security teams alike. This book provides a hands-on guide to securing re-
- ePub + Mobi 85 pkt
(85,49 zł najniższa cena z 30 dni)
85.49 zł
99.90 zł (-14%) -
-
Description GenAI is one of the most transformative technologies of our time, fundamentally changing how we build software and solve business problems. Unlike traditional AI that analyzes data to make predictions or classifications and usually requires training separate models for each specific task, GenAI provides powerful pre-trained models that-
- ePub + Mobi 85 pkt
(85,49 zł najniższa cena z 30 dni)
85.49 zł
99.90 zł (-14%) -
-
Description Reliability and efficiency are paramount in the ever-evolving cloud landscape. Whether you are an enterprise adopting cloud for the first time or have been operating in the cloud for a while, you want to ensure that you are taking advantage of automation options available to you in the cloud. This book provides a systematic, chapter-by--
- ePub + Mobi 85 pkt
(85,49 zł najniższa cena z 30 dni)
85.49 zł
99.90 zł (-14%) -
-
Description Domain-driven Design (DDD) continues to shape how modern software systems are built by bridging the gap between technical teams and business needs. Its emphasis on modeling the domain with precision and clarity is especially relevant in todays fast-paced, complex software landscape. This book begins with DDD fundamentals, including core-
- ePub + Mobi 85 pkt
(85,49 zł najniższa cena z 30 dni)
85.49 zł
99.90 zł (-14%) -
-
Description Building a minimum viable product (MVP) is the most critical step for entrepreneurs looking to validate their business ideas and secure early traction. In an age of rapid innovation, the ability to develop, test, and iterate quickly is the key to outperforming the competition. This book is a practical guide designed to help entrepreneur-
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
Dzięki opcji "Druk na żądanie" do sprzedaży wracają tytuły Grupy Helion, które cieszyły sie dużym zainteresowaniem, a których nakład został wyprzedany.
Dla naszych Czytelników wydrukowaliśmy dodatkową pulę egzemplarzy w technice druku cyfrowego.
Co powinieneś wiedzieć o usłudze "Druk na żądanie":
- usługa obejmuje tylko widoczną poniżej listę tytułów, którą na bieżąco aktualizujemy;
- cena książki może być wyższa od początkowej ceny detalicznej, co jest spowodowane kosztami druku cyfrowego (wyższymi niż koszty tradycyjnego druku offsetowego). Obowiązująca cena jest zawsze podawana na stronie WWW książki;
- zawartość książki wraz z dodatkami (płyta CD, DVD) odpowiada jej pierwotnemu wydaniu i jest w pełni komplementarna;
- usługa nie obejmuje książek w kolorze.
Masz pytanie o konkretny tytuł? Napisz do nas: sklep@ebookpoint.pl
Książka drukowana
Oceny i opinie klientów: Data Engineering Design Patterns Amit Kulkarni, Santosh Hegde
(0)