Data Engineering Design Patterns Amit Kulkarni, Santosh Hegde
- Autorzy:
- Amit Kulkarni, Santosh Hegde
- Wydawnictwo:
- BPB Publications
- Ocena:
- Stron:
- 346
- Dostępne formaty:
-
ePubMobi
Opis
książki
:
Data Engineering Design Patterns
Data engineering has gained even more relevance than before, and data engineering patterns are key to the successful implementation of data engineering projects. This book enables a data engineer to not only become familiar with data engineering patterns but also understand their application in real world use cases.
This book presents a comprehensive collection of data engineering patterns, each illustrated with relevant enterprise use cases to highlight their value and simplicity. It showcases both open-source and cloud technologies, guiding readers in building data systems for on-premise and cloud environments. The book covers patterns for data ingestion, transformation, storage, and serving, while also offering insights into performance engineering for data pipelines. Once we understand fundamental data engineering patterns, we then shift focus to patterns that help us build high-performance low latency data systems. We cover data caching, partitioning, replication, and how to select the technology stack for building out the patterns in this book.
By the end of the book, readers will have a deep understanding of various data engineering use cases and will be able to map the appropriate patterns to address them. They will also be equipped to choose the right technical stack for implementing these patterns, enabling them to create robust and efficient data systems in a secure and a cost-effective manner. What you will learn
Key data engineering patterns.
Data ingestion and processing patterns.
Modern architectures like Lambda.
Explore time-tested data patterns of ETL and ELT.
Modern data systems like data lake and medallion architectures.
Domain-specific patterns and also on data orchestration, observability, and security.
Overcoming performance challenges in building complex data systems. Who this book is for
This book is designed for data engineers with beginner to intermediate experience in building enterprise-grade data systems. ETL developers transitioning into data engineering roles will also find this book valuable for understanding essential data engineering patterns. The code snippets provided throughout the book are written in Python or Scala, so a basic understanding of either language will help readers more easily grasp the concepts presented. Table of Contents
1. Understanding Data Engineering
2. Data Engineering Patterns, Terminologies, and Technical Stack
3. Batch Ingestion and Processing
4. Real-time Ingestion and Processing
5. Micro-batching
6. Lambda Architecture
7. ETL and ELT
8. Data Fundamentals
9. Databases and Transactional Data
10. Data Warehouse and Data Analytics
11. Data Lake and Medallion Architecture
12. Data Replication and Partitioning
13. Hot Versus Cold Data Storage
14. Data Caching and Low Latency Serving
15. Data Search Patterns
16. Domain Specific Patterns
17. Data Security Patterns
18. Data Observability and Monitoring Patterns
19. Idempotency and Deduplication Patterns
20. Data Orchestration Patterns
21. Common Performance Pitfalls
22. Technology and Infrastructure Selection
23. Recap and Next Steps
Szczegóły książki
- ISBN Ebooka:
- 978-93-658-9176-8, 9789365891768
- Data wydania ebooka :
-
2025-09-23
Data wydania ebooka często jest dniem wprowadzenia tytułu do sprzedaży i może nie być równoznaczna
z datą wydania książki papierowej. Dodatkowe informacje możesz znaleźć w darmowym fragmencie.
Jeśli masz wątpliwości skontaktuj się z nami sklep@ebookpoint.pl.
- Język publikacji:
- angielski
- Rozmiar pliku ePub:
- 4.6MB
- Rozmiar pliku Mobi:
- 4.6MB
BPB Publications - inne książki
-
Description There has been a rise in demand for cybersecurity professionals who can identify vulnerabilities proactively in applications and infrastructure and offer their skills and expertise in the form of remedial actions to plug these vulnerabilities. CPENT is one such examination testing the skills and expertise of a penetration testing profes-
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
-
Description Microsoft 365 is a subscription service that brings together a suite of productivity apps, cloud services, and security solutions. The service is constantly updated with new features and security enhancements, making it a comprehensive solution for both individuals and businesses to work, create, and connect from anywhere. This book ser-
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
-
Description The adoption of the Cloud brings many security challenges. Securing identities, data, and workloads while trying to stay on the right side of compliance regulations has become a priority for organizations. Mastering Azure Security is your essential handbook for defending applications and data against a complex threat landscape. Starting-
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
-
Description Salesforce has become the leading platform for customer relationship management, but true mastery comes from applying its power to real-world business needs. In this book, you will look into its two flagship products, Sales Cloud and Service Cloud. You will also be exploring the broader Salesforce ecosystem, from hidden gems to powerful-
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
-
Description An MVP is the most innovative way for startups to test ideas rapidly and avoid building products that miss customer expectations. A strong product mindset helps teams stay focused on real problems, move faster, and adapt with clarity. This book provides a systematic journey, beginning with the foundational principles of MVP and lean sta-
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
-
Description Cloud platforms like Google Cloud are essential for delivering scalable and reliable systems, but with increased speed comes greater security risk. As threats grow more complex, securing cloud-native workloads has become a vital skill for developers, engineers, and security teams alike. This book provides a hands-on guide to securing re-
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
-
Description GenAI is one of the most transformative technologies of our time, fundamentally changing how we build software and solve business problems. Unlike traditional AI that analyzes data to make predictions or classifications and usually requires training separate models for each specific task, GenAI provides powerful pre-trained models that-
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
-
Description Reliability and efficiency are paramount in the ever-evolving cloud landscape. Whether you are an enterprise adopting cloud for the first time or have been operating in the cloud for a while, you want to ensure that you are taking advantage of automation options available to you in the cloud. This book provides a systematic, chapter-by--
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
-
Description Domain-driven Design (DDD) continues to shape how modern software systems are built by bridging the gap between technical teams and business needs. Its emphasis on modeling the domain with precision and clarity is especially relevant in todays fast-paced, complex software landscape. This book begins with DDD fundamentals, including core-
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
-
Description Building a minimum viable product (MVP) is the most critical step for entrepreneurs looking to validate their business ideas and secure early traction. In an age of rapid innovation, the ability to develop, test, and iterate quickly is the key to outperforming the competition. This book is a practical guide designed to help entrepreneur-
- ePub + Mobi 89 pkt
(85,49 zł najniższa cena z 30 dni)
89.91 zł
99.90 zł (-10%) -
Dzięki opcji "Druk na żądanie" do sprzedaży wracają tytuły Grupy Helion, które cieszyły sie dużym zainteresowaniem, a których nakład został wyprzedany.
Dla naszych Czytelników wydrukowaliśmy dodatkową pulę egzemplarzy w technice druku cyfrowego.
Co powinieneś wiedzieć o usłudze "Druk na żądanie":
- usługa obejmuje tylko widoczną poniżej listę tytułów, którą na bieżąco aktualizujemy;
- cena książki może być wyższa od początkowej ceny detalicznej, co jest spowodowane kosztami druku cyfrowego (wyższymi niż koszty tradycyjnego druku offsetowego). Obowiązująca cena jest zawsze podawana na stronie WWW książki;
- zawartość książki wraz z dodatkami (płyta CD, DVD) odpowiada jej pierwotnemu wydaniu i jest w pełni komplementarna;
- usługa nie obejmuje książek w kolorze.
Masz pytanie o konkretny tytuł? Napisz do nas: sklep@ebookpoint.pl
Książka drukowana
Oceny i opinie klientów: Data Engineering Design Patterns Amit Kulkarni, Santosh Hegde
(0)