- Ocena:
- Bądź pierwszym, który oceni tę książkę
- Stron:
- 402
- Dostępne formaty:
-
ePubMobi
Opis ebooka: Kafka Connect
Used by more than 80% of Fortune 100 companies, Apache Kafka has become the de facto event streaming platform. Kafka Connect is a key component of Kafka that lets you flow data between your existing systems and Kafka to process data in real time.
With this practical guide, authors Mickael Maison and Kate Stanley show data engineers, site reliability engineers, and application developers how to build data pipelines between Kafka clusters and a variety of data sources and sinks. Kafka Connect allows you to quickly adopt Kafka by tapping into existing data and enabling many advanced use cases. No matter where you are in your event streaming journey, Kafka Connect is the ideal tool for building a modern data pipeline.
- Learn Kafka Connect's capabilities, main concepts, and terminology
- Design data and event streaming pipelines that use Kafka Connect
- Configure and operate Kafka Connect environments at scale
- Deploy secured and highly available Kafka Connect clusters
- Build sink and source connectors and single message transforms and converters
Wybrane bestsellery
-
Master the world's most dominant programming language Key Features Learn JavaScript fundamentals and advanced techniques. Advanced JavaScript ES2015 (ES6)+ concepts uncovered. Expert tips for optimizing code efficiency in JavaScript. Description JavaScript Masterclass is your comprehensive ...
-
Master PHP fundamentals for efficient web development Key Features Hands-on approach with numerous examples for immediate application. Explaining advanced concepts with practical web development examples. Advanced techniques for secure coding and modern web development. Description This boo...
-
Build scalable and reliable web applications with TypeScript Key Features Learn about basic and advanced TypeScript concepts. Build a simple Todo application using TypeScript with JavaScript, React, and Node. Using TypeScript to write tests, incorporating third-party libraries, and deploying...
-
Bridging web and mobile for next-gen user experiences Key Features Comprehensive guide to web and mobile tech with HTML5, CSS3, PWAs. Case studies and practical strategies for real-world applications. Performance and security focus for efficient, safe apps. Description The book explores how...
-
Gain expertise in React, Hooks, Redux, React Router, Next.js, Best Practices, and much more Key Features Hands-on examples and projects for learning React and TypeScript. Starts with basics and advances to complex topics like Redux and GraphQL. Offers best practices for writing clean and eff...
-
Description Full Stack Development with Angular and Spring Boot is your essential toolkit for creating dynamic, high-performance web applications. This book bridges the gap between frontend and backend development, providing a practical understanding of both domains. This book provides a compreh...
-
Traditional data architecture patterns are severely limited. To use these patterns, you have to ETL data into each tool—a cost-prohibitive process for making warehouse features available to all of your data. The lack of flexibility with these patterns requires you to lock into a set of prio...(152.52 zł najniższa cena z 30 dni)
152.32 zł
249.00 zł(-39%) -
Oprogramowanie Apache Kafka powstało jako broker wiadomości w LinkedIn. Obecnie pełni funkcję rozproszonego systemu przetwarzania strumieniowego danych, używanego do budowania aplikacji opracowujących duże ilości danych w czasie rzeczywistym. Z zalet tego oprogramowania korzystają firmy na całym ...(48.95 zł najniższa cena z 30 dni)
53.39 zł
89.00 zł(-40%) -
This book describes both batch processing and real-time processing pipelines. You’ll learn how to implement basic and advanced big data use cases with ease and develop a deep understanding of the Apache Beam model. In addition to this, you’ll discover how the portability layer works...(83.40 zł najniższa cena z 30 dni)
137.40 zł
139.00 zł(-1%) -
Every enterprise application creates data, including log messages, metrics, user activity, and outgoing messages. Learning how to move these items is almost as important as the data itself. If you're an application architect, developer, or production engineer new to Apache Pulsar, this practical ...(152.43 zł najniższa cena z 30 dni)
152.33 zł
249.00 zł(-39%)
Ebooka "Kafka Connect" przeczytasz na:
-
czytnikach Inkbook, Kindle, Pocketbook, Onyx Boox i innych
-
systemach Windows, MacOS i innych
-
systemach Windows, Android, iOS, HarmonyOS
-
na dowolnych urządzeniach i aplikacjach obsługujących formaty: PDF, EPub, Mobi
Masz pytania? Zajrzyj do zakładki Pomoc »
Audiobooka "Kafka Connect" posłuchasz:
-
w aplikacji Ebookpoint na Android, iOS, HarmonyOs
-
na systemach Windows, MacOS i innych
-
na dowolnych urządzeniach i aplikacjach obsługujących format MP3 (pliki spakowane w ZIP)
Masz pytania? Zajrzyj do zakładki Pomoc »
Kurs Video "Kafka Connect" zobaczysz:
-
w aplikacjach Ebookpoint i Videopoint na Android, iOS, HarmonyOs
-
na systemach Windows, MacOS i innych z dostępem do najnowszej wersji Twojej przeglądarki internetowej
Szczegóły ebooka
- ISBN Ebooka:
- 978-10-981-2649-0, 9781098126490
- Data wydania ebooka:
- 2023-09-18 Data wydania ebooka często jest dniem wprowadzenia tytułu do sprzedaży i może nie być równoznaczna z datą wydania książki papierowej. Dodatkowe informacje możesz znaleźć w darmowym fragmencie. Jeśli masz wątpliwości skontaktuj się z nami sklep@ebookpoint.pl.
- Język publikacji:
- angielski
- Rozmiar pliku ePub:
- 3.9MB
- Rozmiar pliku Mobi:
- 9.6MB
Spis treści ebooka
- Foreword
- Preface
- Who Should Read This Book
- Kafka Versions
- Navigating This Book
- Conventions Used in This Book
- OReilly Online Learning
- How to Contact Us
- Acknowledgements
- I. Introduction to Kafka Connect
- 1. Meet Kafka Connect
- Kafka Connect Features
- Pluggable Architecture
- Scalability and Reliability
- Declarative Pipeline Definition
- Part of Apache Kafka
- Kafka Connect Features
- Use Cases
- Capturing Database Changes
- Mirroring Kafka Clusters
- Building Data Lakes
- Aggregating Logs
- Modernizing Legacy Systems
- Alternatives to Kafka Connect
- Summary
- 2. Apache Kafka Basics
- A Distributed Event Streaming Platform
- Open Source
- Distributed
- Event Streaming
- Platform
- A Distributed Event Streaming Platform
- Kafka Concepts
- Publish-Subscribe
- Brokers and Records
- Topics and Partitions
- Replication
- Retention and Compaction
- KRaft and ZooKeeper
- Interacting with Kafka
- Producers
- Consumers
- Kafka Streams
- Getting Started with Kafka
- Starting Kafka
- Kafka in KRaft mode (without ZooKeeper)
- Kafka with ZooKeeper
- Starting Kafka
- Sending and Receiving Records
- Running a Kafka Streams Application
- Summary
- II. Developing Data Pipelines with Kafka Connect
- 3. Components in a Kafka Connect Data Pipeline
- Kafka Connect Runtime
- Running Kafka Connect
- Kafka Connect REST API
- Installing Plug-Ins
- Deployment Modes
- Kafka Connect Runtime
- Source and Sink Connectors
- Connectors and Tasks
- Configuring Connectors
- Running Connectors
- Converters
- Data Format and Schemas
- Configuring Converters
- Using Converters
- Transformations and Predicates
- Transformation Use Cases
- Routing
- Sanitizing
- Formatting
- Enhancing
- Transformation Use Cases
- Predicates
- Configuring Transformations and Predicates
- Using Transformations and Predicates
- Summary
- 4. Designing Effective Data Pipelines
- Choosing a Connector
- Pipeline Direction
- Licensing and Support
- Connector Features
- Choosing a Connector
- Defining Data Models
- Data Transformation
- Mapping Data Between Systems
- Formatting Data
- Data Formats
- Schemas
- Kafka Connect record schemas
- Kafka record schemas
- Exploring Kafka Connect Internals
- Internal Topics
- Group Membership
- Rebalance Protocols
- Handling Failures in Kafka Connect
- Worker Failure
- Connector/Task Failure
- Kafka/External Systems Failure
- Dead Letter Queues
- Understanding Processing Semantics
- Sink Connectors
- Source Connectors
- Summary
- 5. Connectors in Action
- Confluent S3 Sink Connector
- Configuring the Connector
- Connectivity and S3 details
- Object partitioning
- Object naming
- Object formats
- Object upload
- Configuring the Connector
- Exactly-Once Semantics
- Running the Connector
- Using the field partitioner
- Using the time-based partitioner
- Confluent S3 Sink Connector
- Confluent JDBC Source Connector
- Configuring the Connector
- Connectivity
- Topic naming
- Table filtering
- Data collection mode
- Partitioning and parallelism
- Configuring the Connector
- Running the Connector
- Using the bulk mode
- Using an incrementing mode
- Debezium MySQL Source Connector
- Configuring the Connector
- Connectivity
- Database and table filtering
- Snapshotting
- Configuring the Connector
- Event Formats
- Running the Connector
- Summary
- 6. Mirroring Clusters with MirrorMaker
- Introduction to Mirroring
- Exploring Mirroring Use Cases
- Geo-replication
- Disaster recovery
- Migration
- Complex topologies
- Exploring Mirroring Use Cases
- Mirroring in Practice
- Introduction to Mirroring
- Introduction to MirrorMaker
- Common Concepts
- Local and remote topics
- Common configurations
- Replication policies
- Client overrides
- Common Concepts
- Deployment Modes
- MirrorMaker Connectors
- MirrorSourceConnector
- Configurations
- Topic configurations
- Offset-syncs configurations
- ACLs configurations
- Metrics configurations
- Configurations
- Permissions
- Source cluster ACLs
- Target cluster ACLs
- MirrorSourceConnector
- Metrics
- MirrorCheckpointConnector
- Configurations
- Permissions
- Source cluster ACLs
- Target cluster ACLs
- Metrics
- MirrorHeartbeatConnector
- Configurations
- Permissions
- Running MirrorMaker
- Disaster Recovery Example
- Geo-Replication Example
- Summary
- III. Running Kafka Connect in Production
- 7. Deploying and Operating Kafka Connect Clusters
- Preparing the Kafka Connect Environment
- Building a Kafka Connect Environment
- Installing Plug-Ins
- Networking and Permissions
- Preparing the Kafka Connect Environment
- Worker Plug-Ins
- Configuration Providers
- REST Extensions
- Connector Client Configuration Override Policies
- Sizing and Planning Capacity
- Understanding Kafka Connect Resource Utilization
- How Many Workers and Tasks?
- Single cluster versus separate clusters
- Maintainability
- Isolation
- Security
- Use case optimization
- Operating Kafka Connect Clusters
- Adding Workers
- Removing Workers
- Upgrading and Applying Maintenance to Workers
- Restarting Failed Tasks and Connectors
- Resetting Offsets of Connectors
- Sink connector offsets
- Source connector offsets
- Administering Kafka Connect Using the REST API
- Creating and Deleting a Connector
- Connector and Task Configuration
- Controlling the Lifecycle of Connectors
- Listing Connector Offsets
- Debugging Issues
- Summary
- 8. Configuring Kafka Connect
- Configuring the Runtime
- Configurations for Production
- Clients and connector overrides
- REST configurations
- Miscellaneous configuration
- Configurations for Production
- Fine-Tuning Configurations
- Connection configurations
- Inter-worker and rebalance configurations
- Topic tracking configurations
- Metrics configurations
- Offset flush configurations
- Configuring the Runtime
- Configuring Connectors
- Topic Configurations
- Client Overrides
- Configurations for Exactly-Once
- Configurations for Error Handling
- Configuring Kafka Connect Clusters for Security
- Securing the Connection to Kafka
- TLS configurations
- SASL configurations
- SASL OAUTHBEARER configurations
- SASL GSSAPI configurations
- Securing the Connection to Kafka
- Configuring Permissions
- Securing the REST API
- Summary
- 9. Monitoring Kafka Connect
- Monitoring Logs
- Logging Configuration
- Understanding Startup Logs
- Analyzing Logs
- Log contexts
- Key events
- Errors
- Monitoring Logs
- Monitoring Metrics
- Metrics Reporters
- Analyzing Metrics
- Exploring Metrics
- Key Metrics
- Kafka Connect Runtime Metrics
- Metadata metrics
- Network metrics
- Group protocol metrics
- Connector-level metrics
- Task-level metrics
- Kafka Connect Runtime Metrics
- Other System Metrics
- Internal Kafka client metrics
- Kafka and external system metrics
- Summary
- 10. Administering Kafka Connect on Kubernetes
- Introduction to Kubernetes
- Virtualization Technologies
- Kubernetes Fundamentals
- Introduction to Kubernetes
- Running Kafka Connect on Kubernetes
- Container Image
- Deploying Workers
- Networking and Monitoring
- Configuration
- Using a Kubernetes Operator to Deploy Kafka Connect
- Introduction to Kubernetes Operators
- Kubernetes Operators for Kafka Connect
- Strimzi
- Getting a Kubernetes Environment
- Starting the Operator
- Kafka Connect CRDs
- Deploying a Kafka Connect Cluster and Connectors
- MirrorMaker CRD
- Summary
- IV. Building Custom Connectors and Plug-Ins
- 11. Building Source and Sink Connectors
- Common Concepts and APIs
- Building a Custom Connector
- Implementing a connector
- Packaging a connector
- Building a Custom Connector
- The Connector API
- The version() method
- The config() method
- The initialize() method
- The start() method
- The taskClass() method
- The taskConfigs() method
- The stop() method
- The validate() method
- The context() methods
- Connector API lifecycle
- Common Concepts and APIs
- Configurations
- Configuration types
- Validators and recommenders
- Interacting with configurations at runtime
- The Task API
- The initialize() methods
- The start() method
- The stop() method
- Task API lifecycle
- Kafka Connect Records
- Schemas
- The ConnectorContext API
- The requestTaskReconfiguration() method
- The raiseError() method
- The configs() method
- Implementing Source Connectors
- The SourceTask API
- The poll() method
- The commit() and commitRecord() methods
- SourceTask API lifecycle
- The SourceTask API
- Source Records
- The SourceConnectorContext and SourceTaskContext APIs
- The offsetStorageReader() method
- The transactionContext() method
- Exactly-Once Support
- The exactlyOnceSupport() method
- The canDefineTransactionBoundaries() method
- The commitTransaction() methods
- The abortTransaction() methods
- Implementing Sink Connectors
- The SinkTask API
- The put() method
- The preCommit() method
- The flush() method
- The open() and close() methods
- The SinkTask API lifecycle
- The SinkTask API
- Sink Records
- The SinkConnectorContext and SinkTaskContext APIs
- The offset() methods
- The timeout() method
- The assignment() method
- The pause() and resume() methods
- The requestCommit() method
- The errantRecordReporter() method
- Summary
- 12. Extending Kafka Connect with Connector and Worker Plug-Ins
- Implementing Connector Plug-Ins
- The Transformation API
- The apply() method
- The config() method
- The configure() method
- The close() method
- The Transformation API
- The Predicate API
- The test() method
- The config() method
- The configure() method
- The close() method
- Implementing Connector Plug-Ins
- The Converter and HeaderConverter APIs
- The fromConnectData() methods
- The toConnectData() methods
- The fromConnectHeader() method
- The toConnectHeader() method
- The config() methods
- The configure() methods
- The close() method
- Implementing Worker Plug-Ins
- The ConfigProvider API
- The get() methods
- The configure() method
- The close() method
- The subscribe(), unsubscribe(), and unsubscribeAll() methods
- The ConfigProvider API
- The ConnectorClientConfigOverridePolicy API
- The validate() method
- The configure() method
- The close() method
- The ConnectRestExtension APIs
- The register() method
- The configure() method
- The close() method
- The version() method
- Summary
- Index
O'Reilly Media - inne książki
-
ActivityPub is the new standard for connecting social networks together on the social web. This open, decentralized social networking protocol defines an API for sharing activities to a social network and a procedure that servers use to distribute those activities to a subscriber's feed. With thi...(140.58 zł najniższa cena z 30 dni)
140.37 zł
179.00 zł(-22%) -
Get a fascinating and disturbing look into how state and nonstate actors throughout the world use cyber attacks to gain military, political, and economic advantages. In the third edition of this book, cyber warfare researcher Jeffrey Caruso explores the latest advances in cyber espionage and warf...(154.28 zł najniższa cena z 30 dni)
154.18 zł
199.00 zł(-23%) -
Cloud native security isnâ??t a game for individual players. It requires team collaboration with a platform that can help cloud security engineers, developers, and operations people do their best work. Thatâ??s what the cloud native application protection platform (CNAPP) delivers. With...(189.00 zł najniższa cena z 30 dni)
188.90 zł
239.00 zł(-21%) -
AI has acquired startling new language capabilities in just the past few years. Driven by the rapid advances in deep learning, language AI systems are able to write and understand text better than ever before. This trend enables the rise of new features, products, and entire industries. With this...(170.68 zł najniższa cena z 30 dni)
170.58 zł
279.00 zł(-39%) -
With the increasing complexity of modern cloud-based systems, an effective enterprise architecture program is more critical than ever. In this practical book, author Tanu McCabe from Capital One provides proven frameworks and practices to define an effective enterprise architecture strategy—...(126.48 zł najniższa cena z 30 dni)
126.43 zł
209.00 zł(-40%) -
As data continues to grow and become more complex, organizations seek innovative solutions to manage their data effectively. Data mesh is one solution that provides a new approach to managing data in complex organizations. This practical guide offers step-by-step guidance on how to implement data...(171.03 zł najniższa cena z 30 dni)
170.93 zł
279.00 zł(-39%) -
Large language models (LLMs) are not just shaping the trajectory of AI, they're also unveiling a new era of security challenges. This practical book takes you straight to the heart of these threats. Author Steve Wilson, chief product officer at Exabeam, focuses exclusively on LLMs, eschewing gene...(171.07 zł najniższa cena z 30 dni)
171.02 zł
279.00 zł(-39%) -
The sheer volume of business data has reached an all-time high. Using visualizations to transform this data into useful and understandable information can facilitate better decision-making. This practical book shows data analysts as well as professionals in finance, sales, and marketing how to qu...(126.58 zł najniższa cena z 30 dni)
126.48 zł
209.00 zł(-39%) -
What will you learn from this book?The new edition of this brain-friendly guide takes you through a comprehensive journey into modern JavaScript, covering everything from core language fundamentals to today's cutting-edge features. You'll dive into the nuances of JavaScript types and the unparall...(198.63 zł najniższa cena z 30 dni)
198.12 zł
249.00 zł(-20%)
Dzieki opcji "Druk na żądanie" do sprzedaży wracają tytuły Grupy Helion, które cieszyły sie dużym zainteresowaniem, a których nakład został wyprzedany.
Dla naszych Czytelników wydrukowaliśmy dodatkową pulę egzemplarzy w technice druku cyfrowego.
Co powinieneś wiedzieć o usłudze "Druk na żądanie":
- usługa obejmuje tylko widoczną poniżej listę tytułów, którą na bieżąco aktualizujemy;
- cena książki może być wyższa od początkowej ceny detalicznej, co jest spowodowane kosztami druku cyfrowego (wyższymi niż koszty tradycyjnego druku offsetowego). Obowiązująca cena jest zawsze podawana na stronie WWW książki;
- zawartość książki wraz z dodatkami (płyta CD, DVD) odpowiada jej pierwotnemu wydaniu i jest w pełni komplementarna;
- usługa nie obejmuje książek w kolorze.
Masz pytanie o konkretny tytuł? Napisz do nas: sklep[at]helion.pl.
Książka, którą chcesz zamówić pochodzi z końcówki nakładu. Oznacza to, że mogą się pojawić drobne defekty (otarcia, rysy, zagięcia).
Co powinieneś wiedzieć o usłudze "Końcówka nakładu":
- usługa obejmuje tylko książki oznaczone tagiem "Końcówka nakładu";
- wady o których mowa powyżej nie podlegają reklamacji;
Masz pytanie o konkretny tytuł? Napisz do nas: sklep[at]helion.pl.
Książka drukowana
Oceny i opinie klientów: Kafka Connect Mickael Maison, Kate Stanley (0) Weryfikacja opinii następuję na podstawie historii zamówień na koncie Użytkownika umieszczającego opinię. Użytkownik mógł otrzymać punkty za opublikowanie opinii uprawniające do uzyskania rabatu w ramach Programu Punktowego.