Kafka Connect Mickael Maison, Kate Stanley

Kafka Connect Mickael Maison, Kate Stanley - okladka książki

Autorzy:: Mickael Maison, Kate Stanley
Wydawnictwo:: O'Reilly Media (Z chęcią przeczytam książkę w języku polskim)
Ocena:: Bądź pierwszym, który oceni tę książkę
Stron:: 402
Dostępne formaty:: ePub

Mobi

Ebook 237,15 zł najniższa cena z 30 dni

~~289,00 zł~~ (-15%)
245,65 zł

Dodaj do koszyka lub Kup na prezent Kup 1-kliknięciem

237,15 zł najniższa cena z 30 dni

Przenieś na półkę

Do przechowalni

Used by more than 80% of Fortune 100 companies, Apache Kafka has become the de facto event streaming platform. Kafka Connect is a key component of Kafka that lets you flow data between your existing systems and Kafka to process data in real time.

With this practical guide, authors Mickael Maison and Kate Stanley show data engineers, site reliability engineers, and application developers how to build data pipelines between Kafka clusters and a variety of data sources and sinks. Kafka Connect allows you to quickly adopt Kafka by tapping into existing data and enabling many advanced use cases. No matter where you are in your event streaming journey, Kafka Connect is the ideal tool for building a modern data pipeline.

Learn Kafka Connect's capabilities, main concepts, and terminology
Design data and event streaming pipelines that use Kafka Connect
Configure and operate Kafka Connect environments at scale
Deploy secured and highly available Kafka Connect clusters
Build sink and source connectors and single message transforms and converters

Wybrane bestsellery

Promocja

Description WebAssembly is a groundbreaking technology that has transformed the way we build and deploy web applications. It enables lightning-fast performance, portability across platforms, and seamless integration with existing web technologies. This comprehensive guide will lead you through the journey of mastering WebAssembly, from its fundamen
- ePub + Mobi
Building and Deploying WebAssembly Apps

Peter Salomonsen

(71,91 zł najniższa cena z 30 dni)

76.49 zł ~~84.99 zł (-10%)~~
Promocja

Description The book provides a comprehensive exploration of Java security and penetration testing, starting with foundational topics such as secure coding practices and the OWASP Top 10 for web applications. The early chapters introduce penetration testing methodologies, including Java web application-specific mapping and reconnaissance techniques
- ePub + Mobi
Penetration Testing with Java

Nancy Snoke

(71,91 zł najniższa cena z 30 dni)

76.49 zł ~~84.99 zł (-10%)~~
Promocja

Description Angular is a popular JavaScript framework that empowers developers to create single-page applications (SPAs) with ease. This comprehensive guide is designed to equip you with the skills and knowledge to become a proficient Angular developer, even if you are starting from scratch. This book offers a step-by-step guide to mastering Angula
- ePub + Mobi
Angular Masterclass

Souvik Basu

(71,91 zł najniższa cena z 30 dni)

76.49 zł ~~84.99 zł (-10%)~~
Promocja

Basic to Advance learning of Angular concepts. Key Features A complete overview of the key aspects of Angular Up to date with the latest Angular release The book covers the framework's mental model, API, and the design principles behind it. Description This book is an Essentials guide for every Angular developer. It covers all required topics
- ePub + Mobi
Angular Essentials

Dhananjay Kumar

(71,91 zł najniższa cena z 30 dni)

76.49 zł ~~84.99 zł (-10%)~~
Promocja

Complete guide to Excel Key Features Basic components of excel, the available menu options and tools, some customizations, working with multiple workbooks and worksheets. An initial introduction to what are formulas, functions, and their components. Usage of multiple examples to explain the application in real world scenario. Explaining of dif
- ePub + Mobi
Advance excel 2016 training guide

Ritu Arora

(71,91 zł najniższa cena z 30 dni)

76.49 zł ~~84.99 zł (-10%)~~
Promocja

Learn the robust, secured and the object-oriented programming language Key Features Comprehensive coverage of all the concepts of Core Java Simple language, crystal clear approach, user friendly book Concepts are duly supported by several examples and self-explanatory analogies. Description Book is written in such a way that the concepts are
- ePub + Mobi
Core Java: Made Simple

Som Prakash Rai

(71,91 zł najniższa cena z 30 dni)

76.49 zł ~~84.99 zł (-10%)~~
Promocja

Learn the basics of programming in a simplified manner Key Features Comprehensive coverage of all the concepts of Core Java. Strictly in accordance for the syllabus covered undergraduate and graduate classes for all the Universities. Simple language, crystal clear approach, straight forward comprehensible presentation. Adopting user-friendly c
- ePub + Mobi
Java in depth

Sarika Agarwal, Himani Bansal

(71,91 zł najniższa cena z 30 dni)

76.49 zł ~~84.99 zł (-10%)~~
Promocja

100% practical guide to understand and use Basic to Advance level Excel 2019 Key Features Whats New in Excel 2019 / Office 365 Putting Data into Excel Transforming and Managing the Data Formulas and Functions Data Analysis techniques Data Visualization techniques Multiple ways of Data Extraction Automation in Excel through Macros Description Exce
- ePub + Mobi
Excel 2019 All-In-One: Master the new features of Excel 2019

Lokesh Lalwani

(71,91 zł najniższa cena z 30 dni)

76.49 zł ~~84.99 zł (-10%)~~
Promocja

Gold mine of critical IT interview Q&A for freshers Key Features Understand various best practices, principles, concepts, and guidelines Common pitfalls to avoid during interviews Trending programming languages including Python and R. Tools, best practices, techniques, and processes Methodologies and processes for DevOps, microarchitecture, SD
- ePub + Mobi
IT Interview Guide for Freshers

Sameer S Paradkar

(71,91 zł najniższa cena z 30 dni)

76.49 zł ~~84.99 zł (-10%)~~
Promocja

Step-by-step guide written in a lucid language for mastering C# Key Features Packed with plentiful code examples A comprehensive guide to mastering C# Discusses the OOP principles Targets beginner to advanced readers of C# Provides insight into the latest features of C#, including C# 8.0 Covers Visual Studio 2019 Description This book star
- ePub + Mobi
Mastering C# 8.0

Joydip Kanjilal

(71,91 zł najniższa cena z 30 dni)

76.49 zł ~~84.99 zł (-10%)~~

Ebooka "Kafka Connect" przeczytasz na:

czytnikach Inkbook, Kindle, Pocketbook, Onyx Boox i innych
systemach Windows, MacOS i innych

systemach Windows, Android, iOS, HarmonyOS
na dowolnych urządzeniach i aplikacjach obsługujących formaty: PDF, EPub, Mobi

Masz pytania? Zajrzyj do zakładki Pomoc »

Oceny i opinie klientów: Kafka Connect Mickael Maison, Kate Stanley

(0)

Szczegóły książki

ISBN Ebooka:: 978-10-981-2649-0, 9781098126490
Data wydania ebooka :: 2023-09-18 Data wydania ebooka często jest dniem wprowadzenia tytułu do sprzedaży i może nie być równoznaczna z datą wydania książki papierowej. Dodatkowe informacje możesz znaleźć w darmowym fragmencie. Jeśli masz wątpliwości skontaktuj się z nami sklep@ebookpoint.pl.
Język publikacji:: 1
Rozmiar pliku ePub:: 3.9MB
Rozmiar pliku Mobi:: 9.6MB

Zgłoś erratę

Kategorie

Kliknij, aby zgłosić błędnie przypisaną kategorię »

Informatyka » Serwery internetowe » Apache

Spis treści książki

Foreword
Preface
- Who Should Read This Book
- Kafka Versions
- Navigating This Book
- Conventions Used in This Book
- OReilly Online Learning
- How to Contact Us
- Acknowledgements
I. Introduction to Kafka Connect
1. Meet Kafka Connect
- Kafka Connect Features
  - Pluggable Architecture
  - Scalability and Reliability
  - Declarative Pipeline Definition
  - Part of Apache Kafka
- Use Cases
  - Capturing Database Changes
  - Mirroring Kafka Clusters
  - Building Data Lakes
  - Aggregating Logs
  - Modernizing Legacy Systems
- Alternatives to Kafka Connect
- Summary
2. Apache Kafka Basics
- A Distributed Event Streaming Platform
  - Open Source
  - Distributed
  - Event Streaming
  - Platform
- Kafka Concepts
  - Publish-Subscribe
  - Brokers and Records
  - Topics and Partitions
  - Replication
  - Retention and Compaction
  - KRaft and ZooKeeper
- Interacting with Kafka
  - Producers
  - Consumers
  - Kafka Streams
- Getting Started with Kafka
  - Starting Kafka
    - Kafka in KRaft mode (without ZooKeeper)
    - Kafka with ZooKeeper
  - Sending and Receiving Records
  - Running a Kafka Streams Application
- Summary
II. Developing Data Pipelines with Kafka Connect
3. Components in a Kafka Connect Data Pipeline
- Kafka Connect Runtime
  - Running Kafka Connect
  - Kafka Connect REST API
  - Installing Plug-Ins
  - Deployment Modes
- Source and Sink Connectors
  - Connectors and Tasks
  - Configuring Connectors
  - Running Connectors
- Converters
  - Data Format and Schemas
  - Configuring Converters
  - Using Converters
- Transformations and Predicates
  - Transformation Use Cases
    - Routing
    - Sanitizing
    - Formatting
    - Enhancing
  - Predicates
  - Configuring Transformations and Predicates
  - Using Transformations and Predicates
- Summary
4. Designing Effective Data Pipelines
- Choosing a Connector
  - Pipeline Direction
  - Licensing and Support
  - Connector Features
- Defining Data Models
  - Data Transformation
  - Mapping Data Between Systems
- Formatting Data
  - Data Formats
  - Schemas
    - Kafka Connect record schemas
    - Kafka record schemas
- Exploring Kafka Connect Internals
  - Internal Topics
  - Group Membership
  - Rebalance Protocols
- Handling Failures in Kafka Connect
  - Worker Failure
  - Connector/Task Failure
  - Kafka/External Systems Failure
  - Dead Letter Queues
- Understanding Processing Semantics
  - Sink Connectors
  - Source Connectors
- Summary
5. Connectors in Action
- Confluent S3 Sink Connector
  - Configuring the Connector
    - Connectivity and S3 details
    - Object partitioning
    - Object naming
    - Object formats
    - Object upload
  - Exactly-Once Semantics
  - Running the Connector
    - Using the field partitioner
    - Using the time-based partitioner
- Confluent JDBC Source Connector
  - Configuring the Connector
    - Connectivity
    - Topic naming
    - Table filtering
    - Data collection mode
    - Partitioning and parallelism
  - Running the Connector
    - Using the bulk mode
    - Using an incrementing mode
- Debezium MySQL Source Connector
  - Configuring the Connector
    - Connectivity
    - Database and table filtering
    - Snapshotting
  - Event Formats
  - Running the Connector
- Summary
6. Mirroring Clusters with MirrorMaker
- Introduction to Mirroring
  - Exploring Mirroring Use Cases
    - Geo-replication
    - Disaster recovery
    - Migration
    - Complex topologies
  - Mirroring in Practice
- Introduction to MirrorMaker
  - Common Concepts
    - Local and remote topics
    - Common configurations
    - Replication policies
    - Client overrides
  - Deployment Modes
- MirrorMaker Connectors
  - MirrorSourceConnector
    - Configurations
      - Topic configurations
      - Offset-syncs configurations
      - ACLs configurations
      - Metrics configurations
    - Permissions
      - Source cluster ACLs
      - Target cluster ACLs
    - Metrics
  - MirrorCheckpointConnector
    - Configurations
    - Permissions
      - Source cluster ACLs
      - Target cluster ACLs
    - Metrics
  - MirrorHeartbeatConnector
    - Configurations
    - Permissions
- Running MirrorMaker
  - Disaster Recovery Example
  - Geo-Replication Example
- Summary
III. Running Kafka Connect in Production
7. Deploying and Operating Kafka Connect Clusters
- Preparing the Kafka Connect Environment
  - Building a Kafka Connect Environment
  - Installing Plug-Ins
  - Networking and Permissions
- Worker Plug-Ins
  - Configuration Providers
  - REST Extensions
  - Connector Client Configuration Override Policies
- Sizing and Planning Capacity
  - Understanding Kafka Connect Resource Utilization
  - How Many Workers and Tasks?
    - Single cluster versus separate clusters
    - Maintainability
    - Isolation
    - Security
    - Use case optimization
- Operating Kafka Connect Clusters
  - Adding Workers
  - Removing Workers
  - Upgrading and Applying Maintenance to Workers
  - Restarting Failed Tasks and Connectors
  - Resetting Offsets of Connectors
    - Sink connector offsets
    - Source connector offsets
- Administering Kafka Connect Using the REST API
  - Creating and Deleting a Connector
  - Connector and Task Configuration
  - Controlling the Lifecycle of Connectors
  - Listing Connector Offsets
  - Debugging Issues
- Summary
8. Configuring Kafka Connect
- Configuring the Runtime
  - Configurations for Production
    - Clients and connector overrides
    - REST configurations
    - Miscellaneous configuration
  - Fine-Tuning Configurations
    - Connection configurations
    - Inter-worker and rebalance configurations
    - Topic tracking configurations
    - Metrics configurations
    - Offset flush configurations
- Configuring Connectors
  - Topic Configurations
  - Client Overrides
  - Configurations for Exactly-Once
  - Configurations for Error Handling
- Configuring Kafka Connect Clusters for Security
  - Securing the Connection to Kafka
    - TLS configurations
    - SASL configurations
    - SASL OAUTHBEARER configurations
    - SASL GSSAPI configurations
  - Configuring Permissions
  - Securing the REST API
- Summary
9. Monitoring Kafka Connect
- Monitoring Logs
  - Logging Configuration
  - Understanding Startup Logs
  - Analyzing Logs
    - Log contexts
    - Key events
    - Errors
- Monitoring Metrics
  - Metrics Reporters
  - Analyzing Metrics
  - Exploring Metrics
- Key Metrics
  - Kafka Connect Runtime Metrics
    - Metadata metrics
    - Network metrics
    - Group protocol metrics
    - Connector-level metrics
    - Task-level metrics
  - Other System Metrics
    - Internal Kafka client metrics
    - Kafka and external system metrics
- Summary
10. Administering Kafka Connect on Kubernetes
- Introduction to Kubernetes
  - Virtualization Technologies
  - Kubernetes Fundamentals
- Running Kafka Connect on Kubernetes
  - Container Image
  - Deploying Workers
  - Networking and Monitoring
  - Configuration
- Using a Kubernetes Operator to Deploy Kafka Connect
  - Introduction to Kubernetes Operators
  - Kubernetes Operators for Kafka Connect
- Strimzi
  - Getting a Kubernetes Environment
  - Starting the Operator
  - Kafka Connect CRDs
  - Deploying a Kafka Connect Cluster and Connectors
  - MirrorMaker CRD
- Summary
IV. Building Custom Connectors and Plug-Ins
11. Building Source and Sink Connectors
- Common Concepts and APIs
  - Building a Custom Connector
    - Implementing a connector
    - Packaging a connector
  - The Connector API
    - The version() method
    - The config() method
    - The initialize() method
    - The start() method
    - The taskClass() method
    - The taskConfigs() method
    - The stop() method
    - The validate() method
    - The context() methods
    - Connector API lifecycle
  - Configurations
    - Configuration types
    - Validators and recommenders
    - Interacting with configurations at runtime
  - The Task API
    - The initialize() methods
    - The start() method
    - The stop() method
    - Task API lifecycle
  - Kafka Connect Records
    - Schemas
  - The ConnectorContext API
    - The requestTaskReconfiguration() method
    - The raiseError() method
    - The configs() method
- Implementing Source Connectors
  - The SourceTask API
    - The poll() method
    - The commit() and commitRecord() methods
    - SourceTask API lifecycle
  - Source Records
  - The SourceConnectorContext and SourceTaskContext APIs
    - The offsetStorageReader() method
    - The transactionContext() method
  - Exactly-Once Support
    - The exactlyOnceSupport() method
    - The canDefineTransactionBoundaries() method
    - The commitTransaction() methods
    - The abortTransaction() methods
- Implementing Sink Connectors
  - The SinkTask API
    - The put() method
    - The preCommit() method
    - The flush() method
    - The open() and close() methods
    - The SinkTask API lifecycle
  - Sink Records
  - The SinkConnectorContext and SinkTaskContext APIs
    - The offset() methods
    - The timeout() method
    - The assignment() method
    - The pause() and resume() methods
    - The requestCommit() method
    - The errantRecordReporter() method
- Summary
12. Extending Kafka Connect with Connector and Worker Plug-Ins
- Implementing Connector Plug-Ins
  - The Transformation API
    - The apply() method
    - The config() method
    - The configure() method
    - The close() method
  - The Predicate API
    - The test() method
    - The config() method
    - The configure() method
    - The close() method
  - The Converter and HeaderConverter APIs
    - The fromConnectData() methods
    - The toConnectData() methods
    - The fromConnectHeader() method
    - The toConnectHeader() method
    - The config() methods
    - The configure() methods
    - The close() method
- Implementing Worker Plug-Ins
  - The ConfigProvider API
    - The get() methods
    - The configure() method
    - The close() method
    - The subscribe(), unsubscribe(), and unsubscribeAll() methods
  - The ConnectorClientConfigOverridePolicy API
    - The validate() method
    - The configure() method
    - The close() method
  - The ConnectRestExtension APIs
    - The register() method
    - The configure() method
    - The close() method
    - The version() method
- Summary
Index