Apache Oozie. The Workflow Scheduler for Hadoop
![Język publikacji: angielski Język publikacji: angielski](https://static01.helion.com.pl/global/flagi/1.png)
![Apache Oozie. The Workflow Scheduler for Hadoop Mohammad Kamrul Islam, Aravind Srinivasan - okładka ebooka](https://static01.helion.com.pl/global/okladki/326x466/e_e02k.png)
![Apache Oozie. The Workflow Scheduler for Hadoop Mohammad Kamrul Islam, Aravind Srinivasan - tył okładki ebooka](https://static01.helion.com.pl/global/okladki-tyl/326x466/e_e02k.png)
- Ocena:
- Bądź pierwszym, który oceni tę książkę
- Stron:
- 272
- Dostępne formaty:
-
ePubMobi
Opis ebooka: Apache Oozie. The Workflow Scheduler for Hadoop
Get a solid grounding in Apache Oozie, the workflow scheduler system for managing Hadoop jobs. With this hands-on guide, two experienced Hadoop practitioners walk you through the intricacies of this powerful and flexible platform, with numerous examples and real-world use cases.
Once you set up your Oozie server, you’ll dive into techniques for writing and coordinating workflows, and learn how to write complex data pipelines. Advanced topics show you how to handle shared libraries in Oozie, as well as how to implement and manage Oozie’s security capabilities.
- Install and configure an Oozie server, and get an overview of basic concepts
- Journey through the world of writing and configuring workflows
- Learn how the Oozie coordinator schedules and executes workflows based on triggers
- Understand how Oozie manages data dependencies
- Use Oozie bundles to package several coordinator apps into a data pipeline
- Learn about security features and shared library management
- Implement custom extensions and write your own EL functions and actions
- Debug workflows and manage Oozie’s operational details
Wybrane bestsellery
-
Traditional data architecture patterns are severely limited. To use these patterns, you have to ETL data into each tool—a cost-prohibitive process for making warehouse features available to all of your data. The lack of flexibility with these patterns requires you to lock into a set of prio...(210.88 zł najniższa cena z 30 dni)
210.68 zł
249.00 zł(-15%) -
Oprogramowanie Apache Kafka powstało jako broker wiadomości w LinkedIn. Obecnie pełni funkcję rozproszonego systemu przetwarzania strumieniowego danych, używanego do budowania aplikacji opracowujących duże ilości danych w czasie rzeczywistym. Z zalet tego oprogramowania korzystają firmy na całym ...
Apache Kafka. Kurs video. Przetwarzanie danych w czasie rzeczywistym Apache Kafka. Kurs video. Przetwarzanie danych w czasie rzeczywistym
(31.14 zł najniższa cena z 30 dni)53.39 zł
89.00 zł(-40%) -
Used by more than 80% of Fortune 100 companies, Apache Kafka has become the de facto event streaming platform. Kafka Connect is a key component of Kafka that lets you flow data between your existing systems and Kafka to process data in real time.With this practical guide, authors Mickael Maison a...(245.37 zł najniższa cena z 30 dni)
244.87 zł
279.00 zł(-12%) -
This book describes both batch processing and real-time processing pipelines. You’ll learn how to implement basic and advanced big data use cases with ease and develop a deep understanding of the Apache Beam model. In addition to this, you’ll discover how the portability layer works...
Building Big Data Pipelines with Apache Beam. Use a single programming model for both batch and stream data processing Building Big Data Pipelines with Apache Beam. Use a single programming model for both batch and stream data processing
(137.70 zł najniższa cena z 30 dni)137.20 zł
139.00 zł(-1%) -
Every enterprise application creates data, including log messages, metrics, user activity, and outgoing messages. Learning how to move these items is almost as important as the data itself. If you're an application architect, developer, or production engineer new to Apache Pulsar, this practical ...(211.53 zł najniższa cena z 30 dni)
211.03 zł
249.00 zł(-15%) -
Data is bigger, arrives faster, and comes in a variety of formatsâ??and it all needs to be processed at scale for analytics or machine learning. But how can you process such varied workloads efficiently? Enter Apache Spark.Updated to include Spark 3.0, this second edition shows data engineer...(211.14 zł najniższa cena z 30 dni)
211.09 zł
249.00 zł(-15%) -
Serverless computing greatly simplifies software development. Your team can focus solely on your application while the cloud provider manages the servers you need. This practical guide shows you step-by-step how to build and deploy complex applications in a flexible multicloud, multilanguage envi...
Learning Apache OpenWhisk. Developing Open Serverless Solutions Learning Apache OpenWhisk. Developing Open Serverless Solutions
(211.20 zł najniższa cena z 30 dni)210.70 zł
249.00 zł(-15%) -
Before you can build analytics tools to gain quick insights, you first need to know how to process data in real time. With this practical guide, developers familiar with Apache Spark will learn how to put this in-memory framework to use for streaming data. You’ll discover how Spark enables ...
Stream Processing with Apache Spark. Mastering Structured Streaming and Spark Streaming Stream Processing with Apache Spark. Mastering Structured Streaming and Spark Streaming
(214.29 zł najniższa cena z 30 dni)214.19 zł
249.00 zł(-14%) -
This practical guide explains you to program and understand the power of Apache Cassandra 3.x. You will explore the integration and interaction of Cassandra components, and explore features such as the token allocation algorithm, CQL3, vnodes, lightweight transactions, and data modelling in detail.
Mastering Apache Cassandra 3.x. An expert guide to improving database scalability and availability without compromising performance - Third Edition Mastering Apache Cassandra 3.x. An expert guide to improving database scalability and availability without compromising performance - Third Edition
(118.48 zł najniższa cena z 30 dni)118.38 zł
119.00 zł(-1%) -
Apache Hive helps you deal with data summarization, queries, and analysis for huge amounts of data. This book will give you a background in big data, and familiarize you with your Hive working environment. Next you will cover advanced topics like performance and security in Hive and how to work e...
Apache Hive Essentials. Essential techniques to help you process, and get unique insights from, big data - Second Edition Apache Hive Essentials. Essential techniques to help you process, and get unique insights from, big data - Second Edition
Ebooka "Apache Oozie. The Workflow Scheduler for Hadoop" przeczytasz na:
-
czytnikach Inkbook, Kindle, Pocketbook, Onyx Boox i innych
-
systemach Windows, MacOS i innych
-
systemach Windows, Android, iOS, HarmonyOS
-
na dowolnych urządzeniach i aplikacjach obsługujących formaty: PDF, EPub, Mobi
Masz pytania? Zajrzyj do zakładki Pomoc »
Audiobooka "Apache Oozie. The Workflow Scheduler for Hadoop" posłuchasz:
-
w aplikacji Ebookpoint na Android, iOS, HarmonyOs
-
na systemach Windows, MacOS i innych
-
na dowolnych urządzeniach i aplikacjach obsługujących format MP3 (pliki spakowane w ZIP)
Masz pytania? Zajrzyj do zakładki Pomoc »
Kurs Video "Apache Oozie. The Workflow Scheduler for Hadoop" zobaczysz:
-
w aplikacjach Ebookpoint i Videopoint na Android, iOS, HarmonyOs
-
na systemach Windows, MacOS i innych z dostępem do najnowszej wersji Twojej przeglądarki internetowej
Szczegóły ebooka
- ISBN Ebooka:
- 978-14-493-6975-0, 9781449369750
- Data wydania ebooka:
-
2015-05-12
Data wydania ebooka często jest dniem wprowadzenia tytułu do sprzedaży i może nie być równoznaczna z datą wydania książki papierowej. Dodatkowe informacje możesz znaleźć w darmowym fragmencie. Jeśli masz wątpliwości skontaktuj się z nami sklep@ebookpoint.pl.
- Język publikacji:
- angielski
- Rozmiar pliku ePub:
- 6.2MB
- Rozmiar pliku Mobi:
- 6.2MB
Spis treści ebooka
- Foreword
- Preface
- Contents of This Book
- Conventions Used in This Book
- Using Code Examples
- Safari Books Online
- How to Contact Us
- Acknowledgments
- 1. Introduction to Oozie
- Big Data Processing
- A Recurrent Problem
- A Common Solution: Oozie
- Oozies role in the Hadoop Ecosystem
- What exactly is Oozie?
- The name Oozie
- A Simple Oozie Job
- Oozie Releases
- Timeline and status of the releases
- Compatibility
- Big Data Processing
- Some Oozie Usage Numbers
- 2. Oozie Concepts
- Oozie Applications
- Oozie Workflows
- Workflow use case
- Oozie Workflows
- Oozie Coordinators
- Coordinator use case
- Oozie Applications
- Oozie Bundles
- Bundle use case
- Parameters, Variables, and Functions
- Application Deployment Model
- Oozie Architecture
- 3. Setting Up Oozie
- Oozie Deployment
- Basic Installations
- Requirements
- Build Oozie
- Install Oozie Server
- Hadoop Cluster
- Hadoop installation
- Configuring Hadoop for Oozie
- Hadoop installation
- Start and Verify the Oozie Server
- Advanced Oozie Installations
- Configuring Kerberos Security
- DB Setup
- MySQL configuration
- Oracle configuration
- Shared Library Installation
- Sharelib since version 4.1.0
- Oozie Client Installations
- 4. Oozie Workflow Actions
- Workflow
- Actions
- Action Execution Model
- Action Definition
- Action Types
- MapReduce Action
- Streaming
- Pipes
- MapReduce example
- Streaming example
- MapReduce Action
- Java Action
- Java example
- Pig Action
- Pig example
- FS Action
- Filesystem example
- Sub-Workflow Action
- Hive Action
- Hive example
- DistCp Action
- DistCp Example
- Email Action
- Shell Action
- Shell example
- SSH Action
- Sqoop Action
- Sqoop example
- Synchronous Versus Asynchronous Actions
- 5. Workflow Applications
- Outline of a Basic Workflow
- Control Nodes
- <start> and <end>
- <fork> and <join>
- <decision>
- <kill>
- <OK> and <ERROR>
- Job Configuration
- Global Configuration
- Job XML
- Inline Configuration
- Launcher Configuration
- Parameterization
- EL Variables
- EL constants and system-defined variables
- Hadoop counters
- EL Variables
- EL Functions
- String timestamp()
- String wf:id()
- String wf:errorCode(String node)
- boolean fs:fileSize(String path)
- EL Expressions
- The job.properties File
- Command-Line Option
- The config-default.xml File
- The <parameters> Section
- Configuration and Parameterization Examples
- Lifecycle of a Workflow
- Action States
- 6. Oozie Coordinator
- Coordinator Concept
- Triggering Mechanism
- Time Trigger
- Data Availability Trigger
- Coordinator Application and Job
- Coordinator Action
- Our First Coordinator Job
- Coordinator Submission
- Oozie Web Interface for Coordinator Jobs
- Coordinator Job Lifecycle
- Coordinator Action Lifecycle
- Parameterization of the Coordinator
- EL Functions for Frequency
- Day-Based Frequency
- Month-Based Frequency
- Execution Controls
- An Improved Coordinator
- 7. Data Trigger Coordinator
- Expressing Data Dependency
- Dataset
- Defining a dataset
- Timelines: coordinator versus dataset
- input-events
- output-events
- Dataset
- Expressing Data Dependency
- Example: Rollup
- Parameterization of Dataset Instances
- current(n)
- latest(n)
- Comparison of current() and latest()
- Parameter Passing to Workflow
- dataIn(eventName):
- dataOut(eventName)
- nominalTime()
- actualTime()
- dateOffset(baseTimeStamp, skipInstance, timeUnit)
- formatTime(timeStamp, formatString)
- A Complete Coordinator Application
- 8. Oozie Bundles
- Bundle Basics
- Bundle Definition
- Why Do We Need Bundles?
- Bundle Basics
- Bundle Specification
- Execution Controls
- Bundle State Transitions
- 9. Advanced Topics
- Managing Libraries in Oozie
- Origin of JARs in Oozie
- Design Challenges
- Managing Action JARs
- How to get the JARs?
- Installing sharelib
- Overriding/upgrading existing JARs
- Supporting multiple versions
- Supporting the Users JAR
- JAR Precedence in classpath
- Managing Libraries in Oozie
- Oozie Security
- Oozie Security Overview
- Oozie to Hadoop
- Configuring Hadoop services
- Setting up Keytab and Principal
- Configuring the Oozie server
- Oozie Client to Server
- Oozie Server Security
- Configuring the Oozie Server
- Oozie client
- Proxy user in Oozie
- Supporting Custom Credentials
- Supporting New API in MapReduce Action
- Supporting Uber JAR
- Cron Scheduling
- A Simple Cron-Based Coordinator
- Oozie Cron Specification
- Allowed values
- Special characters
- Nonstandard special characters
- Emulate Asynchronous Data Processing
- HCatalog-Based Data Dependency
- 10. Developer Topics
- Developing Custom EL Functions
- Requirements for a New EL Function
- Implementing a New EL Function
- Writing a new EL function
- Deploy the new EL function
- Using the new function
- Developing Custom EL Functions
- Supporting Custom Action Types
- Creating a Custom Synchronous Action
- Writing an ActionExecutor
- Writing the XML schema
- Deploying the new action type
- Using the new action type
- Creating a Custom Synchronous Action
- Overriding an Asynchronous Action Type
- Implementing the New ActionMain Class
- Testing the New Main Class
- Creating a New Asynchronous Action
- Writing an Asynchronous Action Executor
- Writing the ActionMain Class
- Writing Actions Schema
- Deploying the New Action Type
- Using the New Action Type
- 11. Oozie Operations
- Oozie CLI Tool
- CLI Subcommands
- Useful CLI Commands
- The validate subcommand
- The job subcommand
- The jobs subcommand
- More subcommands
- Oozie CLI Tool
- Oozie REST API
- Oozie Java Client
- The oozie-site.xml File
- The Oozie Purge Service
- Job Monitoring
- JMS-Based Monitoring
- Installation and configuration
- Consuming JMS messages
- JMS-Based Monitoring
- Oozie Instrumentation and Metrics
- Reprocessing
- Workflow Reprocessing
- Coordinator Reprocessing
- Bundle Reprocessing
- Server Tuning
- JVM Tuning
- Service Settings
- The CallableQueueService
- The RecoveryService
- Oozie High Availability
- Debugging in Oozie
- Oozie Logs
- Developing and Testing Oozie Applications
- Application Deployment Tips
- Common Errors and Debugging
- MiniOozie and LocalOozie
- The Competition
- Index
O'Reilly Media - inne książki
-
Keeping up with the Python ecosystem can be daunting. Its developer tooling doesn't provide the out-of-the-box experience native to languages like Rust and Go. When it comes to long-term project maintenance or collaborating with others, every Python project faces the same problem: how to build re...(203.15 zł najniższa cena z 30 dni)
203.29 zł
239.00 zł(-15%) -
Bringing a deep-learning project into production at scale is quite challenging. To successfully scale your project, a foundational understanding of full stack deep learning, including the knowledge that lies at the intersection of hardware, software, data, and algorithms, is required.This book il...(237.15 zł najniższa cena z 30 dni)
244.53 zł
279.00 zł(-12%) -
Frontend developers have to consider many things: browser compatibility, usability, performance, scalability, SEO, and other best practices. But the most fundamental aspect of creating websites is one that often falls short: accessibility. Accessibility is the cornerstone of any website, and if a...(202.60 zł najniższa cena z 30 dni)
202.55 zł
239.00 zł(-15%) -
In this insightful and comprehensive guide, Addy Osmani shares more than a decade of experience working on the Chrome team at Google, uncovering secrets to engineering effectiveness, efficiency, and team success. Engineers and engineering leaders looking to scale their effectiveness and drive tra...(116.53 zł najniższa cena z 30 dni)
116.48 zł
149.00 zł(-22%) -
Data modeling is the single most overlooked feature in Power BI Desktop, yet it's what sets Power BI apart from other tools on the market. This practical book serves as your fast-forward button for data modeling with Power BI, Analysis Services tabular, and SQL databases. It serves as a starting ...(202.78 zł najniższa cena z 30 dni)
202.28 zł
239.00 zł(-15%) -
C# is undeniably one of the most versatile programming languages available to engineers today. With this comprehensive guide, you'll learn just how powerful the combination of C# and .NET can be. Author Ian Griffiths guides you through C# 12.0 and .NET 8 fundamentals and techniques for building c...(245.09 zł najniższa cena z 30 dni)
244.59 zł
279.00 zł(-12%) -
Learn how to get started with Futures Thinking. With this practical guide, Phil Balagtas, founder of the Design Futures Initiative and the global Speculative Futures network, shows you how designers and futurists have made futures work at companies such as Atari, IBM, Apple, Disney, Autodesk, Luf...(150.10 zł najniższa cena z 30 dni)
150.00 zł
179.00 zł(-16%) -
Augmented Analytics isn't just another book on data and analytics; it's a holistic resource for reimagining the way your entire organization interacts with information to become insight-driven.Moving beyond traditional, limited ways of making sense of data, Augmented Analytics provides a dynamic,...(178.05 zł najniższa cena z 30 dni)
177.85 zł
209.00 zł(-15%) -
Learn how to prepare for—and pass—the Kubernetes and Cloud Native Associate (KCNA) certification exam. This practical guide serves as both a study guide and point of entry for practitioners looking to explore and adopt cloud native technologies. Adrián González Sánchez ...
Kubernetes and Cloud Native Associate (KCNA) Study Guide Kubernetes and Cloud Native Associate (KCNA) Study Guide
(169.14 zł najniższa cena z 30 dni)177.65 zł
199.00 zł(-11%) -
Python is an excellent way to get started in programming, and this clear, concise guide walks you through Python a step at a time—beginning with basic programming concepts before moving on to functions, data structures, and object-oriented design. This revised third edition reflects the gro...(143.54 zł najniższa cena z 30 dni)
143.04 zł
179.00 zł(-20%)
Dzieki opcji "Druk na żądanie" do sprzedaży wracają tytuły Grupy Helion, które cieszyły sie dużym zainteresowaniem, a których nakład został wyprzedany.
Dla naszych Czytelników wydrukowaliśmy dodatkową pulę egzemplarzy w technice druku cyfrowego.
Co powinieneś wiedzieć o usłudze "Druk na żądanie":
- usługa obejmuje tylko widoczną poniżej listę tytułów, którą na bieżąco aktualizujemy;
- cena książki może być wyższa od początkowej ceny detalicznej, co jest spowodowane kosztami druku cyfrowego (wyższymi niż koszty tradycyjnego druku offsetowego). Obowiązująca cena jest zawsze podawana na stronie WWW książki;
- zawartość książki wraz z dodatkami (płyta CD, DVD) odpowiada jej pierwotnemu wydaniu i jest w pełni komplementarna;
- usługa nie obejmuje książek w kolorze.
Masz pytanie o konkretny tytuł? Napisz do nas: sklep[at]helion.pl.
Książka, którą chcesz zamówić pochodzi z końcówki nakładu. Oznacza to, że mogą się pojawić drobne defekty (otarcia, rysy, zagięcia).
Co powinieneś wiedzieć o usłudze "Końcówka nakładu":
- usługa obejmuje tylko książki oznaczone tagiem "Końcówka nakładu";
- wady o których mowa powyżej nie podlegają reklamacji;
Masz pytanie o konkretny tytuł? Napisz do nas: sklep[at]helion.pl.
Książka drukowana
![Loader](https://static01.helion.com.pl/ebookpoint/img/ajax-loader.gif)
![ajax-loader](https://static01.helion.com.pl/ebookpoint/img/ajax-loader.gif)
Oceny i opinie klientów: Apache Oozie. The Workflow Scheduler for Hadoop Mohammad Kamrul Islam, Aravind Srinivasan (0)
Weryfikacja opinii następuję na podstawie historii zamówień na koncie Użytkownika umieszczającego opinię. Użytkownik mógł otrzymać punkty za opublikowanie opinii uprawniające do uzyskania rabatu w ramach Programu Punktowego.