Data Science on the Google Cloud Platform. 2nd Edition

Autor:: Valliappa Lakshmanan

Data Science on the Google Cloud Platform. 2nd Edition Valliappa Lakshmanan - okladka książki

Wydawnictwo:: O'Reilly Media (Z chęcią przeczytam książkę w języku polskim)
Ocena:: Bądź pierwszym, który oceni tę książkę
Stron:: 462
Dostępne formaty:: ePub

Mobi

Ebook 220,15 zł najniższa cena z 30 dni

~~269,00 zł~~ (-15%)
228,65 zł

Dodaj do koszyka lub Kup na prezent Kup 1-kliknięciem

220,15 zł najniższa cena z 30 dni

Przenieś na półkę

Do przechowalni

Learn how easy it is to apply sophisticated statistical and machine learning methods to real-world problems when you build using Google Cloud Platform (GCP). This hands-on guide shows data engineers and data scientists how to implement an end-to-end data pipeline with cloud native tools on GCP.

Throughout this updated second edition, you'll work through a sample business decision by employing a variety of data science approaches. Follow along by building a data pipeline in your own project on GCP, and discover how to solve data science problems in a transformative and more collaborative way.

You'll learn how to:

Employ best practices in building highly scalable data and ML pipelines on Google Cloud
Automate and schedule data ingest using Cloud Run
Create and populate a dashboard in Data Studio
Build a real-time analytics pipeline using Pub/Sub, Dataflow, and BigQuery
Conduct interactive data exploration with BigQuery
Create a Bayesian model with Spark on Cloud Dataproc
Forecast time series and do anomaly detection with BigQuery ML
Aggregate within time windows with Dataflow
Train explainable machine learning models with Vertex AI
Operationalize ML with Vertex AI Pipelines

Wybrane bestsellery

Valliappa Lakshmanan - pozostałe książki

Promocja

All cloud architects need to know how to build data platforms that enable businesses to make data-driven decisions and deliver enterprise-wide intelligence in a fast and efficient way. This handbook shows you how to design, build, and modernize cloud native data and machine learning platforms using AWS, Azure, Google Cloud, and multicloud tools lik
- ePub + Mobi
Architecting Data and Machine Learning Platforms

Marco Tranquillin, Valliappa Lakshmanan, Firat Tekiner

(203,15 zł najniższa cena z 30 dni)

211.65 zł ~~249.00 zł (-15%)~~
Promocja

This practical book shows you how to employ machine learning models to extract information from images. ML engineers and data scientists will learn how to solve a variety of image problems including classification, object detection, autoencoders, image generation, counting, and captioning with proven ML techniques. This book provides a great introd
- ePub + Mobi
Practical Machine Learning for Computer Vision

Valliappa Lakshmanan, Martin Görner, Ryan Gillard

(245,65 zł najniższa cena z 30 dni)

254.15 zł ~~299.00 zł (-15%)~~
Promocja

Rozwiązania typowych problemów dotyczących przygotowania danych, konstruowania modeli i MLOps Wzorce projektowe opisane w tej książce obejmują najlepsze praktyki i rozwiązania powtarzalnych problemów w uczeniu maszynowym. Autorzy, troje inżynierów z firmy Google, skatalogowali sprawdzone metody, aby pomóc badaczom danych sprostać typowym problemom
- PDF
Wzorce projektowe uczenia maszynowego. Rozwiązania typowych problemów dotyczących przygotowania danych, konstruowania modeli i MLOps

Valliappa Lakshmanan, Sara Robinson, Michael Munn

(51,29 zł najniższa cena z 30 dni)

80.99 zł ~~89.99 zł (-10%)~~
Promocja

As you move data to the cloud, you need to consider a comprehensive approach to data governance, along with well-defined and agreed-upon policies to ensure your organization meets compliance requirements. Data governance incorporates the ways people, processes, and technology work together to ensure data is trustworthy and can be used effectively.
- ePub + Mobi
Data Governance: The Definitive Guide

Evren Eryurek, Uri Gilad, Valliappa Lakshmanan

(220,15 zł najniższa cena z 30 dni)

228.65 zł ~~269.00 zł (-15%)~~
Promocja

The design patterns in this book capture best practices and solutions to recurring problems in machine learning. The authors, three Google engineers, catalog proven methods to help data scientists tackle common problems throughout the ML process. These design patterns codify the experience of hundreds of experts into straightforward, approachable a
- ePub + Mobi
Machine Learning Design Patterns

Valliappa Lakshmanan, Sara Robinson, Michael Munn

(186,15 zł najniższa cena z 30 dni)

194.65 zł ~~228.99 zł (-15%)~~
Promocja

Work with petabyte-scale datasets while building a collaborative, agile workplace in the process. This practical book is the canonical reference to Google BigQuery, the query engine that lets you conduct interactive analysis of large datasets. BigQuery enables enterprises to efficiently store, query, ingest, and learn from their data in a convenien
- ePub + Mobi
Google BigQuery: The Definitive Guide. Data Warehousing, Analytics, and Machine Learning at Scale

Valliappa Lakshmanan, Jordan Tigani

(186,15 zł najniższa cena z 30 dni)

194.65 zł ~~228.99 zł (-15%)~~

Ebooka "Data Science on the Google Cloud Platform. 2nd Edition" przeczytasz na:

czytnikach Inkbook, Kindle, Pocketbook, Onyx Boox i innych
systemach Windows, MacOS i innych

systemach Windows, Android, iOS, HarmonyOS
na dowolnych urządzeniach i aplikacjach obsługujących formaty: PDF, EPub, Mobi

Masz pytania? Zajrzyj do zakładki Pomoc »

Audiobooka "Data Science on the Google Cloud Platform. 2nd Edition" posłuchasz:

w aplikacji Ebookpoint na Android, iOS, HarmonyOs
na systemach Windows, MacOS i innych

na dowolonych urządzeniach
i aplikacjach obsługujących format MP3
(pliki spakowane w ZIP)

Masz pytania? Zajrzyj do zakładki Pomoc »

Kurs Video "Data Science on the Google Cloud Platform. 2nd Edition" zobaczysz:

Oceny i opinie klientów: Data Science on the Google Cloud Platform. 2nd Edition Valliappa Lakshmanan (0)

Szczegóły książki

ISBN Ebooka:: 978-10-981-1891-4, 9781098118914
Data wydania ebooka :: 2022-03-29 Data wydania ebooka często jest dniem wprowadzenia tytułu do sprzedaży i może nie być równoznaczna z datą wydania książki papierowej. Dodatkowe informacje możesz znaleźć w darmowym fragmencie. Jeśli masz wątpliwości skontaktuj się z nami sklep@ebookpoint.pl.
Język publikacji:: angielski
Rozmiar pliku ePub:: 11.4MB
Rozmiar pliku Mobi:: 21MB

Zgłoś erratę

Kategorie

Kliknij, aby zgłosić błędnie przypisaną kategorię »

Informatyka » Programowanie » Programowanie w chmurze

Spis treści książki

Preface
- Who This Book Is For
- Conventions Used in This Book
- Using Code Examples
- OReilly Online Learning
- How to Contact Us
- Acknowledgments
1. Making Better Decisions Based on Data
- Many Similar Decisions
- The Role of Data Scientists
  - Scrappy Environment
  - Full Stack Cloud Data Scientists
  - Collaboration
- Best Practices
  - Simple to Complex Solutions
  - Cloud Computing
  - Serverless
- A Probabilistic Decision
  - Probabilistic Approach
  - Probability Density Function
  - Cumulative Distribution Function
- Choices Made
  - Choosing Cloud
  - Not a Reference Book
  - Getting Started with the Code
- Agile Architecture for Data Science on Google Cloud
  - What Is Agile Architecture?
  - No-Code, Low-Code
  - Use Managed Services
- Summary
- Suggested Resources
2. Ingesting Data into the Cloud
- Airline On-Time Performance Data
  - Knowability
  - Causality
  - TrainingServing Skew
  - Downloading Data
  - Hub-and-Spoke Architecture
  - Dataset Fields
- Separation of Compute and Storage
  - Scaling Up
  - Scaling Out with Sharded Data
  - Scaling Out with Data-in-Place
- Ingesting Data
  - Reverse Engineering a Web Form
  - Dataset Download
  - Exploration and Cleanup
  - Uploading Data to Google Cloud Storage
- Loading Data into Google BigQuery
  - Advantages of a Serverless Columnar Database
  - Staging on Cloud Storage
  - Access Control
  - Ingesting CSV Files
  - Partitioning
- Scheduling Monthly Downloads
  - Ingesting in Python
  - Cloud Run
  - Securing Cloud Run
  - Deploying and Invoking Cloud Run
  - Scheduling Cloud Run
- Summary
- Code Break
- Suggested Resources
3. Creating Compelling Dashboards
- Explain Your Model with Dashboards
  - Why Build a Dashboard First?
  - Accuracy, Honesty, and Good Design
- Loading Data into Cloud SQL
  - Create a Google Cloud SQL Instance
  - Create Table of Data
  - Interacting with the Database
- Querying Using BigQuery
  - Schema Exploration
  - Using Preview
  - Using Table Explorer
  - Creating BigQuery View
- Building Our First Model
  - Contingency Table
  - Threshold Optimization
- Building a Dashboard
  - Getting Started with Data Studio
  - Creating Charts
  - Adding End-User Controls
  - Showing Proportions with a Pie Chart
  - Explaining a Contingency Table
- Modern Business Intelligence
  - Digitization
  - Natural Language Queries
  - Connected Sheets
- Summary
- Suggested Resources
4. Streaming Data: Publication and Ingest with Pub/Sub and Dataflow
- Designing the Event Feed
  - Transformations Needed
  - Architecture
  - Getting Airport Information
  - Sharing Data
    - Sharing a Cloud Storage dataset
    - Sharing a BigQuery dataset
    - Dataplex and Analytics Hub
- Time Correction
  - Apache Beam/Cloud Dataflow
  - Parsing Airports Data
  - Adding Time Zone Information
  - Converting Times to UTC
  - Correcting Dates
  - Creating Events
  - Reading and Writing to the Cloud
  - Running the Pipeline in the Cloud
- Publishing an Event Stream to Cloud Pub/Sub
  - Speed-Up Factor
  - Get Records to Publish
  - How Many Topics?
  - Iterating Through Records
  - Building a Batch of Events
  - Publishing a Batch of Events
- Real-Time Stream Processing
  - Streaming in Dataflow
  - Windowing a Pipeline
  - Streaming Aggregation
  - Using Event Timestamps
  - Executing the Stream Processing
  - Analyzing Streaming Data in BigQuery
- Real-Time Dashboard
- Summary
- Suggested Resources
5. Interactive Data Exploration with Vertex AI Workbench
- Exploratory Data Analysis
  - Exploration with SQL
  - Reading a Query Explanation
- Exploratory Data Analysis in Vertex AI Workbench
  - Jupyter Notebooks
  - Creating a Notebook
  - Jupyter Commands
  - Installing Packages
  - Jupyter Magic for Google Cloud
- Exploring Arrival Delays
  - Basic Statistics
  - Plotting Distributions
  - Quality Control
    - Oddball values
    - Outlier removal: Big data is different
    - Filtering data on occurrence frequency
  - Arrival Delay Conditioned on Departure Delay
    - Distribution of arrival delays
    - Applying a probabilistic decision threshold
    - Empirical probability distribution function
    - The answer is...
- Evaluating the Model
  - Random Shuffling
  - Splitting by Date
  - Training and Testing
- Summary
- Suggested Resources
6. Bayesian Classifier with Apache Spark on Cloud Dataproc
- MapReduce and the Hadoop Ecosystem
  - How MapReduce Works
  - Apache Hadoop
- Google Cloud Dataproc
  - Need for Higher-Level Tools
  - Jobs, Not Clusters
  - Preinstalling Software
- Quantization Using Spark SQL
  - JupyterLab on Cloud Dataproc
  - Independence Check Using BigQuery
  - Spark SQL in JupyterLab
  - Histogram Equalization
- Bayesian Classification
  - Bayes in Each Bin
  - Evaluating the Model
  - Dynamically Resizing Clusters
  - Comparing to Single Threshold Model
- Orchestration
  - Submitting a Spark Job
  - Workflow Template
  - Cloud Composer
  - Autoscaling
  - Serverless Spark
- Summary
- Suggested Resources
7. Logistic Regression Using Spark ML
- Logistic Regression
  - How Logistic Regression Works
  - Spark ML Library
  - Getting Started with Spark Machine Learning
- Spark Logistic Regression
  - Creating a Training Dataset
    - Dealing with corner cases
    - Creating training examples
  - Training the Model
  - Predicting Using the Model
  - Evaluating a Model
- Feature Engineering
  - Experimental Framework
    - Choosing a metric
    - Creating the held-out dataset
  - Feature Selection
    - Creating a large cluster
    - Increasing quota
    - Autoscale up and down
    - Removing features
  - Feature Transformations
    - Scaling
    - Clipping
  - Feature Creation
  - Categorical Variables
  - Repeatable, Real Time
- Summary
- Suggested Resources
8. Machine Learning with BigQuery ML
- Logistic Regression
  - Presplit Data
  - Interrogating the Model
  - Evaluating the Model
  - Scale and Simplicity
- Nonlinear Machine Learning
  - XGBoost
  - Hyperparameter Tuning
  - Vertex AI AutoML Tables
- Time Window Features
  - Taxi-Out Time
  - Compounding Delays
  - Causality
- Time Features
  - Departure Hour
  - Transform Clause
  - Categorical Variable
  - Feature Cross
- Summary
- Suggested Resources
9. Machine Learning with TensorFlow in Vertex AI
- Toward More Complex Models
  - Preparing BigQuery Data for TensorFlow
  - Reading Data into TensorFlow
- Training and Evaluation in Keras
  - Model Function
  - Features
  - Inputs
  - Training the Keras Model
  - Saving and Exporting
  - Deep Neural Network
- Wide-and-Deep Model in Keras
  - Representing Air Traffic Corridors
  - Bucketing
  - Feature Crossing
  - Wide-and-Deep Classifier
- Deploying a Trained TensorFlow Model to Vertex AI
  - Concepts
  - Uploading Model
  - Creating Endpoint
  - Deploying Model to Endpoint
  - Invoking the Deployed Model
- Summary
- Suggested Resources
10. Getting Ready for MLOps with Vertex AI
- Developing and Deploying Using Python
  - Writing model.py
  - Writing the Training Pipeline
  - Predefined Split
  - AutoML
- Hyperparameter Tuning
  - Parameterize Model
  - Shorten Training Run
  - Metrics During Training
  - Hyperparameter Tuning Pipeline
  - Best Trial to Completion
- Explaining the Model
  - Configuring Explanations Metadata
  - Creating and Deploying Model
  - Obtaining Explanations
- Summary
- Suggested Resources
11. Time-Windowed Features for Real-Time Machine Learning
- Time Averages
  - Apache Beam and Cloud Dataflow
    - Why Apache Beam?
    - Why Dataflow?
    - Starting points
  - Reading and Writing
    - Reading from BigQuery
    - Local JSON input
    - Filtering
  - Time Windowing
    - Assigning a timestamp
    - Sliding windows
    - Computing moving average
    - Removing duplicates
- Machine Learning Training
  - Machine Learning Dataset
    - Label
    - Data split
    - Distance bug
    - Monitoring and verification
  - Training the Model
    - Changes from Chapter 10
    - AutoML model
    - Custom model
- Streaming Predictions
  - Reuse Transforms
  - Input and Output
  - Invoking Model
  - Reusing Endpoint
    - Shared handle
    - Per-worker instance
  - Batching Predictions
- Streaming Pipeline
  - Writing to BigQuery
  - Executing Streaming Pipeline
  - Late and Out-of-Order Records
    - Uniformly distributed delay
    - Exponential distribution
    - Normal distribution
    - Watermarks and triggers
  - Possible Streaming Sinks
    - Choosing a sink
    - Cloud Bigtable
      - Designing tables
      - Designing the row key
      - Streaming into Cloud Bigtable
      - Querying from Cloud Bigtable
- Summary
- Suggested Resources
12. The Full Dataset
- Four Years of Data
  - Creating Dataset
    - Dataset split
    - Shuffling data
    - Need for continuous training
    - More powerful machines
  - Training Model
  - Evaluation
    - RMSE
    - Confusion matrix
    - Impact of threshold
    - Impact of a feature
    - Analyzing errors
    - Categorical features
- Summary
- Suggested Resources
Conclusion
A. Considerations for Sensitive Data Within Machine Learning Datasets
- Handling Sensitive Information
  - Sensitive Data in Columns
  - Sensitive Data in Natural Language Datasets
  - Sensitive Data in Free-Form Unstructured Data
  - Sensitive Data in a Combination of Fields
  - Sensitive Data in Unstructured Content
- Protecting Sensitive Data
  - Removing Sensitive Data
  - Masking Sensitive Data
  - Coarsening Sensitive Data
- Establishing a Governance Policy
Index