Spark SQL tutorial

  • WatchApache Spark - Setup Environment - Introduction
  • WatchApache Spark - Setup Environment on Mac
  • WatchApache Spark - Concepts and Architecture - Introduction
  • WatchApache Spark - Architecture Overview
  • WatchApache Spark - Cluster Modes
  • WatchApache Spark - Modules Overview
  • WatchApache Spark - Documentation Overview
  • WatchApache Spark - Launch Spark Shell (Scala)
  • WatchScala - Setup Scala and sbt introduction
  • WatchScala - Install and Validate
  • WatchScala - Run simple application
  • WatchScala - Install sbt and run scala application
  • WatchScala - Setup Scala IDE for Eclipse - Introduction
  • WatchScala - Setup Scala IDE and run simple application
  • WatchScala - integrate sbt with Scala IDE for Eclipse
  • WatchApache Spark - Develop applications using Scala IDE and sbt - Introduction
  • WatchApache Spark - Develop applications using Scala IDE and sbt
  • WatchApache Spark - Run Spark application on cluster
  • WatchApache Spark - Scala - SparkConf and SparkContext Introduction
  • WatchApache Spark - Scala - SparkConf
  • WatchApache Spark - Scala - SparkContext
  • WatchApache Spark - Scala - Externalizing Parameters
  • WatchApache Spark - Scala - Develop word count using Scala IDE for Eclipse
  • WatchApache Spark - Create RDD for Parallelized Collections
  • WatchApache Spark - Create RDD for external data sets on OS/local file system
  • WatchApache Spark - Create RDD for external data sets on HDFS files
  • WatchApache Spark - Understanding data model
  • WatchApache Spark - Transformations and Actions Overview
  • WatchApache Spark - Define problem statement and design
  • WatchApache Spark - Read Data Using Spark - Introduction
  • WatchApache Spark - Reading orders and order_items data
  • WatchApache Spark - Simple Transformations - Introduction
  • WatchApache Spark - Extract required fields - map
  • WatchApache Spark - Get revenue per order - reduceByKey
  • WatchApache Spark - Joins Introduction
  • WatchApache Spark - Join order and order_items - join transformation
  • WatchApache Spark - Compute average - Introduction
  • WatchApache Spark - Compute total revenue and total number of orders - aggregateByKey
  • WatchApache Spark - Compute average revenue
  • WatchApache Spark - Sort the data - sortByKey
  • WatchApache Spark - Save the output
  • WatchApache Spark - Running Application - Introduction
  • WatchApache Spark - Run Application Using Scala IDE
  • WatchApache Spark - Run Application On Cluster
  • WatchApache Spark - Accumulators Implementation - Scala
  • WatchApache Spark - Broadcast Variables - Scala - Introduction
  • WatchApache Spark - Broadcast Variables - Scala - Design
  • WatchApache Spark - Broadcast Variables - Scala - Implementation
  • WatchApache Spark - Scala - Data Frames - Introduction
  • WatchApache Spark - Scala - Data Frames and Operations

SparkSession in Spark 2.0 provides builtin support for Hive features including the ability to write queries using HiveQL, access to Hive UDFs, and the ability to read data from Hive tables. To use these features, you do not need to have an existing Hive setup.

You may also like...