Anna Martin and Rosaria Silipo look at combining HiveQL and SparkQL:
We set our goal here to investigate the age distribution of Maine residents, men and women, using SQL queries. But the question is… on Apache Hive or on Apache Spark? Well, why not both? We could use SparkSQL to extract men’s age distribution and HiveQL to extract women’s age distribution. We could then compare the two distributions and see if they show any difference.
But the main question, as usual, is: Will SparkSQL queries and HiveQL queries blend?
Topic: Age distribution for men and women in the U.S. state of Maine.
Challenge: Blend results from Hive SQL and Spark SQL queries.
Access mode: Apache Spark and Apache Hive nodes for SQL processing.
Using KNIME, the authors are able to blend together data from different sources.