Processing CSV files in Spark
It is possible to process CSV files in Spark as if these files are tables. That looks very promising: reading a file, translating the file into something that can be…
It is possible to process CSV files in Spark as if these files are tables. That looks very promising: reading a file, translating the file into something that can be…
I found a beautiful YouTube movie that showed how Spark can be installed on windows. I found this on https://www.youtube.com/watch?v=WlE7RNdtfwE . The movie provided a clear guide how to this…
I saw a small Scala programme that allows you to calculate subtotals. The idea is that a flat file is provided with a name and a subtotal. A given namen…
An interesting tango exists between Hive and Impala. The situation is as follows. Hive acts as an layer upon map reduce. It provides an interface whereby table definitions can be…