Oracle create loader file
tom
Creating a loader file is tedious. The syntax is complicated. Moreover, small errors lead to a rejection of records. Luckily, we have the possibility to generate them from SQL Developer.…
Useful Scala Programme
I saw a small Scala programme that allows you to calculate subtotals. The idea is that a flat file is provided with a name and a subtotal. A given namen…
Joining files by Pig
In the previous post, we used scala to merge two files. The interesting feature is that scala bypasses Mapreduce. Pig uses Mapreduce. If we undertake the same example, we will…
Joining files by Scala
In this note, I will provide another script to join two files. The files are foo and bar. They contain lines whereby the elements are separated by a bar (|).…
OBIEE First report
Oracle has a very nice reporting tool, called OBIEE. It is positioned on top of their database. This allows to exploit the data. To do so, a separate (Weblogic OBIEE)…
ElasticSearch: Restful services
As we have seen in a previous post, we communicate with the ElasticSearch server via messages that are sent to a server. On the other hand, the server responds in…
Scala and RDDs
RDDs are the basic unit in Scala on Spark. The abbreviation stands for Resilient Distributed Dataset, This shows that we are talking on full data sets that are stored persistently…
A python script with many steps
Pyspark is the python language that is applied to spark. It therefore allows a wonderful merge between spark with its possibilities to circumvent the limitation that are set by the…
Dataflow in Oracle Warehouse Builder
I know that Oracle Warehouse Builder (OWB) is at end of life. On the other hand, I encounter OWB quite often and it is interesting to see how it works.…
reading an HDFS file in Python
In this note, I show you how to get data from an HDFS platform into a Python programme. The idea is that we have data on HDFS and we would…