Apache NiFi does a great job when it comes to data flow automation. It excels in many regards – ease of use, built-in processors of all kinds, straightforward debugging or data provenance, to name but a few. Despite of a fairly moderate learning curve, there surely are new concepts to grasp. It took me a while to understand…
There are several great articles giving advice on how to handle multiple GitHub accounts. The one I liked in particular has a pretty self-explanatory title: Automatically use correct SSH key for remote Git repo I value the article for two main reasons: It helped me solve my problem with the authentication agent It gave me an idea of…
I’ve just begun with Apache Hadoop. Getting started isn’t as straightforward as one might wish. There is quite a bit of work to do after the initial installation (“brew install hadoop” in my case). Expect tweaks and workarounds. Fortunately, there is plenty of advice available, such as this excellent blog post. After having installed the latest stable version (2.7.1)…
Copying files in Gradle is very intuitive. It’s easy enough to filter out unwanted files using the exclude pattern. Example (see documentation): task copyTaskWithPatterns(type: Copy) { from ‘src/main/webapp’ into ‘build/explodedWar’ include ‘**/*.html’ include ‘**/*.jsp’ exclude { details -> details.file.name.endsWith(‘.html’) && details.file.text.contains(‘staging’) } } The problem occurs, when you only want to copy specific files and…
Gradle is smart enough to skip running tasks if there haven’t been any changes compared to the previous build. This post shows how to override the default optimisation to ensure the given task is executed every single time. Let’s create a sample project: mkdir hello-gradle && cd $_ && gradle init –type java-library Build it:…
Quite frequently, I reach for a combo of find and cd. Here is how to do it using a single command. Let’s create a bunch of nested directories, just for the sake of the exercise: mkdir -p x/y/z Result: tree x x └── y └── z Suppose I want to locate the y directory and cd to…