Inspired by the Enterprise Integration pattern of ‘pipes and filters’ I wanted to make a simple python pipes and filters example. With some digging I found this GitHub repository, which does an exc...

This post shows a simple NiFi dataflow and tries to demonstrate some of the elements of creating a NiFi workflow including adding and connecting processors, attributes and properties. This simple N...

NiFi is a tool designed to support the flow of data between software systems. This post shows how you can achieve NiFi version control with NiFi Register and docker. A note of caution: this post is...

Python variable function arguments are typically represented by the somewhat arcane-looking ‘*args’ and ‘**kwargs’ arguments in a function signature. Using python variable function arguments frees ...

Python packaging can be difficult to navigate. At some point in your python development career you will want to share your project or library with someone else, or deploy it to another location. Wh...

Agile teams typically need a critical mass of highly skilled people in order to be a success. If you are trying to transition from a conventional, plan-based approach to project management, you may...

I was asked recently about adding multiple custom lines and markers to a Folium map. Folium can be a bit funny about the order in which things are applied so below gives an example of how you can l...

If you have used other languages, you will probably be familiar with the idea of passing arguments to a program via the command line. This post shows you how you can do it with java. In this post ...

JSON is a common format for sending data to and from a RESTful API. In this post we’ll see how we can allow a simple Flask API to receive a JSON input. This post extends my previous post which made...

Once you have trained a sci-kit learn model it is not obvious how you can deploy it and use it to score unseen data. This post shows you how to save and learn sci-kit learn models so you can execut...