Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed, highly available service that uses Apache Kafka to process real-time streaming data. In August 2020, AWS launched support for Amazon Managed Streaming Kafka as an event source for Amazon Lambda. As a cloud giant, this service will attract…

Background todo Goals todo The Journeys todo 1 Creating Solution Architecture todo 2 Deploying AWS Neptune DB We will deploy a Neptune instance on AWS using Cloudformation below. We also need to have a file called neptune.params.prod.json, which define all parameters required by Cloudformation template. Below is one example. To deploy the stack, let’s use below command: aws cloudformation create-stack \ --stack-name…

This article shall give you walkthrough in using Apache Flink SQL Client based on my experience on learning and deploy Flink streaming applications. The Mission Supposed that we have a Kafka topic called order_billing which has schema like this: TODO JSON SCHEMA And, this is the example of the records using kafkacat utility. TODO SAMPLE RECORDS We want to have an aggregated view on do_no. The fields need to be aggregated are:

So, what is this all about? Another hype? Another trending tech things? Nope, this is just another simple article to show you on how to get started with Kubernetes and understand some simple operations on it. …

This series shall guides you for setting up Gitlab CI on Ubuntu. The first part of the series covers how to set up Gitlab CE. Gitlab Runner shall be covered on the second part of this series. Prerequisites The published GitLab hardware requirements recommend using a server with: 2 cores 4GB…

This is the documentation of Apache Airflow installation using Ubuntu on Windows. Preparation pip Apache Airflow requires pip for installation. Run below command. sudo apt-get install python-pip Perhaps if the default installed pip is not the up-to-date version, you may want to consider updating it: sudo pip install --upgrade pip Installing Database Backend (PostgreSQL) sudo apt-get…

This is the documentation for Apache JMeter installation on Windows 10. Disclaimer: This article was written on September 2017 Latest version of Apache JMeter was 3.3 Java 8 was required My Windows 10 did not have any Java installed Step 1: Install Java 8 Download latest Java 8 from Oracle website. You will need to…

Requirements Your PC must be running a 64-bit version of Windows 10 Anniversary Update or later (build 1607+) Read These Links Before Begin Install the Linux Subsystem on Windows 10 Your PC must be running a 64-bit version of Windows 10 Anniversary Update or later (build 1607+). To find your PC's…msdn.microsoft.com Install the Windows Subsystem for Linux Open PowerShell as Administrator and run: Enable-WindowsOptionalFeature -Online -FeatureName Microsoft-Windows-Subsystem-Linux

Suddenly yesterday afternoon my client asked me to create a report involving 500 meter rectangular grid. Well, that was quite massive, since the data is covering the whole Indonesia. Yes, the whole Indonesia. Indonesia is basically a very large area. …