This command-line data profiler is a small side project I've been working on to help get a quick understanding of an unfamiliar dataset. It currently supports JSON, but I'm building the application around a pipeline that will eventually accommodate other file formats. The current workflow
Leetcode #170. We are tasked with designing a data structure that accepts a stream of integers and checks if it has a pair of integers that sum up to a particular value. To solve this problem, we need to handle tradeoffs between read and write operations: 1. find(value) and
I am setting up a CICD pipeline in continuation of my Dallas Police Active Calls project. Terraform infrastructure, the data pipeline and the application server all reside in the same project, but I want to use GitHub actions to keep the infrastructure and application deployments loosely coupled. CICD Workflow 1.
A solution to Leetcode #34, Find First and Last Position of Element in Sorted Array Problem Statement: Given an array of integers nums sorted in non-decreasing order, find the starting and ending position of a given target value. If target is not found in the array, return [-1, -1]
This SQL challenge comes from LeetCode. We need to find the total user counts and amount spent for each date in three mutually exclusive categories: 1. mobile; 2. desktop; 3. mobile and desktop. Approach We create a truth table of user and platform usage for each date to help segment
The city of Dallas provides a real-time snapshot of active police calls, where officers are currently assigned and responding to the call. This data updates every two minutes and contains valuable location information, either as an address or cross streets. To visualize these calls, we need to transform the
Let's extend our local network to the cloud by setting up a site to site VPN with Amazon Web Services (AWS), and make file sharing easy between remote and on-premises infrastructure with Elastic File System (EFS). In addition to an AWS account, we need a IPSec capable
Python in Small Doses
This SQL challenge comes from LeetCode. We need to find missing subtasks from the Executed table. We know which subtasks have executed and how many subtasks there should be. Your first instinct might be to generate all subtask ids using a recursive CTE. Instead, we can use the generate_series
Beginning last year, I've endeavored to familiarize myself with the intricacies of AWS Cloud Services within a data engineering framework. As a capstone project, I built a reddit wordcloud generator. I just recently completed its core functionality. It takes all comments from a given reddit post and processes
Operator overloading allows developers to define custom behavior for standard operators. In Python, operator overloading is achieved by defining special methods in a class. These special methods, also known as magic methods or dunder (double underscore) methods, have names that begin and end with double underscores. Define __getitem__() to overload