Posts

27-08-2025

AI research experimentation design

27-08-2025

Designing and evaluating metrics

27-08-2025

The second half of AI shifts from solving problems to to defining problems

26-08-2025

Setting up an evals test harness

21-08-2025

The value proposition of dspy

18-08-2025

Revolut on KPI-based leadership and other changes

15-08-2025

Binary quantisation

15-08-2025

LiteLLM as an adapter for different model sdk syntax

15-08-2025

Openai python client is autogenerated by stainless using openapi spec to sdk

15-08-2025

Pydantic evals library review

12-08-2025

Whisper.cpp audo transcription in ffmpeg

07-08-2025

Generative benchmarking to create representative test data for LLMs

07-08-2025

New OCR model from Rednote performs well across benchmarks

31-07-2025

Jinja for html email templates

31-07-2025

Optimisers using dspy

31-07-2025

Reciprocal rank fusion for document searching

24-07-2025

Embedding wikipedia data to build knowledge graphs and data ontologies

14-07-2025

uv build backend

10-07-2025

Infinitely-long summariser tool with dspy

16-06-2025

Determine python virtual environment path from module

13-06-2025

uv command reference

12-06-2025

FastAPI exmaples not showing up in swagger docs of OpenAPI spec

10-06-2025

Running R code on dagster

02-06-2025

Bulk copy program utility for mssql and files

27-05-2025

Pytest impl hooks to alter terminal output

22-05-2025

Pydantic v2 Migration

20-05-2025

Poetry builds to include additional files

20-05-2025

Wheel files in python

13-05-2025

Lifespan functions in fastapi apps

12-05-2025

Using the python ast module to enfoce validations in pytest

06-05-2025

FastAPI deployment concepts related to ASGI servers and process managers

30-04-2025

pyenv v2.4.20 supports python 3.12

30-04-2025

uvloop v0.18.0 supports python 3.12

28-04-2025

Downloading wheels from pip

28-04-2025

Setuptools bug and version changes

25-03-2025

PEX files for bundling python distributions

12-03-2025

Bimodal distribution of winners and losers in AI

06-03-2025

Index column ordering can be read either way by databases

03-03-2025

Sentry software and sdk philosophy

27-02-2025

Financial analysts on tap

27-02-2025

Monorepo readings and thoughts semi-consolidated

25-02-2025

Agency is more important than intelligence

25-02-2025

Your life in weeks visualisations

24-02-2025

Broot is a rust tool for directory exploration

22-02-2025

Poetry metadata version handling errors and pkginfo constraints

18-02-2025

Notes on "A deep dive into the world's smartest email AI"

17-02-2025

Notes on "Personal Software: The Unbundling of the Programmer?"

16-02-2025

Notes on "The Ascending Arc of AI Agents"

16-02-2025

Notes on "The future belongs to idea guys who can just do things"

13-02-2025

Azure Artifacts with python package index

10-02-2025

Example usage of Deep Research for daily nwws report

10-02-2025

LLMs for OCR and the move towards using LLMs for contextual retrieval

10-02-2025

Notes on "Unlocking LLM Power with Organizational KG Ontologies"

10-02-2025

VSCode exclusions to minimise background tasks

09-02-2025

Pedagogy of Math Academy

06-02-2025

Working with UV for github runners

30-01-2025

Bulletin of the Atomic Scientists

30-01-2025

Tools to convert content to LLM-friendly text prompts

27-01-2025

Check directory sizes, filter for which to delete, and remove them on linux

12-01-2025

Autonomous code generation and completion using the SWE-bench benchmark

08-01-2025

Contemplative reasoning response style for LLMs like Claude and GPT-4o

08-01-2025

PEP 723 – Inline script metadata with uv

06-01-2025

Bookmarks from the end-of-year period

06-01-2025

Dependency handling with deptry for missing or unused or other checks

03-12-2024

Image tokens and embeddings

28-11-2024

MSSQL trailing whitespaces in string values

26-11-2024

Notes on "How to Lead AI Engineering Teams"

22-11-2024

Run Streamlit apps from within python module

12-11-2024

11-11-2024

Cursor IDE rules for various languages and tasks

11-11-2024

Delete all folders within a directory while excluding certain filters

04-11-2024

Handling deprecation warnings in python

03-11-2024

Python libraries for convex optimisation and portfolio optimisation

30-10-2024

Single LLM-prompt for API discovery for use by actions / agents

29-10-2024

LLM leaderboard and evaluations

28-10-2024

FastAPI to include servers when generating OpenAPI spec

24-10-2024

How to normalise a deeply nested JSON-like object with pandas

24-10-2024

17-10-2024

GPT actions, actions library, sql database connections

15-10-2024

Fuzzy search in vscode

24-09-2024

Caplog to capture logging outputs in pytest

17-09-2024

Insert / upsert sql example persist strategy

16-09-2024

Data engineering in python

01-09-2024

GitHub Codespaces

01-09-2024

RSS parsing in python

27-08-2024

27-08-2024

GitHub Models and other LLM inference services

27-08-2024

Server login accounts vs user accounts

23-08-2024

Check which drivers are installed on RHEL server

21-08-2024

Compiling sqlite-vec

19-08-2024

Using pywin32 to query Outlook and extract email metadata and attachments

14-08-2024

Python tools for packaging and distribution

10-08-2024

Bulk insert / update / upsert in SQLAlchemy

06-08-2024

Claude prompting guide

06-08-2024

Dagster Deep Dive on Data quality

05-08-2024

Slow Changing Data types

01-08-2024

Local drives, network drives, and ssh / file clients for servers

01-08-2024

Stale file handles for mounted drives on Linux

29-07-2024

29-07-2024

Portecle, DER and PEM files, and PEM encodings for private key files

29-07-2024

Using Ollama to run Llama3.1

25-07-2024

Fixture set up and tear down in pytest

23-07-2024

Script to unmount drives

22-07-2024

Overview of new security features in ChatGPT Enterprise

22-07-2024

Utility script to create schema

19-07-2024

Convert code repo to LLM prompt

19-07-2024

SSH tunneling in Clojure REPL

04-07-2024

Pandas and Polars using PyArrow backend

03-07-2024

How to change username password on linux

18-06-2024

AI links for routing, multiple data sources, agents, model selection

11-06-2024

LLMs for structured output

30-05-2024

Shiny for Python

27-05-2024

GPTs for financial statement analysis

21-05-2024

Database columns that serve as helpful metadata fields

15-05-2024

Recommended reading

15-05-2024

Visualise SEC 13F filings

13-05-2024

Building CLIs with argparser

13-05-2024

The difference between stored procedures and SQL views

13-05-2024

Using espanso as a global text editor

10-05-2024

Application of Gradient Boosted Decision Trees in Time-Series Analysis

10-05-2024

Usage of ML models in financial time series prediction

10-05-2024

Weekly report of the work done by Infra team at Fly.io

07-05-2024

A collection of essays on technology and work

23-04-2024

Minimalist example of using HTTPX library for both sync and async requests

22-03-2024

Pytest incremental checker

06-03-2024

06-03-2024

The difference between directory / distribution / package names in python packaging

21-02-2024

A git workflow to reset branch and commit correctly

21-02-2024

Python protocols

21-02-2024

Repository Pattern, Unit of Work Pattern, Dependency Injection

21-02-2024

Why "prefer composition over inheritance"?

19-02-2024

Example launch.json file for VSCode

04-02-2024

Macquarie Research Equities, The A-Z of Quant

30-01-2024

Resources on GenAI

29-01-2024

AI-generated artwork winning art festival award

29-01-2024

Common Crawl web data

29-01-2024

Dagster and Databricks integration

29-01-2024

Explicit dependency sources in Poetry

27-01-2024

Getting started with Rust

24-01-2024

Python and Rust compilation, packages, bindings

22-01-2024

The issue with pie charts, and other visualiation tricks

16-01-2024

Python extensions and distributing python packages with pinned dependencies

12-01-2024

Built distributions vs building wheels

12-01-2024

Python library to validate API services and resources

10-01-2024

Longest study on happiness

09-01-2024

Ansible playbooks, roles with default / override values

03-01-2024

Determine the file storage of each sub-directory in a directory

19-12-2023

Working with ansible vault

14-12-2023

Portfolio optimisation inputs

07-12-2023

07-12-2023

Updating fine grained tokens on github

04-12-2023

29-11-2023

Designing pythonic APIs

29-11-2023

VSCode remote tunnels

28-11-2023

Creatine and cognition

23-10-2023

GitHub Actions does not support python 3.6 on ubuntu-22.06 (ubuntu-latest)

12-10-2023

Contex windows using LanceDB

12-10-2023

Function calling as the forth role in GPT models

12-10-2023

How much content should be contained within an embedding?

12-10-2023

Markdown parsing libraries in python

06-10-2023

04-10-2023

Nexus URLs for installing and pushing packages, using it with pip

03-10-2023

Refugees by Brian Bilston

01-10-2023

Consolidation of model architecture

30-09-2023

Python as C++'s limiting case

29-09-2023

Adding shortcuts for snippets in VSCode

29-09-2023

Foundations of deep learning

28-09-2023

Chain of density prompting for LLM summarisation

28-09-2023

Image embeddings

28-09-2023

Multi-prompt chains with LangChain

27-09-2023

Search algorithms when using vector databases

27-09-2023

Working with cronjobs and kerberos tickets

16-09-2023

Tesla Valuation

07-09-2023

Parse, validate and reformat standard numbers in Python

17-06-2023

Download Audio and Subtitle Files from YouTube

16-06-2023

ZAR/USD Calendar Year Moves

11-06-2023

Run Dagit UI in Debug Mode on VSCode

02-06-2023

Markdown syntax guide

07-04-2023

Yann LeCun and Andrew Ng, Why the 6-month AI Pause is a Bad Idea

17-03-2023

Architecture is everyone's business

17-03-2023

Busting the Myth of Private Blockchains

09-03-2023

Introduction to Tokenization, the Benefits it Brings, and How it Works

09-03-2023

Transformers United - DL Models that have revolutionized NLP, CV, RL

06-03-2023

Coinbase CEO Brian Armstrong on the Two Big Challenges Facing Crypto

17-02-2023

Meaningful metrics - How data sharpened the focus of product teams

14-02-2023

Troubleshooting VSCode Remote Extension

13-02-2023

26-11-2022

Removing uncertainty the tip of the iceberg

23-11-2022

Git reset for cleaner commit message

20-10-2022

Alembic type conversions and table alter instructions

19-10-2022

PEPs on python typing, forward references, postponed evaluation of annotations

17-10-2022

Relevant PEPs related to python packaging

12-10-2022

Cartesian product of a dataframe and a list

03-10-2022

Problem with mypy not type checking overload functions correctly due to missed signatures

30-09-2022

Datetime arithmetic logic

26-09-2022

First use-case of the walrus operator

20-09-2022

Restore local branch that has been deleted

17-09-2022

Typing second-order decorators that may be called with and without arguments

16-09-2022

Python underscore naming conventions

15-09-2022

Testing Azure Blob storage with Azurite

14-09-2022

Decrease coupling in Python code

14-09-2022

Interactive rebase in VScode with GitLens

13-09-2022

Undo most recent commit both locally and remotely

12-09-2022

General thoughts on essays by Vitalik about Ethereum and blockchain

09-09-2022

Changing the default response class of FastAPI

07-09-2022

Pip clear cache

05-09-2022

Install packages from trusted host and with default timeout

31-08-2022

Docker code snippets

30-08-2022

Object References and Argument Parsing

27-08-2022

Storing objects in the application instance

25-08-2022

Pivot and convert rows to columns in pandas groupby

25-08-2022

Render child elements inside component

18-08-2022

Create df with specified columns

18-08-2022

MSSQL Optimisation

17-08-2022

Testing middleware and async function

16-08-2022

Data structures to represent data in Python

16-08-2022

How do Small Teams have a Big Impact in Large Companies

15-08-2022

Handling exception chaining and raising from context

15-08-2022

How does installing from a git branch or tag effect python package resolution?

15-08-2022

Use for loops inside f strings

12-08-2022

Create clustered index

11-08-2022

Convert SQLAlchemy core statement into raw SQL string

11-08-2022

Create a simple class to expose dictionary keys with dot notation

09-08-2022

Conditional files and directories with cookiecutter

08-08-2022

Send data to debug console instead of REPL in python vscode

07-08-2022

Add global exception handlers to FastAPI app

07-08-2022

Working with tracebacks in python

04-08-2022

Adding an on_event middleware to FastAPI to check server resources

04-08-2022

Difference between the json and data parameter in python requests library post call

01-08-2022

Pandas Date Offsets and Frequencies

28-07-2022

Handling endpoints / requests with interesting parameter combinations

25-07-2022

SQL query to return first row from groupby query

19-07-2022

Black excludes files in gitignore

19-07-2022

Determine Version of Powershell

18-07-2022

Introduction to GraphQL

08-07-2022

Checkout tag, cherry pick commits, create new release

27-06-2022

VSCode debugger error when running debugger with justmycode set to false

23-06-2022

Pythonic enums with better string support

21-06-2022

Clearing cached folders of VSCode

20-06-2022

Pytest exit codes and how to suppress them in Jenkins

18-06-2022

Python function syntax and argument parsing

13-06-2022

Env Variables using Powershell

13-06-2022

Handling Environment Variables in VSCode

11-06-2022

Source Distributions vs Binary Distributions

10-06-2022

Set script execution policy in Powershell

10-06-2022

Understanding different naming conventions in python packaging

05-06-2022

Mac File System Clean Up

01-06-2022

Function Syntax and the Python Grammar

30-05-2022

Python Package Index Old API Old vs New API

30-05-2022

Useful Git Commands

23-05-2022

Configure iPython with Rich for Pretty REPL Formatting

23-05-2022

Git show all differences between current branch and default branch

23-05-2022

SQLAlchemy Flushing vs Committing

19-05-2022

Use python to clean up cached pytest and executable files

16-05-2022

Use Sqlite Database Browser to view local db files

15-05-2022

Adding Rich tracebacks to Python shell output

15-05-2022

Ignoring Revisions with Git Blame

15-05-2022

Python keyword-only and position-only arguments

12-05-2022

SQLAlchemy and Alembic Troubleshooting

11-05-2022

Delete remote git branches

07-05-2022

Install and configure python linters in vscode

04-05-2022

Add example for enum in FastAPI query parameters

28-04-2022

27-04-2022

SQL queries to select first or last set of rows

21-04-2022

Export github tag version to env variable within github action

20-04-2022

GitHub Action to trigger workflow on label change

19-04-2022

47% mechanical keyboard

19-04-2022

Configuration to enforce python virtual environment's

06-04-2022

Notes and learnings from the Python bootcamp

05-04-2022

Optional Parameters and Mutability

24-03-2022

Checkout old git revision and then jump back to current revision

24-03-2022

Get current git revision hash

18-03-2022

Clear Poetry local cache

18-03-2022

Debug code in external libraries with VSCode

14-03-2022

Render diffs in GitHub-flavoured markdown

14-03-2022

Set environment variable for Windows

11-03-2022

Dependency specification when packaging

11-03-2022

Select duplicates from postgres table

11-03-2022

Setting python interpreter / environment in VSCode

11-03-2022

Version specifiers for Python dependencies in a requirements file

04-03-2022

Installing node and yarn

03-03-2022

Cache python environment in GitHub Actions

01-03-2022

Create snippets in VSCode

01-03-2022

Install poetry venv with specific version of python

01-03-2022

VSCode launch script configuration

14-02-2022

Deploying a Droplet with DigitalOcean

04-02-2022

Bored Ape Yacht Club

28-01-2022

Structural Subtyping with Python Protocols

21-01-2022

The State Machine

16-01-2022

Installing Starship

16-01-2022

Structural Subtyping with Python Protocols

11-01-2022

Configuring an SSH Key Between a Client and Server

21-11-2021

Working with Instance, Class and Static Methods

07-11-2021

Database Migrations with Alembic and SQLAlchemy

05-11-2021

Enforcing Abstract Class Variables in Python

30-10-2021

Setting up a Mac for Development

17-10-2021

Configuring Environment Variables with Starlette

15-10-2021

Parsing Data with Pydantic

14-10-2021

A Graceful Guide to Git

11-10-2021

Implementing an Interface for Non-Fungible Tokens

08-10-2021

Statistical Data Testing with Pandera

30-09-2021

Choosing the Structure of a Python Package

26-09-2021

Configuring Git Hooks with Pre-Commit

25-09-2021

Installing Private GitHub Dependencies in Workflows

24-09-2021

Bootstrapping Development with Poetry