BIG DUDE DATA

No bullshit data engineering & architecture for modern stacks — on-prem or cloud. Pragmatic delivery, clear communication, and platforms that are documented, understood, and built to last.

What We Do

  • Data platform architecture & modernisation — designing and evolving platforms that scale, perform, and make sense
  • Cloud & on-prem migrations — pragmatic transitions without burning the business or the team
  • Analytics & lakehouse engineering — reliable, testable data models that people actually trust
  • Delivery leadership & technical advisory — aligning engineers, platform teams, and stakeholders to a common goal
  • Short, high-impact engagements — unblock, stabilise, accelerate, then leave teams stronger than we found them

Platforms & tooling we’ve worked with and supported over the years:

Cloud & Analytics Platforms

AWS
GCP
AZURE
SNOWFLAKE
BIGQUERY
REDSHIFT

Big Data & Processing

HDFS
MAPREDUCE (MR2)
HIVE
SPARK
IMPALA
KAFKA
SPARK STRUCTURED STREAMING

Orchestration & Platform

AIRFLOW
ASTRONOMER
MWAA
CLOUD COMPOSER
KUBERNETES

Data Architecture & Analytics Engineering

DBT CORE
DBT CLOUD
ELT
ETL
BRONZE / SILVER / GOLD
DIMENSIONAL MODELLING
REBUILDABLE DATASETS

APIs & Data Services

REST APIS
MICROSERVICES
DATA ACCESS PATTERNS
CI/CD
TESTING

Languages & Tooling

PYTHON
SQL
BASH / LINUX
RUBY
JAVASCRIPT
YAML
TERRAFORM
JENKINS
GIT
GITHUB
GITLAB
BITBUCKET
CYPHER
GRAPHQL
NEO4J

Observability & Analytics

DATADOG
GRAFANA
PROMETHEUS
ELK
SPLUNK
CLOUDWATCH
STACKDRIVER
LOOKER
JUPYTER

Datastores & RDBMS

ORACLE
SQL SERVER
POSTGRESQL
MYSQL
DB2
INFORMIX
DUCKDB

Security & Integration

OAUTH2
OIDC
IAM
RBAC
VAULT
SECRETS MANAGER
SERVICE-TO-SERVICE
REST
SFTP

Get in Touch

No email addresses are published. Messages go straight to Big Dude Data.