
Insights
Dataform
All about Dataform (23 posts)
Browse the archive
Explore a topic across our insights
23 results · Page 1 of 2

#131 From raw export to insight-ready data (with Johan van de Werken at GA4Dataform)
Johan van de Werken joins The Measure Pod to discuss GA4Dataform, BigQuery, and the future of analytics engineering and automation.

Webinar: Meet Dataform, the smart solution to fragile SQL setups
In this 30-minute webinar, learn how to bring structure and sanity to your SQL workflows, without adding complexity. We cover practical

#128 MCP servers in digital analytics (with Gunnar Griese at 8-bit-sheep)
In this episode of The Measure Pod, Dara and Matthew sit down with Gunnar Griese from 8-bit-sheep to discuss MCPs and their growing role in digital analytics.

GA4 Dataform integration: how Springer Nature modernised analytics with Measurelab
The Springer Nature Group is an academic publishing company, with brands dating back to 1842, that advances scientific discovery by publishing robust and insightful research, supporting the development of new areas of knowledge, making ideas and information accessible around the world, and leading the way on open access. The challenge Springer Nature needed to migrate their Universal Analytics dashboards to GA4 data. Their reporting relied on multiple stacked scheduled queries in BigQuery tha

#121 Using Dataform and DBT in modern analytics (with Verónica Delgado-Benito at Springer Nature)
In this episode of The Measure Pod, Dara and Matt are joined by Verónica Delgado-Benito to chat through her journey from molecular biology PhD to data analyst at Springer Nature.

Data pipeline optimisation with Google Cloud and Dataform
In our recent engagement with a client, we went on a journey to transform their data pipelines, tackling inefficiencies in performance and cost within their Google Cloud BigQuery environment. Our efforts culminated in a comprehensive optimisation strategy that used Dataform, improved SQL practices, and implemented tailored solutions for significant performance gains and cost savings. Here’s a deep dive into the highlights of our project. Identifying inefficiencies in BigQuery workflows We beg

Dataform for BigQuery: A basic end-to-end guide
Dataform is a powerful tool for managing your data workflows in a structured, version-controlled, and automated way. Whether you're a beginner or an experienced data engineer, Dataform simplifies SQL-based transformations while integrating seamlessly with Google BigQuery. Although this blog offers a basic introduction to Dataform's functionality, users can achieve significantly more with Dataform. From advanced scheduling, parameterised queries, and dependency management to complex data modelli
Behind the Cloud – Releases and scheduling in Dataform
In this episode of Behind the Cloud, Matthew dives into the details of releases and scheduling in Dataform. He breaks down how to manage different versions of your codebase in GitHub. From taking snapshots, to scheduling executions at various intervals daily, hourly, or monthly. By the end of the episode, you’ll have the know-how to confidently release and schedule your code, making it easier to build robust tables and models with Dataform. Video transcript Introduction to releases and sche
Mastering data loading in BigQuery using Dataform
Efficient data loading is crucial for managing and updating tables in Dataform. Various strategies exist to handle different use cases, including truncate and load, appending data, and leveraging incremental tables with unique keys. This blog explores these primary methods and more: Truncate and Load In this method, all existing records in the target table are deleted and replaced with a fresh table. This approach works well when a full table refresh is necessary or if managing slowly changin

A step-by-step guide to migrating scheduled queries to Dataform
Managing scheduled queries in BigQuery often feels limiting — there’s no version control, no easy collaboration, and scaling can be difficult. If you’ve ever wondered how to make SQL workflows smoother, Dataform is your answer. In this post, I’ll show you how I migrated a BigQuery scheduled query to Dataform and how it transformed the way I manage my data pipelines. After all, we all want to know who’s been touching our queries, don’t we? Getting started in Dataform First thing you need to

How to set up a Dataform repository with GitHub & Google Cloud integration
Setting up a Dataform repository can be challenging without the right steps. Whether you’re new to Dataform or want to optimise your workflow, this guide will show you how to seamlessly connect it with GitHub and Google Cloud (GC). What is Dataform and why use it? Dataform is a powerful tool for managing version-controlled SQL workflows in a collaborative way. GC incorporates BigQuery and GitHub integration, providing an efficient way to organise and maintain complex data pipelines. Let’s bre

The complexity paradox: why your spreadsheet is complex and BigQuery is simple
Discover 'The Complexity Paradox': why seemingly simple tools like spreadsheets can lead to hidden complexity, while learning powerful tools like BigQuery and SQL can bring true simplicity and scalability to your data workflows.
You’re sitting on a SQL time bomb: defuse it with Dataform
Learn how Dataform can solve the challenges of outdated SQL, improving data reliability, scalability, and efficiency for marketing teams.

Integrating siloed data: Springer Nature marketing and sales case study
The Springer Nature Group is an academic publishing company, with brands dating back to 1842, that advances scientific discovery by publishing robust and insightful research, supporting the development of new areas of knowledge, making ideas and information accessible around the world, and leading the way on open access. The challenge The sales and marketing teams depended on incomplete data, which didn’t capture the entire customer journey due to different systems in use. Transactions and re

#103 Modern marketing (with Ken Williams @ DiveTeam)
In this week's episode of The Measure Pod, Dan and Bhav are joined by Ken Williams from DiveTeam to discuss modern marketing and measurement strategy.

Behind the Cloud: Setting up a Dataform project within BigQuery
In this episode of Behind the Cloud, Matthew demonstrates how to enable and set up a Dataform project within BigQuery, connect it to GitHub, and initialise the workspace for building a Dataform project. Matt walks us through enabling BigQuery, creating a repository, setting up the region, and using service accounts. Video transcript Introduction to Dataform in BigQuery [00:00:00] Matt: Hello and welcome to this week’s behind the cloud sticking with the practical theme today. We’re going to

Behind the Cloud: Dataform, what is it and why does it matter?
In this episode of Behind the Cloud, Matt discusses Dataform, what it is, and why it matters. Video transcript Cloud Data Warehousing [00:00:00] Matt: Welcome to Behind the Cloud. Today we’re exploring data form, but first a little bit of scene setting. Over the past number of years, cloud computing, specifically cloud data warehousing, has advanced significantly. Huge amounts of data can be queried in seconds. The scalability of the platforms is near infinite from both a performance and a

#98 What on earth is a semantic layer?! (with David Jayatillake @ Delphi)
In this week's episode of The Measure Pod we spoke with David Jayatillake, co-founder of Delphi and organiser of the London Analytics Meetup.
