Insights

Google Cloud

Google Cloud Platform services, infrastructure, and data tools (100 posts)

Need help with Google Cloud? See intelligence platforms

Browse the archive

Explore a topic across our insights

Google Cloud (100)BigQuery (83)Google Analytics (68)SQL (58)AI & ML (57)Looker Studio (51)Data Analysis (48)Privacy (45)Marketing (40)Google Tag Manager (38)
More topics
Google Ads (37)How-to (37)Testing (37)Conversion Tracking (26)React (24)Firebase Analytics (20)Dataform (19)Server-side Tagging (19)Ecommerce (15)Debugging (12)Shopify (7)Wordpress (5)Measurelab (3)MarTech (2)

100 results · Page 2 of 6

Data pipeline optimisation with Google Cloud and Dataform

In our recent engagement with a client, we went on a journey to transform their data pipelines, tackling inefficiencies in performance and cost within their Google Cloud BigQuery environment. Our efforts culminated in a comprehensive optimisation strategy that used Dataform, improved SQL practices, and implemented tailored solutions for significant performance gains and cost savings. Here’s a deep dive into the highlights of our project. Identifying inefficiencies in BigQuery workflows We beg

Prasanna Venkatesan-

Dataform for BigQuery: A basic end-to-end guide

Dataform is a powerful tool for managing your data workflows in a structured, version-controlled, and automated way. Whether you're a beginner or an experienced data engineer, Dataform simplifies SQL-based transformations while integrating seamlessly with Google BigQuery. Although this blog offers a basic introduction to Dataform's functionality, users can achieve significantly more with Dataform. From advanced scheduling, parameterised queries, and dependency management to complex data modelli

Prasanna Venkatesan-

Behind the Cloud – Releases and scheduling in Dataform

In this episode of Behind the Cloud, Matthew dives into the details of releases and scheduling in Dataform. He breaks down how to manage different versions of your codebase in GitHub. From taking snapshots, to scheduling executions at various intervals daily, hourly, or monthly. By the end of the episode, you’ll have the know-how to confidently release and schedule your code, making it easier to build robust tables and models with Dataform. Video transcript Introduction to releases and sche

Matthew Hooson-

2024: Measurelab's year in review

Same same but different At the beginning of the year, I wasn't quite sure what Measurelab would look like by the end of 2024. Altman's assistants had just been unleashed. The robots were on the march. Would the analytics arena be conquered by AI? Would we all be replaced by intelligent agents? As it turns out, no. Things are pretty much the same - on the surface at least. And that's no bad thing. After the tumultuous ups and downs of a rollercoaster 2023, I'll take steady, deliberate progress

Steven Elliott-

A step-by-step guide to migrating scheduled queries to Dataform

Managing scheduled queries in BigQuery often feels limiting — there’s no version control, no easy collaboration, and scaling can be difficult. If you’ve ever wondered how to make SQL workflows smoother, Dataform is your answer. In this post, I’ll show you how I migrated a BigQuery scheduled query to Dataform and how it transformed the way I manage my data pipelines. After all, we all want to know who’s been touching our queries, don’t we? Getting started in Dataform First thing you need to

Katie Kaczmarek-

How to set up a Dataform repository with GitHub & Google Cloud integration

Setting up a Dataform repository can be challenging without the right steps. Whether you’re new to Dataform or want to optimise your workflow, this guide will show you how to seamlessly connect it with GitHub and Google Cloud (GC). What is Dataform and why use it? Dataform is a powerful tool for managing version-controlled SQL workflows in a collaborative way. GC incorporates BigQuery and GitHub integration, providing an efficient way to organise and maintain complex data pipelines. Let’s bre

Katie Kaczmarek-

Behind the Cloud – IAM roles in Google Cloud

In this episode of Behind the Cloud, Matthew dives into Identity and Access Management (IAM) on Google Cloud. He discusses the common frustrations users face, and the significance of assigning specific, granular permissions to mitigate potential risks. Video transcript Introduction to IAM roles [00:00:00] Matt: Hello and welcome to another episode of Behind the Cloud. I’m afraid today isn’t going to be the most glamorous of episodes because what we’re here to talk about today is IAMs on GCP

Matthew Hooson-

Integrating siloed data: Springer Nature marketing and sales case study

The Springer Nature Group is an academic publishing company, with brands dating back to 1842, that advances scientific discovery by publishing robust and insightful research, supporting the development of new areas of knowledge, making ideas and information accessible around the world, and leading the way on open access. The challenge The sales and marketing teams depended on incomplete data, which didn’t capture the entire customer journey due to different systems in use. Transactions and re

Mark Rochefort-

Behind the Cloud: Using Generative AI in the GCP

In this episode of Behind the Cloud, Matthew delves into the world of generative AI in the Google Cloud Platform, highlighting how Google has integrated generative AI features into its various services. Matthew explores the ways generative AI can be used within BigQuery, such as generating SQL queries and Python notebooks! Video transcript Introduction to Generative AI in Google Cloud [00:00:00] Matt: Hello and welcome to another episode of Behind the Cloud. Uh, today we’re going to cover g

Matthew Hooson-