Big Data Archives - Purple Frog Systems

What We Heard at Big Data LDN 2026
October 10^th, 2026 in Big Data, Business, Community, News
Another Big Data LDN done, and what a busy couple of days it was for Team Purple Frog! We headed to London to talk all things data, analytics and AI, and once the doors opened, it didn’t take long for the conversations to get going. Throughout the two days, our stand welcomed people from organisations at very different stages of their data journeys. Some came with specific technical challenges, while others were exploring what Microsoft Fabric…
» Read more
How to Handle Deleted Rows in an Incremental Load
September 4^th, 2026 in Big Data, Blog, Data Lakehouse, Data Warehouse, ETL, SQL, SQL Server, SSIS, Uncategorised
Most data warehouse issues are apparent: a pipeline fails, an alert fires, you get a phone call at an unsociable hour. Deleted source data doesn’t do this. A row is removed from the source, and no one notices. It sits in the warehouse silently skewing measures and KPIs, until the finance director asks why a cancelled order is still in the revenue report. What’s causing this? Incremental loads use watermarks to avoid re-extracting…
» Read more
Predictive Analytics for Small and Medium Enterprises
November 3^rd, 2025 in AI, Azure, Big Data, Blog, Business, Fabric
For many years, predictive analytics was a luxury reserved for large enterprises with deep pockets and advanced infrastructure. Today, thanks to the power of cloud computing, AI-driven tools, and accessible business intelligence platforms like Power BI, small and medium enterprises (SMEs) can tap into predictive analytics to transform how they plan and grow. At Purple Frog Systems, we’ve seen firsthand how even modest-sized organisations can…
» Read more
My Trip To BDL: Insights, Innovation & Responsible AI
October 14^th, 2025 in AI, Artificial Intelligence, Azure, Big Data, Blog, Community
Last month, I had the opportunity to attend Big Data London (BDL), the UK’s largest data and analytics conference, bringing together thought leaders, engineers, and strategists shaping the future of data-driven transformation. Across two days, the atmosphere was amazing: over 300 expert speakers, hands-on tech demos, and insightful panels exploring everything from AI governance to the latest in cloud analytics and data architecture. In this…
» Read more
Purple Frog at Big Data LDN 2025: Exploring the Future of Data and AI
October 10^th, 2025 in Big Data, Just For Fun, News
Last week, our Senior Data Engineer, Callum Bryant, and Senior AI Engineer, Lewis Prince, attended Big Data LDN, one of the UK’s leading events for data, analytics, and AI professionals. Over two packed days, they joined thousands of delegates, thought leaders, and technology experts to explore the latest trends shaping the future of data-driven innovation. From emerging best practices in cloud analytics and data governance to the real-world…
» Read more
AI and Big Data Expo London 2025
February 12^th, 2025 in AI, Big Data, Blog, Community, Machine Learning
Exploring the future at the AI and Big Data Expo London 2025 Last week, I had the incredible opportunity to attend the AI and Big Data Expo Global 2025 at the Olympia in London. This event brought together attendees which included top executives, industry leaders, and tech enthusiasts from around the world. It was a fantastic experience filled with insightful sessions, networking opportunities, and a glimpse into the future of AI and Big Data.…
» Read more
You need a data strategy to harness AI
February 11^th, 2025 in Big Data, Blog, Business Intelligence, Cloud, Cybersecurity, Machine Learning
By embracing AI and data analytics, UK businesses could significantly boost their productivity, streamline operations, and gain a competitive edge in the market. Investing in AI not only promises enhanced efficiency but also opens up new opportunities for innovation and growth. You need a data strategy to harness AI Data is now the most valuable commodity in the world, surpassing oil in terms of worth. Just like oil, data needs to be extracted,…
» Read more
How Did Hollie Inspire a Data Revolution at CompTIA Connect?
October 24^th, 2024 in AI, Artificial Intelligence, Big Data, Community, Machine Learning, News
On Monday, at CompTIA Connect 2024, the audience was captivated by a keynote presentation ‘Unleashing Data Power: Supercharge Your Business Strategy’ from our HR & InfoSec Director, Hollie, who is a recognised business leader within the industry and in the fields of data and Artificial Intelligence. Her presentation delved into the rapidly evolving landscape of these technologies and how they are and can be poised to transform industries…
» Read more
The Role of AI in Business
July 4^th, 2024 in Artificial Intelligence, Big Data, Blog, Machine Learning
The landscape of business is undergoing a dramatic transformation driven by Artificial Intelligence (AI). No longer science fiction, AI is rapidly becoming a powerful tool for companies of all sizes, streamlining operations, enhancing customer experiences, and fueling innovation. Let’s dive into how AI is revolutionising the business world Supercharging efficiency Imagine a world where mundane tasks are handled flawlessly and…
» Read more
What is Microsoft Fabric? (Power BI + Synapse + DW + DataLake + ML)
May 23^rd, 2023 in AI, Big Data, Blog, Business Intelligence, Data Factory, Data Lake, Fabric, Power BI, PowerBI, Spark
At today’s Build conference, Microsoft announced Fabric. What is this? In simple terms, think of taking Synapse Analytics, Data Warehousing, Data Lakes, Data Factory, Spark Notebooks and Machine Learning, and bring them all together into Power BI. This is underpinned by Microsoft OneLake, a high performance scalable data lake storage layer, supporting all of the above. OneLake is, as the name implies, one data lake that can be used across…
» Read more

Alex Whittles (MVP)
Annabel Hemingbrough
Callum Bryant
Hollie Whittles
James Snow
Jeet Kainth
Joe Billingham
Jon Fletcher
Laura Adamson
Lewis Prince (MVP)
Matt Mair-Durrant
Nick Edwards
Tom Owen