My Jupyter Notebook Crashed and Now Won’t Open
February 14th, 2023 in Blog, Jupyter, Python
This is a problem that has plagued me a few times and is usually due to outputting too much in a single cell. The Notebook will run out of memory and crash, but it will contain the output that caused the notebook to crash. The notebook will crash every time you open it, for some browsers you may even see an ‘out of memory’ error message. The solution to this problem is to delete the vast amount of output, without opening the…
» Read morePart 4: Natural Language Processing – Bringing it all together!
January 23rd, 2023 in AI, Azure, Big Data, Blog, Business Intelligence, DAX, Power BI, Python
Here’s the final post in this blog series on natural language processing where we are going to bring everything together and web scrape Trust Pilot for review data, which we will then perform Natural Language Processing on and then display in a Power Bi dashboard. I’ll be talking exclusively practically in this demo, so for a refresher on the theory please refer back to my earlier blogposts (Part 1, Part 2, Part 3). To re-iterate the goal…
» Read morePurple Frog at AI and Big Data Expo
December 15th, 2022 in AI, Big Data, Blog
During the 1st and 2nd of December, Purple Frog descended on London Olympia for 2 days of AI, ML and Big Data based fun at the AI & Big Data Expo. The AI and Big Data Expo is a leading Artificial Intelligence & Big Data Conference & Exhibition that showcases the next generation enterprise technologies and strategies from the world of Artificial Intelligence & Big Data, providing an opportunity to explore and discover the…
» Read morePart 3: Natural Language Processing – Sentiment Analysis and Opinion Mining
November 24th, 2022 in AI, Azure, Big Data, Blog, Business Intelligence, Python, Synapse
If you remember in part 2 we discussed what Key Word Analysis is and how this can be implemented to gain deeper insight from textual data. But we can go one step deeper and extract feelings and opinions from the same data. We can do this through Sentiment Analysis and Opinion mining! In this blog I will talk you through what they are and how we can implement them using Microsoft’s Cognitive Services. What is Sentiment Analysis? We should…
» Read morePart 2 : Natural Language Processing- Key Word Analysis
August 10th, 2022 in AI, Azure, Big Data, Blog, Machine Learning, Python, Uncategorized
Here we are with part 2 of this blog series on web scraping and natural language processing (NLP). In the first part I discussed what web scraping was, why it’s done and how it can be done. In this part I will give you details on what NLP is at a high level, and then go into detail of an application of NLP called key word analysis (KWA). What is NLP? NLP is a form of artificial intelligence which deals with the interactions between humans…
» Read morePart 1: Web Scraping and Natural Language Processing- Web Scraping
July 18th, 2022 in AI, Blog, Machine Learning, Python
In this multi blog series I will go through what web scraping is, what Natural Language processing is as a general term as well as diving into some constituent techniques we are interested in; key word extraction, sentiment analysis and its derivative opinion mining. The last few parts will then go through a coded example of scraping the popular review site Trust pilot for reviews of the popular supermarket chain ‘Lidl’. We will then…
» Read moreDeploy Azure AutoML Model And Consume In Excel
May 31st, 2022 in Blog, Machine Learning, Uncategorized
It has come back to my turn to write a blog post, and if you remember my previous one concerned why you should use Azure based AutoMl and subsequently how to do so. If you followed that then you will be left with a model of which you’ve scored and know the performance of, but no way of how to then deploy and use your model. I will outline the steps needed to do this (which involves a major shortcut as we are using an AutoMl model), and…
» Read moreAutoML; How to use it and why
March 18th, 2022 in Blog, UncategorizedIntroduction Some of you may have noticed that the Purple Frog team were at the largest community-led SQL Server and Microsoft Data Platform conference in Europe last week; SQL Bits. With all of us learning a lot, I thought I would share some of the knowledge I picked up in the Machine Learning space with you this week. I went to a session by Gavita Regunath of Advancing Analytics on the topic of AutoML, and why not just beginners in…
» Read morePandas; Why Use It And How To Do So!
December 17th, 2021 in Big Data, Blog, Machine Learning, PythonIntroduction Hi and welcome to what will be my first frog blog! I’m Lewis Prince, a new addition to the Purple Frog team who has come on board as a Machine Learning Developer. My skill set resides mainly in Data Science and Statistics, and using Python and R to apply these. Therefore my blogs will be primarily on hints and tips on performing Data Science and Statistics through the medium of Python (and possibly R). I thought I would start…
» Read more