How to scrape data from Google Maps
Hey, we're Apify. You can build, deploy, share, and monitor any scrapers on the Apify platform.
Weβre going to show you how to use the Apify platform and a ready-made tool called Google Maps Scraper to extract data from Google Maps. This scraper, or crawler, will enable you to extract the most recent Google Maps data directly from the website, including reviews, images, opening hours, and popular times.
To learn how to achieve this, you can follow a step-by-step guide here or head over to our short YouTube tutorial πΉπ΄βΆοΈ
π What data can I extract from Google Maps?
π Place ID, subtitle, category, name, and URL | βοΈ Review text | βοΈ Phone and website, if available |
π Address, location, plus code | π People also search | π Published date |
π° Geolocation | π Images | π³ Hotel room price |
π· Menu and price, if available | β List of detailed characteristics (additionalInfo, optional) | π©βπ» Response from owner - text and published date |
π Temporarily or permanently closed status | π€³ Review images | π Review ID & URL |
π§βπ³ Opening hours | π Language & translation settings | π Reviews sorting and filtering |
βοΈ Popular times - histogram & live occupancy | π Reviewer name and ID | π¨ Hotel booking URL+ nearby hotels |
π Stars | βοΈ Average rating (totalScore), review count, and review distribution | π Updates from customers & Questions and answers |
π€ Can I use AI to scrape Google Maps?
AI is currently unable to scrape websites directly, but it can help generate code for scraping Google Maps if you prompt it with the target elements you want to scrape. Note that the code may not be functional, and website structure and design changes may impact the targeted elements and attributes.
πΏ Why not use the official Google Maps API?
Some massively popular websites such as Instagram and Amazon do provide APIs for their users to access part of their data, scraping purposes included. Google Maps is among these websites. So why do people search for unofficial Google Maps API in the first place when thereβs an official API around?
The answer is the limitations of the Google Maps API and the need to find alternatives to get around these limitations. Back in 2010, Google Places API introduced considerable limitations on scraping their data. Here are just a few reasons why alternatives to Google Maps API are popular:
π· Prices got pretty high. In 2010, Google Places made using their APIs paid. 8 years later, in 2018, Google introduced a new billing model for businesses using Google Maps APIs. The amount of free API calls has been cut, and the new pricing wasnβt welcome.
π€ Pricing model is also tricky. After using up the freemium monthly credits of $200, which include a seemingly safe package of 28K Dynamic Maps loads, 100K Static Maps loads, 40K Directions calls and 40K Geolocation calls, things get tricky. However, the costs go pretty high if you decide to use Embed API in Directions, Views, or Search mode. And donβt even get us started on autocomplete - that one consumes credits like wildfire.
π Authentication gate. Your API calls have to include a valid API key linked to a Google Cloud Platform account; yes, even if your usage remains within the initial free $200 credit.
π Limited number of free API calls. 28K dynamic loads per month for free (compared to 25K per day before 2018 pricing change). All this leads toβ¦
π Anxious monitoring. You have to constantly keep an eye on your API usage so as to stay within the limits because you donβt want to face consequences when your account gets blocked out of the blue for overusage.
β± Imposed limitations on results. Google Places API enforces rate limits (100 requests per second) and IP quotas. Some features are still unavailable in Place API such as Popular place times histogram.
π Unpredictability. Google can make any changes to the paid API, or impose new restrictions at any moment. Adapting to those changes can influence your solution significantly and without warning.
These are just a few reasons that encouraged businesses and developers around the world to find alternative ways to scrape the Google Maps website, such as Google Maps Scraper π, which now accounts for 30+K users. While the official Google Maps Places API can be an adequate option in some cases, low-code crawlers such as ours can provide:
𧬠Unlimited results
π All place reviews
π All place images
π Popular place times histogram
πΊ Visual representation of scraped data
πΈ All for a better price
Now let's walk you through every step of the process of scraping Google Maps.
βπ How to scrape Google Maps?
There are two ways of scraping Google Maps efficiently: either by using a ready-made scraper (or crawler) or by creating a scraping bot of your own. Since Google Maps is a complex site to extract data from (and to build a web scraper for), let's try out the ready-made option first.
Step 1. Go to Google Maps Scraper
First, go to the Google Maps Scraper page and click the Try for free button.
Step 1. Find Google Maps Scraper on Apify Store
You can create a free account using only your email address or GitHub account. Afterward, you will be redirected to Apify Console β your workspace for all things data extraction.
Sign up to scrape Google Maps data for free
Step 2. Indicate the search term or URL to scrape
There are two ways to get your Google Maps data. Choose your starting point: search terms π or URLs βπ .
ππ How to scrape Google Maps by search term + location
Enter your search terms in the first fields of the scraper, e.g., bagel -> New York. That would be enough for a regular scrape. The scraper will find places in New York City that mention Bagel π₯―
.
Step 2. Indicate the search term and location to scrape data from Google Maps
Alternatively, you can make your search even more granular in the π‘ Define the search area either by typing the rest of the address (state, US county, postal code) or by inserting the latitude and longitude coordinates of the area of your interest. More detailed guide here π°.
How to scrape Google Maps by area coordinates or postal address
π πΊ How to scrape Google Maps by URL?
Open the Google Maps website in a separate tab, search for New York -> bagel and, once Google Maps provides you with results, copy the URL and paste it into the respective field.
π πΊ How to scrape Google Maps by UR**L**
With this option, you can also adjust the zoom level of the area to scrape, before you copy-paste the URL. If you zoom in, you will get more detailed results, including smaller businesses. Otherwise, you will obtain what Google Maps will consider the most relevant places over a larger area. More detailed guide here π.
Step 3. Click Start βΆοΈ
Once you are all set, click the Start button. Notice that your task will change its status to RunningπββοΈ, so wait for the scraper to finish. It might take a few minutes before you see the status switch to Succeeded π; this depends on the complexity of your search and how many places you've indicated.
Step 3. Start Google Maps Scraper and wait till the status turns to Succeeded π
Step 4. Download data from Google Maps
To preview and download the dataset, move over to the Storage tab or click on the Export X results button. It will contain your scraped data in various formats, including HTML table, JSON, CSV, Excel, XML, and RSS feed. Besides the format, you can also choose which part of the dataset you want to download: all data, rating, contact info or reviews, or even which specific fields to keep or get rid of.
Part of the Google Maps dataset - basic info about the restaurant
Finally, if this particular scraper seems too advanced for your needs, have no fear. There is also Fast Google Maps Scraper. It has an easier interface and is great for quickly scraping Google Maps.
π Need more Google scraping tools?
If you have a specific scraping case for Google data extraction (or Google API), check out these simple scrapers. They're designed to handle Google scraping and data extraction from Google Trends, News, Lens, Images, and even Google Search. Take a peek and see if any of them fit the bill.
βοΈ Google Reviews Scraper | |
π Google SERP Scraper | |
π Google Jobs Scraper | π° Google News Scraper |
π Google Translator | |
π· Google Lens | |
πWant to know more about how to use Google Maps Scraper to get reviews, geolocation or addresses? Check out this comprehensive guide.
β FAQ
π§ββοΈ Is it legal to extract data from Google Maps?
Anybody can get information from publicly available websites - web scraping is just a faster and more efficient way to get the job done. It is therefore legal, as long as you respect the personal data and copyright laws. To learn more about the legality of web scraping, read our blog post on the subject.
βοΈ Is it legal to scrape Google Maps reviews?
Yes, but with caveats. Public reviews posted on Google Maps often contain personal information such as a name, profile image, review ID. All that information combined could be potentially used to identify the reviewer - which is protected by GDPR in the EU and by other laws around the world, and for a good reason.
You should only scrape personal data if you have a legitimate reason to do so, and you should also factor in Google's Terms of Use. We are aware of that and built our Google Reviews Scraper in a way to be able to avoid extracting personal data. You can read the basics of ethical web scraping in our expert piece on the legality of web scraping.
π³ Is Google Maps API free?
No. Google Places APIs used to have a free tier, but in 2018, they introduced a new billing model which reduced the amount of free API calls available. After using up the free credits, costs can quickly become expensive, especially if you use certain features like Embed API or Autocomplete.
π Can I scrape Google Place IDs?
Yes. Google Maps Scraper π extracts Google Place IDs, among other things like place name, address, contact details like website and phone number, reviews, opening hours, popular times, open/closed status, menu, and prices. If you want to scrape Google Maps using place ID as an input, you should try πΌ Google Maps Business Scraper.
β½οΈ Can I scrape gas prices from Google Maps?
Yes. Any data that you can see on Google Maps website you can also extract. That data includes gas prices, gas type, gas station location and details, price update time, etc. Check out our tutorial on how you can use a Gas Prices Scraper to that end.
βοΈ How do I extract email from Google Maps?
You can use a web scraper tool created specifically to extract contact details from Google Business Profile (formerly Google My Business). Google Maps Email Extractor will get you G Maps business details such as place name, location, website, phone number. Besides, you can get info on rating, number of reviews, popular times, category, ads if available, opening hours and URLs. It can also include detailed reviews of every place as well as their translations.
π·ββοΈ Can I build my own Google Maps data scraper?
If you want to make a map scraper of your own, you can do it, but these days you don't have to start from scratch. Start off with a simple web scraping template in Python, JavaScript, and TypeScript. You can host your scraper on the Apify platform which will cover the proxy, monitoring, and scheduling.
π‘ Do I need proxies to scrape Google Maps?
It's preferable to scrape such a huge website as Google Maps by using proxies, that way, it's faster and more efficient. Because of this, if you get serious about scraping Maps, it will eventually start costing you at least a little cash, but in the meantime, you can get one month of Apify Proxy free as soon as you sign up at Apify.
π² Can I integrate data from Google Maps with my app?
Yes, though the data has to be in machine-readable format. Apify platform stores data in universal formats such as JSON, XML or CSV which makes it easy to plug in extracted Google Maps data into other apps. The platform also allows seamless data integration across various integration tools such as Zapier, Make, Airbyte, Keboola, and others. To make this happen, all you need to know is the dataset's ID.
πββοΈ How do I scrape my location on Google Maps?
You can get G Maps data from the exact location by indicating coordinates or postal address, including your current location. Here's how to do it in 4 steps with Google Maps Scraper:
Head over to the π° Define the search area section and indicate your postal details (country, state, city, zip code).
Alternatively, indicate your exact coordinates (longitude and latitude).
Begin data collection by clicking 'Start'.
Download your Google Maps data in CSV format.
β How to scrape data from Google Maps without getting blocked?
The best way is to use proxies. The vast majority of the websites use anti-blocking protections of varying caliber to fend off bots. That's understandable β traffic that comes from real visitors is more valuable than the bots' traffic (even if the bot comes at the command of a real human). To avoid getting blocked while scraping Google Maps, or any other website for that matter, you should first try using data-center or residential proxies along with your web scraper.
π° Can I scrape Google Maps by geolocation?
Yes. Extracting data by geolocation can be very handy because you can create various irregular shapes for specific areas on the map. We recommend using Geojson.io for an easy coordinates definition and following our guide to see how to apply those coordinates in Google Maps scraper.
π How to use data extracted from Google Maps
These days, without a digital presence on Google Maps, a local business can count itself as pretty much invisible. That's why Google Maps is a colossal free data repository for businesses and organizations, which makes it a goldmine for extracting all kinds of invaluable data: from reviews, geolocation, and gas prices to contact data such as emails, phone numbers, addresses, and websites companies in the general vicinity. Here are just a couple of examples of how you can use this extracted data:
βοΈ Generate leads. By scraping Google Maps, you can build your own database of emails, phone numbers, reviews, ratings, and businesses for a targeted place, industry, or country.
π§Έ Monitor brand sentiment. You can analyze collected Google Maps reviews for positive/negative sentiment, quality of service, and specific phrases. Our Google Maps Reviews Scraper focuses specifically on Google Maps reviews, including reviewer name, reviewer ID & URL, reviewer number of reviews, and Is Local Guide parameter.
π§βπ» Create a potential customer base. Websites and contact information are scattered all over the internet, but trying to find them takes a lot of time. Google Maps is one place where many of your prospects are gathered together.
π Search, monitor, and analyze the competitors' offers. Scraping Google Maps reviews about competitors can be a useful review framework for your business and can give you the capability to provide your clients with a better marketing service.
πΊ Analyze geospatial data for scientific or engineering work. For instance, when working with satellite data and geolocation or analyzing territorial changes before and after an event, as has been thoroughly done in this Bellingcat study.
β½οΈ Get gas prices. Google Maps also provides an opportunity to get recent gas prices from the area, along with details on field type, company supplier, and more. You can use Gas Stations Scraper to that end.
π΅οΈ Carry out a product hunt. Find businesses offering the product you're searching for and choose the best option out of the pool of results.
π Benefit from big data, even if you're a small player. Find opportunities for expanding your business or organization and developing a working market strategy.
There are many other ways to use that Google Maps data. For example, custom mapping solutions might be made out of it. With that, your business will not just exist; it'll stand out on digital maps and provide tailored experiences for your customers.
However, in order to create a whole database, you may need to automate the process of data collection. One way to do that is via an official Google Maps API, but it won't be easy, as you know by now. You can always opt for a completely different Google Maps data extraction tool that can provide a full range of results, such as this free Google Maps Scraper or other Google scraping tools.
Subscribe to my newsletter
Read articles from Apify directly inside your inbox. Subscribe to the newsletter, and don't miss out.
Written by