April-2022 Release Notes (04/05/22)
Welcome to the April 2022 Release Notes ๐ ๐ ๐
Weโre not fooling around this month. This release is seriously one of our largest ever! Weโve got HUGE updates across the board! Read on for more details! ๐
(2022-03-29/1648540807
shipped 2022-04-05).
Highlights
- +700k new POI across the globe, bringing us to more than 12 million total ๐
- +205 new brands across 138 countries ๐
- New
category_tags
for 6 million POIs in the US and CA ๐ท - Improved NAICS codes for over 1.8 million non-branded POI in the US and CA ๐งฎ
- Introducing Parking Lots with over 6 million polygons ๐ ฟ๏ธ
- Spend now includes non-branded POI and covers over 1 million POI in total ๐ณ
Enhancements
SafeGraph is delivering more POI each month in countries around the world. This month SG Places has a grand total of 12,376,710, including POI with or without geometry and closed POI. This is a net increase of 717,382 places from last month (+100,888๐บ๐ธ, +30,029๐จ๐ฆ, +32,904๐ฌ๐ง, +553,561 ๐ outside these geographies):
- + 703,015 standard POI (+94,137 ๐บ๐ธ, +25,119 ๐จ๐ฆ, +30,780 ๐ฌ๐ง, +552,979 ๐)
- + 14,367 point-only POI (+6,751 ๐บ๐ธ, +4,910๐จ๐ฆ, +2,124๐ฌ๐ง) +582 ๐)
This month we've added over 150k POI in Germany, including independently owned, non-branded POI. Some of the highlights include:
- 104,935 Restaurants and Other Eating Places (7225) ๐ด
- 17,588 Supermarkets and Other Grocery (except Convenience) Stores (445110) ๐
- 17,165 Other Gasoline Stations (447190) โฝ
- 13,749 Museums, Historical Sites, and Similar Institutions (7121) ๐ฐ
Brands
We've added a grand total of 205 brands across 138 countries. Some of the highlights:
Notable brands ๐
- Edeka (SG_BRAND_24da9d90225ec175) with 6,038 POI ๐
- Netto Marken-discount (SG_BRAND_0f6f2c08dabcd3d9) with 4,159 POI ๐ฅจ
- Repsol (SG_BRAND_980b992000d5b3c2) with 4,140 POI โฝ
Point POI brands ๐ด:
- Banque National ATM (SG_BRAND_6436fd7d294634d1) with 2,714 POI ๐ง
- Scotia Bank ATM (SG_BRAND_8e228a02ab7760ed) with 2,057 POI ๐ง
๐ Are we missing a brand or country? ๐ Please let us know here!
Brand Openings and Closings
- We rely on POI metadata to track store openings and closings, and we are especially interested in understanding open/close dates for branded POIs. It can take more than a month to infer open/close dates, so we report brand open/close metrics on a one month delay.
- In this release, we flagged 1,212 brands with at least one store closure in February 2022 and 1,369 brands with at least one store opening in February 2022:
Learn more about our open/close columns here
Categories
This month, SafeGraph updated our categorization model for non-branded places to improve our NAICS code assignments in the US and CA. This update improved our overall accuracy and incorporated feedback provided by our customers. Note, any place with a safegraph_brand_id
was not impacted by this update. Also, we did not change anything about the schema, only some of the values in naics_code
and the resulting top_category
and sub_category
labels.
You can find the full list of NAICS code mappings here, detailing counts from old NAICS codes to new NAICS codes. 1,761,662 POI received a new NAICS codes. Of those, 947,740 POI retained the same top_category
label meaning they just moved within the same NAICS code family.
Unrelated to our model change, we also updated the naics_code
for the following big box retail brands to 452311
which is Warehouse Clubs and Supercenters
๐ฆ. This change was based on customer feedback.
- Walmart (SG_BRAND_04a8ca7bf49e7ecb4a32451676e929f0) from 452319 to 452311
- Target (SG_BRAND_42aefbae01d2dfd981f7da7d823d689e) from 452210 to 452311
- Costco (SG_BRAND_60b7b54d19fca719281e76d485a141ad) from 452319 to 452311
- Samโs Club (SG_BRAND_1fdf499b6898e2c4f4c47e72ae249f4e) from 452319 to 452311
- BJโs Wholesale Club (SG_BRAND_f114e3e39748c95944856cc06c40af68) from 452319 to 452311
Category Tags
With this release, SafeGraph significantly expanded the application of Category Tags by introducing a new list of beta category tags. Category tags are additional descriptors about a POI providing additional metadata that would not be covered by a NAICS code. Category tags have historically covered bars, cafes, and restaurants (POIs with a NAICS code beginning with โ722โ). But with this new update, we are expanding beyond restaurants to cover over 6 million POI in the US. This includes both branded and non-branded POI.
A few examples of new categories that will receive these more granular category tags:
- Healthcare (NAICS codes beginning โ622โ): Audiologist, Cardiology, Dermatology, etc. ๐ฅ ๐ฉบ ๐ฆป
- Retail (NAICS codes beginning โ44โ): Outdoor Gear, Jewelry, Sportswear, Party Supplies, Leather, etc.๐งฅ ๐ ๐ผ
- Amusement/Recreation (NAICS codes beginning โ71โ): Batting Cages, Disc Golf, Go Karts, Arcade, Pool & Billiards, etc. โพ โณ ๐ฑ
Here is a spreadsheet with the counts by category tag as of this release. And for reference, here is a list of all of the possible tags for each NAICS code.
We'll continue to improve these tags in the months to come. We plan to apply them to more and more brands and also expand the use of existing tags across more NAICS codes. Please share your feedback early and often as we are eager to hear how these new tags are being put to use!
Drops โฌ๏ธ
- We are ingesting many sources and due to source changes and processing changes, Placekeys do drop over time. In this release, we dropped 139,149 Placekeys (21,684 branded and 117,465 non-branded).
- To keep track of the status, predecessors, and latest successor of each Placekey, you can try using the Lineage API.
Parking Lots
Our new Parking Lots product is a collection of over 6m rows depicting the size and shape of surface area parking lots in the US. Furthermore, each parking lot includes a column referencing nearby POI that likely utilize the lot. If purchased alongside our Places or Geometry products, weโll include a column for each POI that references nearby parking lots in those schemas as well.
A few introductory stats:
- 6,203,046 total parking lots
- 2,613,105 parking lots with at least one associated POI
- 6,103,384 POI in the US with at least one related parking lot
See our Parking Lots doc site for the full schema and additional details. Also, check out this blog for an inside look on how we developed this new product.
Premier Polygons
Every month, we highlight some of our favorite new polygons getting released. This month, here are a few of our new parking lots! Parking Lots in green. POI in blue.
Bug Fixes and Known Issues
- There are some changes to SafeGraph Geometry as a result of the improved NAICS code assignments highlighted in Places. SafeGraph references NAICS codes for certain Geometry concepts like Spatial Hierarchy (parent/child relationships) and the enclosed column (see the Geometry schema for details). These concepts also influence how visits are attributed in Patterns. Below is a summary of spatial hierarchy and enclosed changes as a result of the updated NAICS codes from above:
- ~12k POI are now parent places when they previously were not.
- ~8k POI are no longer parent places when they previously were.
- ~66k POI are now enclosed by a parent (enclosed = โtrueโ) when they previously were not - meaning these POIs are no longer eligible for Patterns visit attribution.
- ~28k POI are no longer enclosed by a parent (enclosed = โfalseโ) when they previously were - meaning these POIs are now eligible for Patterns visit attribution.
- Note: A majority of the changes are for POI in the Health Care field (NAICS code starting โ62โ). We can provide the full list of impacted Placekeys upon request. Reach out to our CSM.
Enhancements
Our Spend product debuted in January 2022 but we never stopped working on improving it. Weโre here with our first update on the growth weโve seen. You can head here for the full Spend Release Notes but a couple highlights:
- Spend now covers over 1 million POIs! ๐ณ
- We introduced Spend coverage for non-branded POI ๐
- For branded POI, weโve tripled the number of brands covered to over 3,700 ๐ฏ ๐ฏ ๐ฏ
- And for those we previously covered, over 700 brands doubled their store count coverage โซ
- We spent more time comparing our data to public sources like the Census MRTS, where we saw correlations improve in many regions and across NAICS categories ๐ถ
Enhancements
-
In last month's delivery, SG Monthly Patterns had 4,682,201 (US only). This month, SG Monthly Patterns has 4,750,974 (net +68,773).
-
Last month, SG Monthly Patterns had 1,003,942,415 visits from 37,030,933 visitors. This month, SG Monthly Patterns has 1,193,701,324 visits from 42,188,184 visitors (delta +189,758,909 visits, +5,157,251 visitors).
-
Our Neighborhood Patterns product, provides more generalized foot traffic flows across census block groups. In the
US
we have 2,373,807,505 raw stops (+403,441,096 from last month). -
Neighborhood Patterns is available in Canada! ๐จ๐ฆ Contact your CSM to learn more or add to your subscription. In
CA
we have 40,357,786 raw stops (+2,875,151 from last month).
Bug Fixes and Known Issues
- There are some changes to SafeGraph Patterns as a result of the improved NAICS code assignments highlighted in Places. SafeGraph references NAICS codes for certain Geometry concepts like Spatial Hierarchy (parent/child relationships) and the enclosed column (see the Geometry schema for details). These concepts also influence how visits are attributed in Patterns. Below is a summary of spatial hierarchy and enclosed changes as a result of the updated NAICS codes from above:
- ~12k POI are now parent places when they previously were not.
- ~8k POI are no longer parent places when they previously were.
- ~66k POI are now enclosed by a parent (enclosed = โtrueโ) when they previously were not - meaning these POIs are no longer eligible for Patterns visit attribution.
- ~28k POI are no longer enclosed by a parent (enclosed = โfalseโ) when they previously were - meaning these POIs are now eligible for Patterns visit attribution.
- Note: A majority of the changes are for POI in the Health Care field (NAICS code starting โ62โ). We can provide the full list of impacted Placekeys upon request. Reach out to our CSM.
What's New
- New Omni Search Bar: Search by Geography, Brand, or Category filters all from the same starting point ๐
- Improved Performance: From complex filters to data previews, you'll find everything just moves faster ๐จ
[Places API] (https://docs.safegraph.com/reference/places-api-overview-new)
What's New
- Category Tag Search: You can now search for POI by category tags ๐ ๐ท
- Improved Search for Long Names: Our search results have improved when searching for POI names that are especially lengthy โก
- Parent Place Object: For locations with a Parent place, you can now pull in all info related to that Parent within the same query that identified the Child place ๐ธ