Following up with the US amateur licenses discussion earlier (https://mastodon.sdf.org/@jdavis/111720350879036543), I found some data and made some plots.

Data from ARRL using the Internet Wayback Machine: https://web.archive.org/web/20150905095114/http://www.arrl.org/fcc-license-counts

I'll put this in a blog post when I get a chance, and share the CSV file when I do. #hamRadio #amateurRadio

Jeff KE9V :sdf: (@[email protected])

"...some disturbing news in hamlandia about the precipitous drop in the number of US amateur radio licensees..." https://ke9v.net/2024/01/08/fading-away.html #hamradio

Mastodon @ SDF
Looking closer at AH0A's site, he has the total (not split out by state) data back to 1997 in tabular format. I'll see if I can add that in. http://ah0a.org/FCC/Licenses.html

I found some more US #hamRadio license count data in various places and put it all together here. Download the CSV and fool around if you'd like! https://amiok.net/gitea/W1CDN/ham-radio-licenses

Haven't gotten to state-by-state numbers yet.

There *is* a very rough interactive version of the total license plot if you trust me enough to download this HTML file with JS: https://amiok.net/gitea/W1CDN/ham-radio-licenses/src/branch/main/plots/total-over-time-y.html

Big shoutout to @dlarc for the W3HF dataset!

ham-radio-licenses

Datasets and time-series plots of US ham radio license counts over time.

Gitea
Now setting up a cron job using https://github.com/overcast07/wayback-machine-spn-scripts so we can archive the ARRL stats every weekday going forward.
GitHub - overcast07/wayback-machine-spn-scripts: Bash scripts which interact with Internet Archive Wayback Machine's Save Page Now

Bash scripts which interact with Internet Archive Wayback Machine's Save Page Now - overcast07/wayback-machine-spn-scripts

GitHub

Added some more data from W5YI Report issues in @dlarc as well as class data from W3HF. Class plots are getting funky now.

https://amiok.net/gitea/W1CDN/ham-radio-licenses

ham-radio-licenses

Datasets and time-series plots of US ham radio license counts over time.

Gitea
Updated with the last few days of FCC data via ARRL. Here are new plots of the last two years. The rest of the plots and data are at https://amiok.net/gitea/W1CDN/ham-radio-licenses.
(Edited to fix plot with bad x-axis labels.)
ham-radio-licenses

Datasets and time-series plots of US ham radio license counts over time.

Gitea

It's been a while but there is a slight flattening of the ARRL license count lately (~last three weeks).

I'm not caught up on the AE7Q and HamCall numbers, but they are consistently above the ARRL numbers.

And just an update on how this is going; every few weeks I update the latest data, but I'm also still going through historical data from the W5YI Report.

All data and plots here: https://amiok.net/gitea/W1CDN/ham-radio-licenses #hamRadio #amateurRadio

ham-radio-licenses

Datasets and time-series plots of US ham radio license counts over time.

Gitea

Welp, that didn't last long.

My most recent update was only for the ARRL FCC numbers. All data and plots here: https://amiok.net/gitea/W1CDN/ham-radio-licenses #hamRadio #amateurRadio

ham-radio-licenses

Datasets and time-series plots of US ham radio license counts over time.

Gitea

US #hamRadio license counts have been updated.

We continue to see a drop of ~1000-1500 licensed hams per month since December 2021. Here's the last two months of totals, according to the FCC counts posted by ARRL:

Now that I'm scraping some of these websites, the updates are easier (but I also forget about them). Data: https://amiok.net/gitea/W1CDN/ham-radio-licenses

ham-radio-licenses

Datasets and time-series plots of US ham radio license counts over time.

Gitea

I do have "enter numbers of new licenses" in the backlog, but there's only so much time I have for this. Licensing rate may help people who are afraid of the hobby dying.

There are bound to be errors in my data--but this is common ground to start from and fix as we go.

I updated the US #hamRadio license counts yesterday. No real change in trends. I need to prioritize filling in historical data so there aren't big gaps in the data.

https://amiok.net/gitea/W1CDN/ham-radio-licenses

ham-radio-licenses

Datasets and time-series plots of US ham radio license counts over time.

Gitea

I am starting to play with new US FCC ham radio license counts scraped from AE7Q.

How should I structure these data so they are useful?

Attached is an example of what I can summarize down to for FCC actions on a certain date. Or I could just count brand new systematic callsigns--these indicate brand new hams (and maybe a few old hams getting back into it). Maybe the cleanest number for how fast/slow growth is over time.

AE7Q has historic data back to 1994. https://amiok.net/gitea/W1CDN/ham-radio-licenses/issues/114

AE7Q new license counts

To track new licenses over time, can we scrape the table under "Retrieving license grants issued on"? Note the date in the URL for easy downloading. https://www.ae7q.com/query/list/ProcessDate.php?DATE=2024-2-02 This goes back to one of the W5YI Report comments that the only way to really m...

Gitea

Interesting thing about the AE7Q database is that "License Status" is as of the date the query is run.

So if you query and see "new systematic call sign assigned" and "canceled" together, that means the call was canceled (maybe in favor of a vanity) *after* the activity date and *before* the query was run.

Another update to the US #hamRadio license counts. I made a few plots of the license action summary data from AE7Q's database at the bottom of the README.

It's interesting that new licenses seem to peak in April/May and valley in September for the last few years.

https://amiok.net/gitea/W1CDN/ham-radio-licenses

ham-radio-licenses

Datasets and time-series plots of US ham radio license counts over time.

Gitea

Updated the easy total/state/city US #hamRadio data. Something interesting happening in total license count since July 2024.

I need to figure out why my license action scraper isn't working and update those data for the past few months.

https://amiok.net/gitea/W1CDN/ham-radio-licenses

ham-radio-licenses

Datasets and time-series plots of US ham radio license counts over time.

Gitea
Updated the ham radio license data again: https://amiok.net/gitea/W1CDN/ham-radio-licenses
ham-radio-licenses

Datasets and time-series plots of US ham radio license counts over time.

Gitea

@W1CDN

Matt

Is there a straightforward way to get license counts by US county in any of this?

I know that I've seen "top cities" tables, but no aggregates at the county level. And selfishly I'd love to have some orderly way to track "active licenses in Washtenaw County, Michigan" over time.

@W1CDN brb, busy downloading the entire license database from the FCC and extracting some tables, I think I can do this at least locally
@w8emv I haven't tried to look at the raw data in a long time, can you work it into something that makes sense?

@W1CDN

My Linux toolkit of choice for dealing with tabular data is "csvkit" which does a good job of slicing and dicing tabular data. The amateur data set includes a table EN.dat which looks pretty complete for individual user records.

Some fields are obvious, but not all are, and I'll have to do some further reading in the data dictionary.

that said I did find this pretty interesting FCC DB to SQL importer from #K3NG

https://github.com/k3ng/hamdb

with a writeup here

https://blog.radioartisan.com/fcc-callsign-database-script/

GitHub - k3ng/hamdb: A bash script that downloads FCC Amateur Radio licenses data, populates a database, and has a query tool

A bash script that downloads FCC Amateur Radio licenses data, populates a database, and has a query tool - k3ng/hamdb

GitHub
@w8emv that looks familiar! I think I have it written down but haven't tried to make it go.
@W1CDN @w8emv here, I wrote this a few years ago to dump both the application and license databases into SQL.

https://github.com/nkbooth/ULSUpdater

You can get the table definitions from the fcc website, but keep in mind they aren’t always accurate.

https://www.fcc.gov/wireless/data/public-access-files-database-downloads
GitHub - nkbooth/ULSUpdater: PHP script to parse the FCC Public Access files and publish into a more standards-compliant database.

PHP script to parse the FCC Public Access files and publish into a more standards-compliant database. - nkbooth/ULSUpdater

GitHub

@alatartheblue @W1CDN @w8emv

It seems this is a common thing. I made https://github.com/tarxvftech/fcc_licdb along the same lines. Python and sqlite. Some worked examples in main.py for the ORI AMTS regulatory work.

I don't see county stored in ULS.

Since that county has zip codes straddling the county lines, I suppose you could geocode the addresses in those zip codes and then check whether each is within the county bounds.

GitHub - tarxvftech/fcc_licdb

Contribute to tarxvftech/fcc_licdb development by creating an account on GitHub.

GitHub
@tarxvf @w8emv @W1CDN that would be the only way to do it. It gets even more interesting when you try to bounce that off the fact that some states don’t *have* counties.

@tarxvf @alatartheblue @W1CDN

Thanks all for making sense of FCC records. I'm going to finesse the county issue by making lists of zip codes for the nearby counties I care about, and I'll just have to be OK with imprecise results at the edges.

My ambition is to download each of these tools, try them out to do something non-trivial, maybe open up an issue if I find something useful, and write up my findings somewhere that I can share them.

(But first: it's a sunny day and my bicycle calls)