diff --git a/docs/api/covidcast-signals/_source-template.md b/docs/api/covidcast-signals/_source-template.md index f2e966817..a13efd3ff 100644 --- a/docs/api/covidcast-signals/_source-template.md +++ b/docs/api/covidcast-signals/_source-template.md @@ -9,8 +9,7 @@ grand_parent: Main Endpoint (COVIDcast) * **Source name:** `SOURCE-API-NAME` * **Earliest issue available:** DATE RELEASED TO API -* **Number of data revisions since 19 May 2020:** 0 -* **Date of last change:** Never +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** county, hrr, msa, state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [LICENSE NAME](../covidcast_licensing.md#APPLICABLE-SECTION) @@ -21,6 +20,15 @@ A brief description of what this source measures. |---------------|----------------------------------------------------------------------------------------------------------| | `signal_name` | Brief description of the signal, including the units it is measured in and any smoothing that is applied | +## Changelog + +
+Click to expand + +Your collapsible content goes here. You can still use **Markdown** inside. + +
+ ## Table of contents {: .no_toc .text-delta} diff --git a/docs/api/covidcast-signals/chng.md b/docs/api/covidcast-signals/chng.md index 06b6d5a29..1886ad289 100644 --- a/docs/api/covidcast-signals/chng.md +++ b/docs/api/covidcast-signals/chng.md @@ -10,12 +10,22 @@ nav_order: 1 * **Source name:** `chng` * **Earliest issue available:** November 4, 2020 -* **Number of data revisions since May 19, 2020:** 0 -* **Date of last change:** Never +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** county, hrr, msa, state, hhs, nation (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY-NC](../covidcast_licensing.md#creative-commons-attribution-noncommercial) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +No changes so far. + +
+ ## Overview **Notice: This data source was inactive between 2021-10-04 and 2021-12-02 to allow us resolve some problems with the data pipeline. We have resumed daily updates and are working on a data patch to fill the gap. [Additional details on this inactive period are available below](#pipeline-pause).** diff --git a/docs/api/covidcast-signals/covid-act-now.md b/docs/api/covidcast-signals/covid-act-now.md index 41a5cabc2..29a80ace6 100644 --- a/docs/api/covidcast-signals/covid-act-now.md +++ b/docs/api/covidcast-signals/covid-act-now.md @@ -9,13 +9,25 @@ nav_order: 2 {: .no_toc} * **Source name:** `covid-act-now` -* **Earliest issue available:** 2021-03-25 -* **Number of data revisions since 19 May 2020:** 0 -* **Date of last change:** Never +* **Earliest issue available:** March 25, 2021 +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** county, hrr, msa, state, hhs, nation (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY-NC](../covidcast_licensing.md#creative-commons-attribution-noncommercial) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +No changes so far. + +
+ +## Overview + The [COVID Act Now (CAN)](https://covidactnow.org/) data source provides COVID-19 testing statistics, such as positivity rates and total tests performed. The county-level positivity rates and test totals are pulled directly from CAN using [their API](https://covidactnow.org/data-api). While CAN provides this data potentially from multiple sources, we only use data that CAN sources from the diff --git a/docs/api/covidcast-signals/covid-trends-and-impact-survey.md b/docs/api/covidcast-signals/covid-trends-and-impact-survey.md index 147566f98..3e27fe373 100644 --- a/docs/api/covidcast-signals/covid-trends-and-impact-survey.md +++ b/docs/api/covidcast-signals/covid-trends-and-impact-survey.md @@ -11,12 +11,41 @@ permalink: api/covidcast-signals/fb-survey.html * **Source name:** `fb-survey` * **Earliest issue available:** April 29, 2020 -* **Number of data revisions since May 19, 2020:** 1 -* **Date of last change:** [June 3, 2020](../covidcast_changelog.md#fb-survey) +* **Date of last data revision:** June 3, 2020 (see [data revision docs](../covidcast_changelog.md#fb-survey)) * **Available for:** county, hrr, msa, state, nation (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY](../covidcast_licensing.md#creative-commons-attribution) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +### June 3, 2020 + +Duplicate survey weights had corrupted historical figures for the following signals and dates. The correct data has been restored to the API. +* `raw_wcli` + * `county`: 20200406, 20200408, 20200410, 20200430 + * `hrr`: 20200406, 20200408-20200410, 20200430 + * `msa`: 20200408, 20200410, 20200430 + * `state`: 20200408-20200410, 20200430 +* `smoothed_wcli` + * `county`: 20200406, 20200408-20200414, 20200430-20200506 + * `hrr`: 20200406-20200415, 20200430-20200506 + * `msa`: 20200408-20200414, 20200430-20200506 + * `state`: 20200408-20200416, 20200430-20200506 + +### November 20, 2020 + +Due to a bug in our data processing system, estimates of the percentage of people reporting that they have been tested for COVID-19 calculated before October 8th were incorrect. +We incorrectly treated an answer of “no” as a missing response, which affected the `smoothed_tested_14d` and `smoothed_wtested_14d` signals from the `fb-survey` source. + +As of Nov. 20th, the error has been corrected and all affected data reissued. + +
+ ## Overview This data source is based on the [COVID-19 Trends and Impact Survey (CTIS)](../../symptom-survey/) diff --git a/docs/api/covidcast-signals/doctor-visits.md b/docs/api/covidcast-signals/doctor-visits.md index 5eb9c96a9..71865f948 100644 --- a/docs/api/covidcast-signals/doctor-visits.md +++ b/docs/api/covidcast-signals/doctor-visits.md @@ -10,12 +10,22 @@ nav_order: 1 * **Source name:** `doctor-visits` * **Earliest issue available:** April 29, 2020 -* **Number of data revisions since May 19, 2020:** 1 -* **Date of last change:** November 9, 2020 +* **Date of last data revision:** November 9, 2020 (see [data revision docs](#changelog)) * **Available for:** county, hrr, msa, state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY](../covidcast_licensing.md#creative-commons-attribution) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +### November 9, 2020 +We went from a custom geo-mapping file (for aggregating from county->(msa, hrr, state)) to a central geo file based on rigorously sourced US census data. + +
## Overview diff --git a/docs/api/covidcast-signals/dsew-cpr.md b/docs/api/covidcast-signals/dsew-cpr.md index 82e76d7df..f1a65cbaf 100644 --- a/docs/api/covidcast-signals/dsew-cpr.md +++ b/docs/api/covidcast-signals/dsew-cpr.md @@ -9,13 +9,25 @@ nav_order: 2 {: .no_toc} * **Source name:** `dsew-cpr` -* **Earliest issue available:** 2022-01-28 -* **Number of data revisions since 19 May 2020:** 0 -* **Date of last change:** Never +* **Earliest issue available:** January 28, 2022 +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** county, msa, state, hhs, nation (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [Public Domain US Government](https://www.usa.gov/government-works) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +No changes so far. + +
+ +## Overview + The Community Profile Report (CPR) is published by the Data Strategy and Execution Workgroup (DSEW) of the White House COVID-19 Team. For more information, see the [official description at healthdata.gov](https://healthdata.gov/Health/COVID-19-Community-Profile-Report/gqxm-d9w9) for "COVID-19 Community Profile Report". Each issue of the CPR is made available as an attachment on that page. You can view all attachments by scrolling to the bottom of the "About this dataset" panel and clicking "Show more". This data source provides various COVID-19 related metrics, of which we report hospital admissions and vaccinations. diff --git a/docs/api/covidcast-signals/ght.md b/docs/api/covidcast-signals/ght.md index 9b592f60e..a80a86a4d 100644 --- a/docs/api/covidcast-signals/ght.md +++ b/docs/api/covidcast-signals/ght.md @@ -10,11 +10,21 @@ nav_order: 2 * **Source name:** `ght` * **Earliest issue available:** April 29, 2020 -* **Number of data revisions since May 19, 2020:** 0 -* **Date of last change:** Never +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** dma, hrr, msa, state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +No changes so far. + +
+ ## Overview This data source (`ght`) is based on Google searches, provided to us by Google diff --git a/docs/api/covidcast-signals/google-survey.md b/docs/api/covidcast-signals/google-survey.md index d758d6a8b..ca42ab7b9 100644 --- a/docs/api/covidcast-signals/google-survey.md +++ b/docs/api/covidcast-signals/google-survey.md @@ -10,12 +10,22 @@ nav_order: 2 * **Source name:** `google-survey` * **Earliest issue available:** May 01, 2020 -* **Number of data revisions since May 19, 2020:** 0 -* **Date of last change:** Never +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** county, hrr, msa, state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY](../covidcast_licensing.md#creative-commons-attribution) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +No changes so far. + +
+ ## Overview Data source based on [Google-run symptom surveys](https://9to5google.com/2020/03/23/google-coronavirus-survey/), through publisher websites, diff --git a/docs/api/covidcast-signals/google-symptoms.md b/docs/api/covidcast-signals/google-symptoms.md index f37926242..05349daa0 100644 --- a/docs/api/covidcast-signals/google-symptoms.md +++ b/docs/api/covidcast-signals/google-symptoms.md @@ -10,12 +10,24 @@ nav_order: 1 * **Source name:** `google-symptoms` * **Earliest issue available:** Aug 20, 2017 -* **Number of data revisions since May 19, 2020:** 1 -* **Date of last change:** February 28, 2025 +* **Date of last data revision:** March 14, 2025 (see [data revision docs](#changelog)) * **Available for:** county, MSA, HRR, state, HHS, nation (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** To download or use the data, you must agree to the Google [Terms of Service](https://policies.google.com/terms) +## Changelog + +
+Click to expand + +### March 14, 2025 +Google added earlier dates starting from 2017-08-15 and also fixed a gap of county-level data from November 14 2022 through February 20, 2023. + +### February 14, 2025 +We added a new signal s07_raw_search and s07_smoothed_search. + +
+ ## Overview This data source is based on the [COVID-19 Search Trends symptoms diff --git a/docs/api/covidcast-signals/hhs.md b/docs/api/covidcast-signals/hhs.md index d591aa720..dba2e1990 100644 --- a/docs/api/covidcast-signals/hhs.md +++ b/docs/api/covidcast-signals/hhs.md @@ -10,12 +10,24 @@ nav_order: 2 * **Source name:** `hhs` * **Earliest issue available:** November 16, 2020 -* **Number of data revisions since 19 May 2020:** 0 -* **Date of last change:** Never +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** state, hhs, nation (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [Public Domain US Government](https://www.usa.gov/government-works) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +No changes so far. + +
+ +## Overview + The U.S. Department of Health & Human Services (HHS) publishes several datasets on patient impact and hospital capacity. The data is made available to HHS through the CDC’s National Healthcare Safety Network (NHSN). One of these diff --git a/docs/api/covidcast-signals/hospital-admissions.md b/docs/api/covidcast-signals/hospital-admissions.md index 1dcd5959f..a76e44a65 100644 --- a/docs/api/covidcast-signals/hospital-admissions.md +++ b/docs/api/covidcast-signals/hospital-admissions.md @@ -10,12 +10,23 @@ nav_order: 1 * **Source name:** `hospital-admissions` * **Earliest issue available:** June 21, 2020 -* **Number of data revisions since May 19, 2020:** 1 -* **Date of last change:** October 20, 2020 +* **Date of last data revision:** October 20, 2020 (see [data revision docs](#changelog)) * **Available for:** county, hrr, msa, state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY](../covidcast_licensing.md#creative-commons-attribution) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +### October 20, 2020 +We went from a custom geo mapping file (for aggregating from zip->(county, msa, hrr, state)) to a central geo file based on rigorously sourced US census data. + +
+ ## Overview This data source is based on electronic medical records and claims data about diff --git a/docs/api/covidcast-signals/indicator-combination.md b/docs/api/covidcast-signals/indicator-combination.md index fe2edd3cf..e71e77adc 100644 --- a/docs/api/covidcast-signals/indicator-combination.md +++ b/docs/api/covidcast-signals/indicator-combination.md @@ -22,12 +22,30 @@ calculated or composed by Delphi. It is not a primary data source. ## Statistical Combination Signals * **Earliest issue available:** May 20, 2020 -* **Number of data revisions since May 19, 2020:** 1 -* **Date of last change:** [June 3, 2020](../covidcast_changelog.md#indicator-combination) +* **Date of last data revision:** June 3, 2020 (see [data revision docs](#changelog)) * **Available for:** county, msa, state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY](../covidcast_licensing.md#creative-commons-attribution) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +### June 3, 2020 + +Standard errors are now included in the `nmf_day_doc_fbc_fbs_ght` signal for all geo levels and dates, representing the estimated uncertainty in this signal. This uncertainty comes because the signal is a combination of other signals based on survey estimates or other estimates with margins of error. + +* `nmf_day_doc_fbc_fbs_ght` + * all geo levels + * all dates + +
+ +## Overview + These signals combine Delphi's indicators---*not* including cases and deaths, but including other signals expected to be related to the underlying rate of coronavirus infection---to produce a single indicator. The goal is to provide a @@ -191,12 +209,27 @@ The resampling method for each input source is as follows: ## Compositional Signals: Confirmed Cases and Deaths -* **Earliest issue available:** 7 July 2020 -* **Number of data revisions since 19 May 2020:** 1 -* **Date of last change:** [12 October 2020](../covidcast_changelog.md#indicator-combination) +* **Earliest issue available:** July 7, 2020 +* **Date of last data revision:** October 12, 2020 (see [data revision docs](#changelog-deaths)) * **Available for:** county, msa, hrr, state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) +## Changelog Deaths + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +### October 12, 2020 + +The 10 October 2020 issue of all `indicator-combination` deaths signals has been removed from the API. These signals are primarily constructed of USAFacts data, whose 10 October 2020 issue was discovered to be corrupt on 11 October and repaired on 12 October. Subsequent issues have adequate coverage of all regions and dates included in the 10 October issue, so this change only affects forecasters who intend to pull training data with an `as_of` or `issues` parameter set to 20201010. + +
+ + +## Overview + These signals combine the cases and deaths data from JHU and USA Facts. This is a straight composition: the signals below use the [JHU signal data](jhu-csse.md) for Puerto Rico, and the [USA Facts signal data](usa-facts.md) everywhere else. diff --git a/docs/api/covidcast-signals/jhu-csse.md b/docs/api/covidcast-signals/jhu-csse.md index c9d665b5a..7f6c9425e 100644 --- a/docs/api/covidcast-signals/jhu-csse.md +++ b/docs/api/covidcast-signals/jhu-csse.md @@ -10,12 +10,38 @@ nav_order: 2 * **Source name:** `jhu-csse` * **Earliest issue available:** May 7, 2020 -* **Number of data revisions since May 19, 2020:** 1 -* **Date of last change:** [October 7, 2020](../covidcast_changelog.md#jhu-csse) +* **Date of last data revision:** October 7, 2020 (see [data revision docs](#changelog)) * **Available for:** county, hrr, msa, state, hhs, nation (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY](#source-and-licensing) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +### October 7, 2020 + +The following changes were made to all `jhu-csse` signals related to geocoding: +- NY Boroughs county FIPS (36005, 36047, 36061, 36081, 36085) are now [differentiated by JHU](https://github.com/CSSEGISandData/COVID-19/issues/3084), +- “Unassigned” and “Out of State” counts are assigned to a megaFIPS at the county level (XX000 where XX is the state FIPS code) and will now be incorporated into the state totals +- The split of the Kansas City, Missouri into its four sub-counties is now done with a more precise population proportion, +- The split of the Dukes and Nantucket, Massachusetts FIPS codes into the two sub-counties is now done with a more precise population proportion, +- Some counts are reported in the Utah territories JHU UIDs 84070015-84070020. These are now aggregated properly into the state megaFIPS 49000, which will be aggregated in state-level information. + +### September 1, 2020 + +NY Boroughs county FIPS (36005, 36047, 36061, 36081, 36085) are now split in proportion to the population of each county, instead of being reported in aggregate in FIPS 36061. + +### June 3, 2020 + +We now include figures on Puerto Rico for all `jhu-csse` signals at the state level. + +
+ + ## Overview This data source of confirmed COVID-19 cases and deaths is based on reports made diff --git a/docs/api/covidcast-signals/nchs-mortality.md b/docs/api/covidcast-signals/nchs-mortality.md index 94a72ead2..65c1ee97b 100644 --- a/docs/api/covidcast-signals/nchs-mortality.md +++ b/docs/api/covidcast-signals/nchs-mortality.md @@ -10,12 +10,24 @@ nav_order: 1 * **Source name:** `nchs-mortality` * **Earliest issue available:** Epiweek 50 2020 (6-12 December 2020) -* **Number of data revisions since May 19, 2020:** 0 -* **Date of last change:** Never +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** week (see [date format docs](../covidcast_times.md)) * **License:** [NCHS Data Use Agreement](https://www.cdc.gov/nchs/data_access/restrictions.htm) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +No changes so far. + +
+ +## Overview + This data source of national provisional death counts is based on death certificate data received and coded by the National Center for Health Statistics [(NCHS)](https://www.cdc.gov/nchs/nvss/vsrr/COVID19/index.htm). This data is diff --git a/docs/api/covidcast-signals/nhsn.md b/docs/api/covidcast-signals/nhsn.md index 2fc89afd7..8f8b1701a 100644 --- a/docs/api/covidcast-signals/nhsn.md +++ b/docs/api/covidcast-signals/nhsn.md @@ -9,12 +9,23 @@ nav_order: 1 * **Source name:** `nhsn` * **Earliest issue available:** November 19, 2024 -* **Number of data revisions since 18 Nov 2024:** 0 -* **Date of last change:** Never +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** state, hhs, nation (see [geography coding docs](../covidcast_geography.md)) * **Time type:** week (see [date format docs](../covidcast_times.md)) * **License:** [Public Domain US Government](https://www.usa.gov/government-works) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +No changes so far. + +
+ + ## Overview [The National Healthcare Safety Network (NHSN)](https://www.cdc.gov/nhsn/index.html) is the nation’s most widely used healthcare-associated infection tracking system. diff --git a/docs/api/covidcast-signals/nssp.md b/docs/api/covidcast-signals/nssp.md index 8e988a25b..e5871a67b 100644 --- a/docs/api/covidcast-signals/nssp.md +++ b/docs/api/covidcast-signals/nssp.md @@ -9,12 +9,22 @@ nav_order: 1 * **Source name:** `nssp` * **Earliest issue available:** April 17, 2024 -* **Number of data revisions since 19 May 2020:** 0 -* **Date of last change:** Never +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** county, hrr, msa, state, hhs, nation (see [geography coding docs](../covidcast_geography.md)) * **Time type:** week (see [date format docs](../covidcast_times.md)) * **License:** [Public Domain US Government](https://www.usa.gov/government-works) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +No changes so far. + +
+ ## Overview [The National Syndromic Surveillance Program (NSSP)](https://www.cdc.gov/nssp/php/about/index.html) is an effort to track epidemiologically relevant conditions. diff --git a/docs/api/covidcast-signals/quidel.md b/docs/api/covidcast-signals/quidel.md index 430339291..894942990 100644 --- a/docs/api/covidcast-signals/quidel.md +++ b/docs/api/covidcast-signals/quidel.md @@ -20,13 +20,24 @@ nav_order: 1 * **Source name:** `quidel` * **Earliest issue available:** July 29, 2020 -* **Number of data revisions since May 19, 2020:** 1 -* **Date of last change:** October 22, 2020 +* **Date of last data revision:** October 22, 2020 (see [data revision docs](#changelog-covid-19-tests)) * **Available for:** county, hrr, msa, state, HHS, nation (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY](../covidcast_licensing.md#creative-commons-attribution) -### Overview +## Changelog COVID-19 Tests + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +### October 22, 2020 +We went from a custom geo mapping file (for aggregating from zip->(county, msa, hrr, state)) to a central geo file based on rigorously sourced US census data. + +
+ +## Overview Data source based on COVID-19 Antigen tests, provided to us by Quidel, Inc. When a patient (whether at a doctor’s office, clinic, or hospital) has COVID-like @@ -54,7 +65,7 @@ meaningful levels starting May 26, 2020. | `covid_ag_smoothed_pct_positive_age_65plus` | Percentage of antigen tests that were positive for COVID-19 (ages 65+), smoothed by pooling together the last 7 days of tests.
**Earliest date available:** 2020-05-26 | | `covid_ag_smoothed_pct_positive_age_0_17` | Percentage of antigen tests that were positive for COVID-19 (ages 0-17), smoothed by pooling together the last 7 days of tests.
**Earliest date available:** 2020-05-26 | -### Estimation +## Estimation The source data from which we derive our estimates contains a number of features for every test, including localization at 5-digit Zip Code level, a TestDate and @@ -80,7 +91,7 @@ We estimate p across 6 temporal-spatial aggregation schemes: - daily, at the HHS level; - daily, at the US national level. -#### Standard Error +### Standard Error We assume the estimates for each time point follow a binomial distribution. The estimated standard error then is: @@ -89,11 +100,11 @@ $$ \text{se} = 100 \sqrt{ \frac{\frac{p}{100}(1- \frac{p}{100})}{N} } $$ -#### Smoothing +### Smoothing We add two kinds of smoothing to the smoothed signals: -##### Temporal Smoothing +#### Temporal Smoothing Smoothed estimates are formed by pooling data over time. That is, daily, for each location, we first pool all data available in that location over the last 7 days, and we then recompute everything described in the two subsections above. @@ -101,7 +112,7 @@ days, and we then recompute everything described in the two subsections above. Pooling in this way makes estimates available in more geographic areas, as many areas report very few tests per day, but have enough data to report when 7 days are considered. -##### Geographical Smoothing +#### Geographical Smoothing **County, MSA and HRR levels**: In a given County, MSA or HRR, suppose $$N$$ COVID tests are taken in a certain time period, $$X$$ is the number of tests taken with positive @@ -168,12 +179,21 @@ These signals are inactive. They were updated until May 19, 2020. * **Source name:** `quidel` * **Earliest issue available:** April 29, 2020 * **Last issued:** May 19, 2020 -* **Number of data revisions since May 19, 2020:** 0 -* **Date of last change:** Never +* **Date of last data revision:** Never (see [data revision docs](#changelog-flu-tests)) * **Available for:** msa, state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) -### Overview +## Changelog Flu Tests + +
+Click to expand + +### October 22, 2020 +We went from a custom geo mapping file (for aggregating from zip->(county, msa, hrr, state)) to a central geo file based on rigorously sourced US census data. + +
+ +## Overview Data source based on flu lab tests, provided to us by Quidel, Inc. When a patient (whether at a doctor’s office, clinic, or hospital) has COVID-like diff --git a/docs/api/covidcast-signals/safegraph.md b/docs/api/covidcast-signals/safegraph.md index 96775de0f..873d2d4d5 100644 --- a/docs/api/covidcast-signals/safegraph.md +++ b/docs/api/covidcast-signals/safegraph.md @@ -26,11 +26,29 @@ surface signals from two such datasets. ## SafeGraph Social Distancing Metrics * **Earliest issue available:** June 20, 2020 -* **Number of data revisions since June 23, 2020:** 1 -* **Date of last change:** November 3, 2020 +* **Date of last data revision:** November 3, 2020 (see [data revision docs](#changelog-social-distancing-metrics)) **This dataset is no longer updated after April 19th, 2021.** +## Changelog (Social Distancing Metrics) + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +### April 19, 2021 + +The Safegraph social distancing metrics are no longer being updated. Weekly patterns are still available. + +### November 3, 2020 + +We went from a custom geo mapping file (for aggregating from county->state) to a central geo file based on rigorously sourced US census data. + +
+ +## Overview + Data source based on the [Social Distancing Metrics](https://docs.safegraph.com/docs/social-distancing-metrics) data product. SafeGraph provided this data for individual census block groups, using differential privacy to protect individual people's data privacy. @@ -77,11 +95,28 @@ additional day for SafeGraph's data to be ingested into the COVIDcast API. ## SafeGraph Weekly Patterns * **Earliest issue available:** November 30, 2020 -* **Number of data revisions since June 23, 2020:** 0 -* **Date of last change:** never +* **Date of last data revision:** Never (see [data revision docs](#changelog-weekly-patterns)) **This dataset is no longer updated after July 15th, 2022.** +## Changelog (Weekly Patterns) + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +### July 15, 2022 +The Safegraph Weekly Patterns dataset is no longer updated. + +### November 3, 2020 + +We went from a custom geo mapping file (for aggregating from county->state) to a central geo file based on rigorously sourced US census data. + +
+ +## Overview + Data source based on [Weekly Patterns](https://docs.safegraph.com/docs/weekly-patterns) dataset. SafeGraph provided this data for different points of interest diff --git a/docs/api/covidcast-signals/usa-facts.md b/docs/api/covidcast-signals/usa-facts.md index 3c972cfcd..8db886ba1 100644 --- a/docs/api/covidcast-signals/usa-facts.md +++ b/docs/api/covidcast-signals/usa-facts.md @@ -10,12 +10,30 @@ nav_order: 2 * **Source name:** `usa-facts` * **Earliest issue available:** June 24, 2020 -* **Number of data revisions since May 19, 2020:** 2 -* **Date of last change:** [November 3, 2020](../covidcast_changelog.md#usa-facts) +* **Date of last data revision:** November 3, 2020 (see [data revision docs](#changelog)) * **Available for:** county, hrr, msa, state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY](#source-and-licensing) +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +### November 3, 2020 +We went from a custom geo mapping file (for aggregating from county->(msa, hrr, state)) to a central geo file based on rigorously sourced US census data. + +### October 12, 2020 + +The 10 October 2020 issue of all `usa-facts` deaths signals has been removed from the API. The file for deaths provided by USAFacts on 10 October included case data instead. The resulting spurious 100× increase in magnitude of COVIDcast `usa-facts` deaths signals was noticed on 11 October and repaired on 12 October. Subsequent issues have adequate coverage of all regions and dates included in the 10 October issue, so this change only affects forecasters that intend to pull training data with an `as_of` or `issues` parameter set to 20201010. + +
+ + +## Overview + This data source of confirmed COVID-19 cases and deaths is based on reports made available by [USAFacts](https://usafacts.org/). diff --git a/docs/api/covidcast-signals/youtube-survey.md b/docs/api/covidcast-signals/youtube-survey.md index 5b376f913..923f550e1 100644 --- a/docs/api/covidcast-signals/youtube-survey.md +++ b/docs/api/covidcast-signals/youtube-survey.md @@ -12,12 +12,23 @@ nav_order: 2 * **Source name:** `youtube-survey` * **Earliest issue available:** May 01, 2020 -* **Number of data revisions since May 19, 2020:** 0 -* **Date of last change:** Never +* **Date of last data revision:** Never (see [data revision docs](#changelog)) * **Available for:** state (see [geography coding docs](../covidcast_geography.md)) * **Time type:** day (see [date format docs](../covidcast_times.md)) * **License:** [CC BY-NC](../covidcast_licensing.md#creative-commons-attribution-noncommercial) + +## Changelog + +
+Click to expand + +See [COVIDcast Signal Changes](../covidcast_changelog.md) for general information about how we track changes to signals. + +No changes have been made to this signal. + +
+ ## Overview This data source is based on a short survey about COVID-19-like illness diff --git a/docs/api/covidcast_changelog.md b/docs/api/covidcast_changelog.md index f1efed34e..204cd3553 100644 --- a/docs/api/covidcast_changelog.md +++ b/docs/api/covidcast_changelog.md @@ -4,7 +4,13 @@ parent: Main Endpoint (COVIDcast) nav_order: 8 --- -# COVIDcast Signal Changelog +# COVIDcast Signal Changes + +## Table of contents +{: .no_toc .text-delta} + +1. TOC +{:toc} When Delphi makes substantial changes to a signal's computation, we will typically publish it under a new name rather than revising the existing signal. @@ -17,98 +23,8 @@ we **strongly recommend** that anyone using the API to download data regularly should subscribe to this list. We will only use the list to announce API changes, data corrections, and other information relevant to API users. -For current information on how up-to-date our public health and behavior data is, how much of the country is covered by our public health and behavior data, and the data versioning effects present in our public health and behavior data, please see Delphi's [Indicator Status Overview page](https://delphi.cmu.edu/covidcast/indicator-status/). - -## Table of contents -{: .no_toc .text-delta} - -1. TOC -{:toc} - -## Sources and Signals -### `doctor-visits` -#### 9 November 2020 -We went from a custom geo-mapping file (for aggregating from county->(msa, hrr, state)) to a central geo file based on rigorously sourced US census data. - -### `fb-survey` - -#### 3 June 2020 - -Duplicate survey weights had corrupted historical figures for the following signals and dates. The correct data has been restored to the API. -* `raw_wcli` - * `county`: 20200406, 20200408, 20200410, 20200430 - * `hrr`: 20200406, 20200408-20200410, 20200430 - * `msa`: 20200408, 20200410, 20200430 - * `state`: 20200408-20200410, 20200430 -* `smoothed_wcli` - * `county`: 20200406, 20200408-20200414, 20200430-20200506 - * `hrr`: 20200406-20200415, 20200430-20200506 - * `msa`: 20200408-20200414, 20200430-20200506 - * `state`: 20200408-20200416, 20200430-20200506 - -#### 20 November 2020 - -Due to a bug in our data processing system, estimates of the percentage of people reporting that they have been tested for COVID-19 calculated before October 8th were incorrect. -We incorrectly treated an answer of “no” as a missing response, which affected the `smoothed_tested_14d` and `smoothed_wtested_14d` signals from the `fb-survey` source. - -As of Nov. 20th, the error has been corrected and all affected data reissued. - -### `hospital-admissions` -#### 20 October 2020 -We went from a custom geo mapping file (for aggregating from zip->(county, msa, hrr, state)) to a central geo file based on rigorously sourced US census data. - -### `jhu-csse` - -#### 3 June 2020 - -We now include figures on Puerto Rico for all `jhu-csse` signals at the state level. - -#### 1 September 2020 - -NY Boroughs county FIPS (36005, 36047, 36061, 36081, 36085) are now split in proportion to the population of each county, instead of being reported in aggregate in FIPS 36061. - -#### 7 October 2020 - -The following changes were made to all `jhu-csse` signals related to geocoding: -- NY Boroughs county FIPS (36005, 36047, 36061, 36081, 36085) are now [differentiated by JHU](https://github.com/CSSEGISandData/COVID-19/issues/3084), -- “Unassigned” and “Out of State” counts are assigned to a megaFIPS at the county level (XX000 where XX is the state FIPS code) and will now be incorporated into the state totals -- The split of the Kansas City, Missouri into its four sub-counties is now done with a more precise population proportion, -- The split of the Dukes and Nantucket, Massachusetts FIPS codes into the two sub-counties is now done with a more precise population proportion, -- Some counts are reported in the Utah territories JHU UIDs 84070015-84070020. These are now aggregated properly into the state megaFIPS 49000, which will be aggregated in state-level information. - -### `indicator-combination` - -#### 3 June 2020 - -Standard errors are now included in the `nmf_day_doc_fbc_fbs_ght` signal for all geo levels and dates, representing the estimated uncertainty in this signal. This uncertainty comes because the signal is a combination of other signals based on survey estimates or other estimates with margins of error. - -* `nmf_day_doc_fbc_fbs_ght` - * all geo levels - * all dates - -#### 12 October 2020 - -The 10 October 2020 issue of all `indicator-combination` deaths signals has been removed from the API. These signals are primarily constructed of USAFacts data, whose 10 October 2020 issue was discovered to be corrupt on 11 October and repaired on 12 October. Subsequent issues have adequate coverage of all regions and dates included in the 10 October issue, so this change only affects forecasters who intend to pull training data with an `as_of` or `issues` parameter set to 20201010. - -### `quidel` - -#### 22 October 2020 -We went from a custom geo mapping file (for aggregating from zip->(county, msa, hrr, state)) to a central geo file based on rigorously sourced US census data. - -### `safegraph` - -#### 19 April 2021 - -The Safegraph social distancing metrics are no longer being updated. Weekly patterns are still available. - -#### 3 November 2020 -We went from a custom geo mapping file (for aggregating from county->state) to a central geo file based on rigorously sourced US census data. - -### `usa-facts` - -#### 3 November 2020 -We went from a custom geo mapping file (for aggregating from county->(msa, hrr, state)) to a central geo file based on rigorously sourced US census data. - -#### 12 October 2020 - -The 10 October 2020 issue of all `usa-facts` deaths signals has been removed from the API. The file for deaths provided by USAFacts on 10 October included case data instead. The resulting spurious 100× increase in magnitude of COVIDcast `usa-facts` deaths signals was noticed on 11 October and repaired on 12 October. Subsequent issues have adequate coverage of all regions and dates included in the 10 October issue, so this change only affects forecasters that intend to pull training data with an `as_of` or `issues` parameter set to 20201010. +For current information on how up-to-date our public health and behavior data +is, how much of the country is covered by our public health and behavior data, +and the data versioning effects present in our public health and behavior data, +please see Delphi's [Indicator Status Overview +page](https://delphi.cmu.edu/covidcast/indicator-status/).