Data profiling information about the published datasets on the DataSF open data portal
The source code that generates this dataset can be found at:
Publishing Department: Mayor
Dataset Link: https://data.sfgov.org/d/w6q6-i3uv
| Field Name (opt. alias) | Field Definition | API Key |
|---|---|---|
| Blob Count | Number of blob fields in a dataset | blob_count |
| Boolean Count | Number of boolean fields in a dataset | boolean_count |
| Category | The semantic category that the dataset is associated with | category |
| Created Date | Date the dataset was created | created_date |
| Data Change Frequency | A time period that indicates how often the data in the dataset changes | data_change_frequency |
| Dataset Name | The name of the dataset | dataset_name |
| datasetID | The four by four of the dataset | datasetid |
| Days Since First Created | The number of days between today and the date when the dataset was first created | days_since_first_created |
| Days Since Last Updated | The number of days between today and the date when the dataset was last updated | days_since_last_updated |
| Department | The City department that is responsible for the dataset | department |
| Description | Description for the dataset | description |
| Documented Count | Count of the number of fields that have been documented and have completed field definitions | documented_count |
| Documented Percentage | Shows the percentage of fields in the dataset that have been documented | documented_percentage |
| Downloads | Number of downloads as reported by Socrata | downloads |
| Dupe Record Count | The number of row level duplicates- aka rows that are exact copies | dupe_record_count |
| Dupe Record Percent | Indicates what percentage of the dataset is compromised of level duplicates | dupe_record_percent |
| Field Count | The total number of fields in a dataset | field_count |
| Global Field Count | The number of fields in the dataset mapped to a global field alias and definition | global_field_count |
| Global Field Percentage | Shows the percentage that global fields make up the dataset; A dataset with a high percetnge of global fields may indicate that its a reference dataset | global_field_percentage |
| Keywords | Associated tags or keywords to help in classifying for search. | keywords |
| Last Updt Dt Data | Date that a dataset was lasted updated | last_updt_dt_data |
| Line Count | Number of geometry: line fields in a dataset | line_count |
| Multiline Count | Number of geometry: multiline fields in a dataset | multiline_count |
| Multipoint Count | Number of multipoint fields in a dataset | multipoint_count |
| Multipolygon Count | Number of geometry: multipolygon fields in a dataset | multipolygon_count |
| nbeID | New backend ID. This id corresponds to the SODA API 2.1 API endpoint for this dataset. | nbeid |
| Notes | Notes about the dataset | notes |
| Numeric Count | Number of numeric fields in a dataset | numeric_count |
| Point Count | Number of point fields in a dataset | point_count |
| Polygon Count | The number of geometry: polygon fields in a dataset | polygon_count |
| Profile Last Updt Dt | The date that the dataset was last profiled | profile_last_updt_dt |
| Publishing Frequency | The time period in which the dataset should be (re)published | publishing_frequency |
| Publishing Health | The publishing health indicates whether or not a dataset is being updated as specified by its publishing schedule\n\nOn Time- indicates that dataset updated on time\n\nDelayed-- indicates that dataset is late to update\n\nStale - indicates that dataset has not been updated in more than two times the time period indicated in publishing frequency | publishing_health |
| Record Count | The total number of records in a dataset | record_count |
| rowIdentifier | pkid for a dataset if exisits | rowidentifier |
| rowLabel | text for what a row in the dataset represents | rowlabel |
| Text Count | Number of text fields in a dataset | text_count |
| Time Count | Number of time fields in a dataset | time_count |
| Timestamp Count | Number of timestamp fields in a dataset | timestamp_count |
| Visits | Number of user visits to the dataset as reported by Socrata | visits |