Data mapping for Service Graph Connector for Microsoft Azure
Data from the Azure data sources is mapped and transformed into the ServiceNow CMDB Configuration Item (CI) class definitions using the Robust Transform Engine (RTE). Data is inserted into the ServiceNow® CMDB using the Identification and Reconciliation Engine (IRE).
Data mapping for Azure
When you complete setting up the connection, you can configure the integration to periodically pull data from Azure. The data is loaded into staging tables and then inserted into the target tables.
The following table lists the data sources, the staging tables, and the target tables as CMDB CI and non-CMDB classes for Azure.
| Data source | Staging table | Target tables |
|---|---|---|
| SG-Azure Subscriptions | SG Azure Subscriptions \[sn\_sg\_azure\_integ\_subscriptions\] | Cloud Service Account Key Value |
| SG-Azure Datacenter Updation | SG-Azure Datacenter Updation \[sn\_sg\_azure\_integ\_datacenter\_updation\] | Azure Datacenter |
| SG-Azure Resource Group | SG-Azure Resource Group \[sn\_sg\_azure\_integ\_resource\_groups\] | Resource Group Key Value |
| SG-Azure Availability Zone | SG-Azure Availability Sets \[sn\_sg\_azure\_integ\_availability\_sets\] | Availability Zone Key Value |
| SG-Azure Storage Volume | SG-Azure Storage Volume \[sn\_sg\_azure\_integ\_storage\_volume\] | Storage Volume Key Value |
| SG-Azure Load Balancers | SG-Azure Load Balancers \[sn\_sg\_azure\_integ\_load\_balancers\] | Cloud Load Balancer Cloud LB IPAddress Key Value |
| SG-Azure Network | SG-Azure Network \[sn\_sg\_azure\_integ\_network\] | Cloud Network Cloud Service Account Cloud Subnet Key Value |
| SG-Azure Public IP Address | SG-Azure Public IP Address \[sn\_sg\_azure\_integ\_public\_ip\_address\] | Cloud Public IP Address Cloud Mgmt Network Interface Cloud Load Balancer Cloud LB IPAddress Key Value |
| SG-Azure Security Group | SG-Azure Security Group \[sn\_sg\_azure\_integ\_security\_group\] | Compute Security Group Key Value |
| SG-Azure Storage Accounts | SG-Azure Storage Accounts \[sn\_sg\_azure\_integ\_storage\_accounts\] | Cloud Storage Account Key Value |
| SG-Azure Virtual Machines | SG-Azure Virtual Machine \[sn\_sg\_azure\_integ\_virtual\_machine\] | Virtual Machine Instance Image Computer Linux Server Server Windows Server Key Value |
| SG-Azure Network Interface | SG-Azure Network Interface \[sn\_sg\_azure\_integ\_network\_interface\] | Cloud Mgmt Network Interface IP Address Virtual Machine Instance Key Value |
| SG-Azure SQL | SG-Azure SQL \[sn\_sg\_azure\_integ\_sql\] | Cloud DataBase Key Value |
| SG-Azure Functions and WebSites | SG-Azure Functions \[sn\_sg\_azure\_integ\_functions\] | Cloud WebServer Cloud Function |
| SG-Azure Generic Resources | SG-Azure Generic Resources [sn_sg_azure_integ_generic_resources]Note: The SG-Azure Generic Resources data source imports data for resources that are categorized as Generic in the Service Graph Resource Inclusion Whitelist [sn_cmdb_int_util_service_graph_resource_inclusion_whitelist] table. | Cloud Resource Key Value |
| SG-Azure Scale Sets | SG-Azure Scale Sets \[sn\_sg\_azure\_integ\_scale\_sets\] | Instance Scale Set |
| SG-Azure Scale Sets VMs | SG-Azure Scale Sets VMs \[sn\_sg\_azure\_integ\_scale\_sets\_vms\] | Virtual Machine Instance Storage Volume Image Cloud Mgmt Network Interface Hardware Type Azure Datacenter Linux Server Server Windows Server Key Value |
| SG-Azure Software | SG-Azure Software [sn_sg_azure_integ_software]Note: The SG-Azure Software data source imports the software data from the ConfigurationData table in the Log Analytics workspace of Azure. The SG-Azure Software import is set to inactive by default. | When the Software Asset Management \(SAM\) application isn't installed: Software Software Instance When the SAM application is installed: Software Installation |
| SG-Azure Software Remove | SG-Azure Software Remove \[sn\_sg\_azure\_integ\_software\_remove\]The SG-Azure Software Remove import is set to inactive by default. | When the SAM application isn't installed: Software Software Instance When the SAM application is installed: Software Installation |
| SG-Azure TCP | SG-Azure TCP [sn_sg_azure_integ_tcp]Note: The SG-Azure TCP data source imports the TCP and processes data from the VMConnection and VMProcess tables in the Log Analytics workspace of Azure. To populate the tables, you must first enable the VM insights feature in the Azure portal. For more information, see Enabling VM insights for collecting Azure data. | TCP Connection Running Process |
| SG-Azure Hardware Template Updation | Hardware templates \[sn\_sg\_azure\_integ\_hardware\_templates\] | Hardware Type |
| SG-Azure HW Consolidation | SG-Azure HW Consolidation \[sn\_sg\_azure\_integ\_hw\_consolidation\] | Virtual Machine Instance Computer |
| SG-Azure Run Command | SG-Azure Run Command \[sn\_sg\_azure\_integ\_run\_command\] | No data created |
| SG-Azure Get Run Command | SG-Azure Get Run Command \[sn\_sg\_azure\_integ\_get\_run\_command\] | Application TCP Connection Running Process |
| SG-Azure Kubernetes Cluster | SG-Azure Kubernetes Cluster \[sn\_sg\_azure\_integ\_kubernetes\_cluster\] | Kubernetes Cluster |
For more information on where data is saved when pulling data from Azure, see CMDB classes targeted in Service Graph Connector for Microsoft Azure and Supported Microsoft Azure resource types.
You can use the IntegrationHub ETL app to view the data maps. See IntegrationHub ETL for more information.
Additional information about Azure data sources:
The Service Graph Connector for Microsoft Azure utilizes the Service Graph Resource Inclusion Whitelist [sn_cmdb_int_util_service_graph_resource_inclusion_whitelist] table to differentiate between generic resources and other supported resource types.
Any resource that is not populated in the Service Graph Resource Inclusion Whitelist [sn_cmdb_int_util_service_graph_resource_inclusion_whitelist] table is populated in the Cloud Inventory Resource Inclusion Lists [sa_cloud_inventory_resource_whitelist_list] table.
The SG-Azure Hardware Template Updation and SG-Azure HW Consolidation import schedules replace the SG-Azure Hardware Template import schedule from the Service Graph Connector for Microsoft Azure 1.12.0 version. The SG-Azure Hardware Template Updation and SG-Azure HW Consolidation data sources fetch only the data of the hardware templates that are used for VMs in Azure, instead of fetching all hardware templates.
The SG-Azure SQL data source populates the
microsoft.dbformysql/flexibleserversandmicrosoft.dbforpostgresql/flexibleserversresource types in the Cloud Database [cmdb_ci_cloud_database] table instead of the Cloud Resource [cmdb_ci_cmp_resource] table from the Service Graph Connector for Microsoft Azure 1.14.0 version.After upgrading to version 1.14.0, run a full data load to migrate all active flexible servers from the Cloud Resource [cmdb_ci_cmp_resource] table to the Cloud Database [cmdb_ci_cloud_database] table.
All data sources except SG-Azure Scale Sets VMs are migrated from Azure Resource Manager (ARM) APIs to Resource Graph APIs for a full data load from the Service Graph Connector for Microsoft Azure 1.14.0 version. Microsoft Azure doesn't support uniform orchestration-type Scale Set VMs on Resource Graph APIs.
- The import set rows for the SG-Azure Run Command scheduled import job [sn_sg_azure_integ_run_command] remain in Pending state even after the import set is processed.
Related content
CMDB classes targeted in Service Graph Connector for Microsoft Azure