Auditing SQL Server Databases Using CAATs

Author: Ian Cooke, CISA, CRISC, CGEIT, CDPSE, COBIT 5 Assessor and Implementer, CFE, CIPM, CIPP/E, CIPT, FIP, CPTE, DipFM, ITIL Foundation, Six Sigma Green Belt
Date Published: 1 January 2015

There are a variety of commercial security tools1 available to audit Microsoft (MS) SQL Server databases. However, there can be instances when their application is not practical, including:

  • For smaller companies in which the cost may be prohibitive
  • For larger holding companies or geographically dispersed companies that do not have full network connectivity between the centre and its subsidiaries
  • For consultancies performing external reviews that are not given permission to install or run tools that require full database administrator privileges and, hence, the administrator password. Furthermore, the audited entity has no oversight of what the tool does or what effect it is likely to have on mission-critical databases.

The following approach to auditing MS SQL Server databases using computer-assisted audit techniques (CAATs) in conjunction with information taken directly from the MS SQL Server database offers a solution to the issues identified. It describes a cost-effective solution for auditing MS SQL Server databases to a company’s own standards using tools already available in the enterprise.

SQL Server Databases

All MS SQL Server installations contain information about the installed databases. To retrieve the information, one must understand how it is stored and the tools available to extract it.

  • SQL server catalog views—MS SQL Server databases contain information about data known as catalog metadata. This provides details about the database’s configuration options, users, objects and more. Catalogue metadata are accessed through catalog views. Catalogue views provide an organised view of the catalog metadata. The views are grouped into categories, one of which is security. A full list of the catalog views along with more detailed explanations may be found on Microsoft’s Developer Network.2
  • SQL Server Management Studio—This is a tool for accessing, configuring, managing, administering and developing SQL server databases. It also allows users to query the database using SQL, formatting the output as desired and writing the results to file (if required).
  • SQL server structure—Each instance of the MS SQL Server has four system databases (master, model, tempdb and msdb) and one or more user databases.3 Security is built around the master/server level (server roles) and the user database level (database roles).

Outputting SQL Server Catalog Views

Figure 1 offers an example of an MS SQL Server script (a full script can be downloaded from the ISACA Knowledge Center4). Once generated, these scripts can be transferred to the database administrator to be run over the required database(s). One comma-separated values (CSV) file is produced for each server-level view. A CSV file is also produced for each database-level view, but it contains separate output for all installed databases (the required setup, formatting and configuration options are described in figure 2).


Analysing SQL Server Catalog Views

The files can then be imported into CAATs tools for analysis and comparison. Examples of MS SQL Server catalog views include:

  • Configurations—The entity being audited should have a policy on how its MS SQL Server databases are configured. Much of the configuration is reflected in the MS SQL Server parameters, which can be retrieved from the sys.configurations catalog view. Examples of parameters include those for enabling the command shell or allowing client applications on remote computers to use an administrator connection (a full list of SQL server configuration options exists on Microsoft’s Developer Network5).

    As noted, this catalogue view can be output to a CSV file. A sample output from the configuration’s CSV file can be seen in figure 3. The first line shows the MS SQL Server field names. The field name relates to the defined layout for the configurations catalogue view.7 (The layout for all SQL server catalogue views are available on Microsoft’s Developer Network.8)



    All common CAATs tools (as well as Microsoft Excel and Microsoft Access) allow for the importation of CSV files. Once the configurations are imported to the CAATs tool, they can be analysed for compliance to the entity’s standards. These standards could be based upon any source of assurance for an MS SQL Server database,9 e.g., the Center for Internet Security Benchmarks,10 or a document developed by the entity. (ISACA’s Microsoft SQL Server Database Audit/Assurance Program11 does not use catalogue views, although the items could be tested by referencing them.)

    Once one database is analysed and known to be compliant to required standards, it can be used as a ‘master configuration’ using the CAATs tool to compare the configurations of interest across all of the organisation’s MS SQL Server databases. This can be done by joining the field configuration_id displaying all records where the value is not equal. In this manner, noncompliant configurations are quickly flagged for follow-up and review.

    If required, the review of the configurations can be repeated periodically. This would allow changes to be tracked and used as part of a continuous monitoring audit programme.
  • Server principals—An MS SQL Server provides two methods of authenticating to the database: Windows authentication or mixed mode.12 Windows authentication uses MS Windows security to validate all of the database accounts and passwords against the Windows operating system. It is the mode recommended by Microsoft.13 Mixed mode allows for both Windows authentication and MS SQL Server authentication. With MS SQL Server authentication, an explicit user account and password are required to access the database.

    The entity being audited should have a policy on how these passwords are configured. For Windows authentication, these will be as per the Windows server. From Windows Server 2003 onwards, mixed mode can be configured to validate the password against the Windows server.14 In a mixed mode environment, the mode in use for a given user can be seen in the sys.server_principals catalogue view (figure 1 [b]). The field ‘type’ will be ‘S’ for an SQL login or ‘U’ for a Windows login.

    From SQL Server 2005 onwards, the password hashes for SQL login users are stored in the view sys.sql_logins catalogue view.15 To audit the passwords, one must request that the MS SQL Server database administrator output the contents of the view (figure 1 [c]) to a CSV file, as discussed. Once one has the password hashes, these can be validated by running them through a password cracking tool, e.g., Hashcat.16

    In an MS SQL Server, anything that can be granted a right to perform an activity is called a principal. So, fundamentally, principals include logins, users and roles, for example. Principals can also be separated into server principals and database principals.17

    Permissions are what allow principals to perform activities in an MS SQL Server. Depending on the scope, the permission granted is either a server permission or a database permission.

    Roles are used to group together permissions or other roles. They are a means of facilitating the granting of multiple permissions or roles to users. An MS SQL Server provides some predefined roles to help in database administration. Fixed server roles18 are defined at the server level and have server-level permissions.19 They cannot be added, removed or changed. Each member of a fixed server role can add other users to the role. Since MS SQL Server 2012, one can also create user-defined server roles.20

    Fixed server roles can also be seen in the sys.server_ principals view (the field ‘type’ is ‘R’), while the users who have been allocated the fixed server roles can be seen in the sys.server_role_members view (figure 1 [d]). These should be reviewed for appropriateness and separation of duties.
  • Database principals—Fixed database roles21 are defined at the database level and exist in each database. Members of the db_owner and db_securityadmin database roles can manage fixed database role membership; however, only members of the db_owner database role can add members to the db_owner fixed database role.22

    User-defined (or flexible) database roles allow one to create one’s own roles. After a role is created, one can configure the database permissions of the role by using grant, deny and revoke, for example.

    Using the sys.database_principals view via the sp_MSforeachdb stored procedure (figure 1 [e]), one can obtain a list of the database roles in use for each database. The users allocated these roles can be retrieved from sys.database_role_members (figure 1 [f]). These should also be reviewed for appropriateness and separation of duties.

As there are many MS SQL Server catalog views, it is not possible to discuss them all in this article. Those mentioned previously are for illustration purposes. The views used depend on the purpose of the audit, but could also include:

  • Sys.databases, which lists all the installed databases. This could be used to ensure that all databases are required, in use, and secured, and that there is a separation between test and live databases.
  • Sys.server_permissions, which lists all the permissions that have been defined at the server level. This could be reviewed to ensure that the server permissions are appropriate.
  • Database_permissions, which lists all the permissions that have been defined at the database level. This could be reviewed to ensure that the database permissions are appropriate.
  • Database_objects, which lists all the objects for a given database. This could be cross-checked with permissions to ensure that the database permissions are appropriate.

A full list of MS SQL Server catalog views, including those for auditing and encryption, along with more detailed explanations can be found on Microsoft’s Developer Network.23

The key point is that any of the views may be output to CSV files and imported into a CAATs tool. These may then be:

  • Compared to other SQL server databases, including a master that one knows to be compliant to one’s standards
  • Compared to development, test or QA versions of the production database (useful for change control)
  • Compared to other sources of data, including data from internal or external entities

Benefits of CAATS for SQL Server Databases

Benefits of the proposed CAATs solution for auditing MS SQL Server databases include cost, as many organisations are already using CAATs software. The approach also allows for total transparency as the database administrator of the audited entity can review the SQL that is being run over the database to ensure that it will have no adverse effects on the production environment. Furthermore, the approach allows external consultants and geographically dispersed companies to request that the queries are run by the local database administrator without the need to compromise security (the administrator password) or install any additional software. Once the queries have been run, they can be securely transferred for analysis. Query results can be compared against other databases from the audited entity or known compliant (master) databases to highlight areas of audit concern. Query results can also be compared against preproduction databases and other sources of data, such as the company payroll. Finally, the entire process can be repeated, reconfigured (if required) and used as part of a continuous monitoring and/or audit.

Endnotes

1 TechTarget, SQL Server security test checklist, http://searchsqlserver.techtarget.com/feature/SQL-Server-security-test-checklist
2 Microsoft Developer Network, ‘Catalog Views (Transact-SQL)’, http://msdn.microsoft.com/en-us/library/ms174365(v=sql.100).aspx
3 Microsoft TechNet, Database Architecture, http://technet.microsoft.com/en-us/library/aa214422(v=sql.80).aspx
4 ISACA, Knowledge Center, Outputs SQL Server Files CSV, 2013
5 Microsoft Developer Network, ‘Setting Server Configuration Option’s’, http://msdn.microsoft.com/en-us/library/ms189631(v=sql.100).aspx
6 Microsoft Developer Network, ‘Edit SQLCMD Scripts With Query Editor’, http://msdn.microsoft.com/en-us/library/ms174187.aspx
7 Microsoft Developer Network, ‘sys.configurations (Transact-SQL)’, http://msdn.microsoft.com/en-us/library/ms188345(v=sql.100).aspx
8 Op cit, Microsoft Developer Network, Catalog Views (Transact-SQL)
9 ISACA, Knowledge Center, ‘Sources of Assurance for a SQL Server Database’
10 Center for Internet Security, ‘Security Benchmarks, Microsoft SQL Server 2008 R2 Database’, 2012, https://benchmarks.cisecurity.org/tools2/sqlserver/CIS_Microsoft_
SQL_Server_2008_R2_Database_Engine_Benchmark_v1.0.0.pdf

11 ISACA, Microsoft SQL Server Database Audit/Assurance Program, 2011
12 MSSQLTips.com, ‘How to Check SQL Server Authentication Mode Using T SQL and SSMS’, www.mssqltips.com/sqlservertip/2191/how-to-check-sql-server-authentication-mode-using-t-sql-and-ssms/
13 Microsoft TechNet, ‘Choosing an Authentication Mode’, http://technet.microsoft.com/en-us/library/ms144284(v=sql.100).aspx
14 MSSQLTips.com, ‘SQL Server Login Properties to Enforce Password Policies and Expiration’, www.mssqltips.com/sqlservertip/1088/sql-server-login-properties-to-enforce-password-policies-and-expiration/
15 Microsoft Developer Network, ‘Sys.sql_logins (Transact-SQL)’, http://msdn.microsoft.com/en-us/library/ms174355(v=sql.100).aspx
16 Hashcat.net, http://hashcat.net/hashcat/
17 Microsoft Developer Network, ‘Principals (Database Engine)’, http://msdn.microsoft.com/en-us/library/ms181127(v=sql.100).aspx
18 Microsoft Developer Network, ‘Permissions of Fixed Server Roles (Database Engine)’, http://msdn.microsoft.com/en-us/library/ms175892(v=sql.100)
19 MSSQLTips.com, ‘Understanding SQL Server Fixed Server Roles’, www.mssqltips.com/sqlservertip/1887/understanding-sql-server-fixed-server-roles/
20 Microsoft TechNet Magazine, ‘SQL Server: User-defined Roles’, http://technet.microsoft.com/en-us/magazine/hh641407.aspx
21 Microsoft Developer Network, ‘Permissions of Fixed Database Roles (Database Engine)’, http://msdn.microsoft.com/en-us/library/ms189612(v=sql.100)
22 MSSQLTips.com, ‘Understanding SQL Server Fixed Database Roles’, www.mssqltips.com/sqlservertip/1900/understanding-sql-server-fixed-database-roles/
23 Op cit, Microsoft Developer Network, ‘Catalog Views(Transact-SQL)’

Ian Cooke, CISA, CGEIT, CRISC, COBIT Foundation, CFE, CPTS, DipFM, ITIL-F, Six Sigma Green Belt, is an IT audit manager based in Dublin, Ireland, with more than 25 years of experience in all aspects of information systems. A member of ISACA’s Communities Committee, he is also the topic leader for the Oracle Databases, SQL Server Databases and OS/400 discussions in the ISACA Knowledge Center. Cooke welcomes comments or suggestions at ian.j.cooke@gmail.com or on the SQL server topic in the ISACA Knowledge Center.