Are Organizations Actually Performing Risk-Based Audits?

Author: Blake Curtis, SC.D, CISA, CRISC, CISM, CGEIT, CDPSE, COBIT 2019 Foundation, Design and Implementation, CISSP, NIST CSF
Date Published: 5 August 2020
Related: IT Risk Management Audit Program | Digital | English

Organizations place a strong emphasis on cybersecurity, privacy and compliance.1 However, many enterprises are uneducated when it comes to identifying, assessing, responding to and monitoring these domains. Auditors provide value in these areas and address these deficiencies via various techniques and approaches. IT audits play a significant role in protecting technology, enterprises and the economy; in turn, audit quality influences how the public and investors perceive an enterprise’s reputation based on its effectiveness in preventing breaches of personally identifiable information (PII).2 Audits also play a significant role in an enterprise’s cyberresilience. For example, IT auditors are responsible for ensuring that IT protects and optimizes business objectives.3 Moreover, IT audits ensure that technical controls are designed and operating effectively to mitigate threats to the enterprise’s mission, vision and objectives.4 The need for IT audits is growing as technology evolves at an unprecedented velocity; the complexity of new technologies such as big data and containerization demands a unique set of skills and collaboration among IT specialists and IT auditors. The interaction between IT auditors and subject matter experts (SMEs) is vital to ensure that enterprises implement the appropriate safeguards and countermeasures.5 Audits enhance cyberresilience by ensuring that IT processes meet business goals and external requirements such as the US Health Insurance Portability and Accountability Act (HIPAA), the Payment Card Industry Data Security Standard (PCI DSS) and the EU General Data Protection Regulation (GDPR).

Industries of all sizes and types are exposed to risk; however, enterprises may not utilize their resources effectively to identify the likelihood of threats materializing and the potential impact if they do.6 For example, in the case of a new statutory or regulatory requirement, such as the US State of California Consumer Privacy Act (CCPA), the enterprise must effectively translate compliance risk throughout the strategic, operational and tactical tiers of the business. IT audits interpret risk by identifying the applicable requirements and communicating with senior management and subject matter experts within the enterprise to determine risk thresholds and implement required controls.7

Compliance vs. Risk

Enterprises must employ best practices to reduce the frequency of cybersecurity incidents and breaches of sensitive data. There are two methods of protecting against such events: compliance-based audits and risk-based audits. Compliance-based audits substantiate conformance with enterprise standards and verify compliance with external laws an d regulations such as GDPR, HIPAA and PCI DSS.8 Risk-based audits address the likelihood of incidents occurring because of vulnerabilities such as deficient safeguards, technologies, policies and procedures. Although risk-based audits include the risk of noncompliance, compliance-based audits do not identify and enforce risk thresholds.9 Both audit strategies aim to support enterprise objectives and compliance requirements, but the approaches vary in purpose, technique and execution. The juxtaposition of these two methodologies highlights their respective strengths and weaknesses. Additionally, this comparison provides insight for enterprises that need to support contrasting stakeholder interests and reduce risk to an acceptable level.

Compliance-Based Audits

Compliance-based audits evaluate compliance with laws, regulations and internal policies. These audits are necessary to establish a reasonable level of assurance that an enterprise is conforming with external requirements and internal processes. The risk of noncompliance, such as fees and penalties, necessitates compliance with industry standards and recognized practices. For example, in 2019, the US Department of Health and Human Services and the Office for Civil Rights (OCR) imposed a US$2.154 million penalty against an organization that violated HIPAA’s security and breach notification rules.10

Compliance-focused audits use frameworks such as those created by the US National Institute of Standards and Technology (NIST) and the International Organization for Standardization (ISO) to support enterprise objectives and comply with external requirements.11 IT auditors then utilize questionnaires based on these frameworks to establish statutory and regulatory compliance.12 IT auditors provide auditees with yes-or-no questions to ascertain whether adequate controls are in place to comply with laws, regulations and enterprise policy.13 Based on the responses, IT auditors perform substantive testing such as inspections, sampling and evidence gathering to obtain better assurance of compliance.14 This strategy is analogous to a physician asking a patient to complete a yes-or-no questionnaire to determine whether a more extensive examination is warranted. Modern IT audits leverage compliance-based tactics to ensure that enterprises conform to internal and external mandates. However, the increase in breaches highlights this methodology’s inconsistency, limitations and inherent risk.15

Risk-Based Audits

Risk-based audits also use industry frameworks to ascertain support of organizational goals and conformance to external parameters. In contrast to compliance-based audits, they also apply the enterprise’s risk appetite, risk tolerance and expectation of compliance.16 Risk appetite is the level of risk the enterprise is willing to accept in pursuit of its goals, objectives and mission and how much deviation is tolerable.17 First, IT auditors should consult senior management to establish risk thresholds. Then the auditors should involve subject matter experts to guarantee the accurate interpretation and employment of technical controls.18 At the strategic level, auditors should discuss risk factors that impact the enterprise’s mission, vision, strategy and objectives.

 

Second, IT auditors must communicate with management and business owners to identify risk factors that affect the enterprise at the operational level. The operational tier plays an imperative role by providing major business processes and services that support the strategic level’s business objectives and goals.19 Last, IT auditors must identify the underlying infrastructure that supports operations at the tactical level. The tactical or technical tier provides the infrastructure and technology that optimize and sustain the core services and processes in the operational tier. IT auditors must understand how risk factors at each level relate to and endanger the overall mission and business objectives. For example, frameworks such as COBIT® 201920 and NIST Special Publication 800-5321 help auditors translate strategic and operational risk into technical risk and vice versa. This strategy enables auditors to have conversations at each tier and educate management on how risk factors identified at one level can affect other levels.

Similar to compliance-based audits, risk-based audits use questionnaires to ensure that controls are operating and in compliance with internal and external mandates. However, in this case, IT auditors do not rely solely on yes-or-no responses; they weigh each response against the enterprise’s risk appetite and expectations.22 Additionally, risk-based questionnaires utilize open-ended questions to obtain information about the control environment. This strategy allows auditors to gain a clearer understanding of the enterprise’s security posture and associated risk. Risk-based methods also include an in-depth analysis based on the auditee’s response. However, because risk-based tactics evaluate responses against expectations rather than subjectively evaluating yes-or-no answers, the auditor is in a better position to determine the need for an investigation. Risk-based inquiries are comparable to an instructor presenting students with an examination. To grade each student’s paper fairly and consistently, the instructor must already know the answers to each question.

Modernizing IT Audits

Although risk-based audits provide several advantages over the compliance-based approach (figure 1),23 today’s environment necessitates a modern methodology to keep up with continuous changes in the threat landscape, information security and technology. Technologies such as containerization and microservices solutions present new risk factors for enterprises. Therefore, it is paramount that IT auditors continuously advance the profession and utilize tools and techniques such as data analytics, continuous auditing and continuous monitoring, which are indispensable. They better illuminate threats in real time and empower management to make informed decisions about control maturity and residual risk. 24, 25, 26, 27

Conclusion

Questionnaires present their own limitations during the audit process. For example, respondents may not answer truthfully or may skew their responses. Moreover, the IT auditor may not possess the skills or background to determine whether the responses are appropriate for a given situation.

Risk-based and compliance-based audits can benefit enterprises and protect them in several ways. For example, traditional compliance audits help enterprises conform to various mandates and prevent fines associated with noncompliance. However, compliance-based approaches do not take into account risk-based expectations or ensure that auditors have an adequate understanding of safeguards and technology. Most important, compliance-oriented strategies are ineffective and inconsistent in addressing risk factors other than compliance issues. Risk-based tactics, in contrast, address variations in experience among IT auditors by establishing expectations for both risk and compliance. This strategy enables IT auditors to remain objective and ensures a consistent interpretation of responses. Furthermore, this approach addresses different levels of IT audit skills and competencies by providing auditors with better direction and a better ability to evaluate responses to technical questions based on expectations.

RISK-BASED TACTICS... ADDRESS VARIATIONS IN EXPERIENCE AMONG IT AUDITORS BY ESTABLISHING EXPECTATIONS FOR BOTH RISK AND COMPLIANCE.

Significant business collapses such as Enron, WorldCom and Tyco forced the US Congress to enact standards such as the US Sarbanes-Oxley Act (SOX).28 However, more recent events such as the Equifax breach highlight weaknesses in the compliance-oriented approach.29 As the number of breaches continues to increase, enterprises should be concerned about how much reliance they place on compliance certifications.30 Although compliance is vital, it is crucial to emphasize that many enterprises that have experienced breaches, such as Equifax and Target,31 were compliant and had been certified by reputable auditing and accounting firms.32 Therefore, enterprises should reevaluate and modify their audit strategies to address risk factors distinct from compliance to reduce the likelihood of breaches.

Endnotes

1 AlKalbani, A.; H. Deng; B. Kam; X. Zhang; “Information Security Compliance in Organizations: An Institutional Perspective,” Data and Information Management, vol. 1, iss. 2, 2017, p. 104–114, https://www.sciencedirect.com/science/article/pii/S2543925122000924?via%3Dihub
2 Haapamäki, E.; J. Sihvonen; “Cybersecurity in Accounting Research,” Managerial Auditing Journal, vol. 34, iss. 7, 2019, p. 808–834, https://www.emerald.com/insight/content/doi/10.1108/MAJ-09-2018-2004/full/html
3 Ibid.
4 Bozkus, K. S.; C. Kiymet; “Cyber Security Assurance Process From the Internal Audit Perspective,” Managerial Auditing Journal, vol. 33, iss. 4, 2018, p. 360–376, https://www.emerald.com/insight/content/doi/10.1108/MAJ-02-2018-1804/full/html
5 Op cit Haapamäki, Sihvonen
6 Ibid.
7 De Smet, D.; A. Mention; “Improving Auditor Effectiveness in Assessing KYC/AML Practices: Case Study in a Luxembourgish Context,” Managerial Auditing Journal, vol. 26, iss. 2, 2011, p. 182–203, https://www.emerald.com/insight/content/doi/10.1108/02686901111095038/full/html
8 Kuhn, J. R.; B. Morris; “IT Internal Control Weaknesses and the Market Value of Firms,” Journal of Enterprise Information Management, vol. 30, iss. 6, 2017, p. 964–986, https://www.emerald.com/insight/content/doi/10.1108/JEIM-02-2016-0053/full/html
9 Op cit De Smet, Mention
10 US Department of Health and Human Services, “OCR Imposes a $2.15 Million Civil Money Penalty Against Jackson Health System for HIPAA Violations,” 23 October 2019, https://www.hhs.gov/about/news/2019/10/23/ocr-imposes-a-2.15-million-civil-money-penalty-against-jhs-for-hipaa-violations.html
11 Goldstein, A.; U. Frank; “Components of a Multi-Perspective Modeling Method for Designing and Managing IT Security Systems,” Information Systems and eBusiness Management, vol. 14, iss. 1, 2016, p. 101–140, https://link.springer.com/article/10.1007/s10257-015-0276-5
12 Huang, J.; D. M. Nicol; “Trust Mechanisms for Cloud Computing,” Journal of Cloud Computing, vol. 2, iss. 1, 2013, p. 1–14, https://journalofcloudcomputing.springeropen.com/articles/10.1186/2192-113X-2-9
13 Gutiérrez-Martínez, J.; M. A. Núñez-Gaona; H. Aguirre-Meneses; “Business Model for the Security of a Large-Scale PACS, Compliance With ISO/27002:2013 Standard,” Journal of Digital Imaging, vol. 28, iss. 4, 2015, p. 481–491, https://link.springer.com/article/10.1007/s10278-014-9746-4
14 Mentz, M.; K. Barac; E. Odendaal; “An Audit Evidence Planning Model for the Public Sector,” Journal of Economic and Financial Sciences, vol. 11, iss. 1, 2018, https://jefjournal.org.za/index.php/jef/article/view/166
15 Al-Moshaigeh, A.; D. Dickins; J. L. Higgs; “Cybersecurity Risks and Controls: Is the AICPA’s SOC for Cybersecurity a Solution?” CPA Journal, vol. 89, iss. 6, 2019, p. 36–41, https://search.proquest.com/openview/72915043b6ca9ac3e25c96c664bccb71/1?pq-origsite=gscholar&cbl=41798
16 Jana, V. W.; R. Rudman; “COBIT 5 Compliance: Best Practices Cognitive Computing Risk Assessment and Control Checklist,” Meditari Accountancy Research, vol. 27, iss. 5, 2019, p. 761–788, https://www.emerald.com/insight/content/doi/10.1108/MEDAR-04-2018-0325/full/html
17 Drew, M.; “Information Risk Management and Compliance—Expect the Unexpected,” BT Technology Journal, vol. 25, iss. 1, 2007, p. 19–29, https://link.springer.com/article/10.1007/s10550-007-0004-x
18 Hux, C. T.; “Use of Specialists on Audit Engagements: A Research Synthesis and Directions for Future Research,” Journal of Accounting Literature, vol. 39, 2017, p. 23–51, https://www.emerald.com/insight/content/doi/10.1016/j.acclit.2017.07.001/full/html
19 Iliescu, F.; “Auditing IT Governance,” Informatica Economica, vol. 14, iss. 1, 2010, p. 93–102, http://www.revistaie.ase.ro/content/53/09%20Iliescu.pdf
20 ISACA®, “COBIT® 2019: Effective IT Governance at Your Fingertips,” https://www.isaca.org/resources/cobit
21 National Institute of Standards and Technology, “Security and Privacy Controls for Information Systems and Organizations,” NIST Special Publication 800-53 Revision 5, USA, March 2020, https://nvlpubs.nist.gov/nistpubs/SpecialPublications/NIST.SP.800-53r5-draft.pdf
22 Op cit Jana, Rudman
23 Curtis, B.; “Compliance Audits vs Risk Audits,” 2020, https://my.visme.co/view/x4jpnmzn-compliance-audits-vs-risk-audits
24 Op cit Bozkus, Kiymet
25 Tang, J. J.; K. E. Karim; “Big Data in Business Analytics: Implications for the Audit Profession,” CPA Journal, vol. 87, iss. 6, 2017, p. 34–39, https://search.proquest.com/openview/124fc5055ff6e23ff84801bd967988f7/1?pq-origsite=gscholar&cbl=41798
26 Amoush, A. H.; “Using Information Technology Among Auditors in Jordan,” International Research Journal of Applied Finance, vol. 10, iss. 3, 2019, p. 109–114, https://search.proquest.com/openview/7ff6a822188d77605a2fd6ef01564b26/1?pq-origsite=gscholar&cbl=2046325
27 Doelitzscher, F.; C. Reich; M. Knahl; A. Passfall; N. Clarke; “An Agent Based Business Aware Incident Detection System for Cloud Environments,” Journal of Cloud Computing: Advances, Systems and Applications, vol. 1, iss. 1, 2012, p. 9, https://link.springer.com/article/10.1186/2192-113X-1-9
28 Zhang, P.; J. Long; J. Ma; “How IT Awareness Impacts IT Control Weaknesses and Firm Performance,” Journal of International Technology and Information Management, vol. 27, iss. 2, 2018, p. 99–120, https://scholarworks.lib.csusb.edu/jitim/vol27/iss2/5/
29 McKenna, F.; “Unit of Equifax’s Auditor EY Certified the Information Security That Was Later Breached,” MarketWatch, 20 December 2018, https://www.marketwatch.com/story/unit-of-equifaxs-auditor-ey-certified-the-information-security-that-was-later-breached-2018-12-20
30 Ibid.
31 Plachkinova, M.; C. Maurer; “Security Breach at Target,” Journal of Information Systems Education, vol. 29, iss. 1, 2018, p. 11–19, https://aisel.aisnet.org/jise/vol29/iss1/7
32 Op cit Al-Moshaigeh, Dickins, Higgs

Blake Curtis, CISA, CRISC, CISM, CGEIT, CISSP

Is an information security and compliance adviser for Cigna’s Global Security Assurance Team. He has more than 15 industry certifications across diverse disciplines and more than 10 years’ experience in engineering, networking, virtualization, IT service management, cybersecurity and risk management.