ISACA Pittsburgh will be hosting a 2 day virtual training event.
April 22nd and April 23rd from 8:30 AM - 4:30 PM EST both days.
Auditing Corporate AI Strategic Planning and Implementation Initiatives
Detailed information about the class:
Seminar Objective
This course is designed to provide professionals with the knowledge and skills necessary to conduct various types of AI audits within their organization. Participants will gain a deep understanding of AI technologies, their potential risks and benefits, and gain knowledge of the detailed audit test procedures required to perform effective AI audits.
Seminar Length
Two days (7 ½ -hour presentation time per day plus 1-hour lunch and four 10-minute breaks per day)
Who Should Attend
This seminar is designed for senior IT Auditors, Security and GRC personnel. In addition, due to the technical nature of the materials being presented, it would be useful for individuals responsible for building out a corporate AI program
Continuing Professional Education Credits
All attendees are eligible to receive 15 hours of continuing professional education (CPE) credits issued by the ISACA/IIA Local Chapter by attending.
Learning Outcomes
Attendees will achieve the following learning outcomes:
- Will be able to evaluate the effectiveness of AI governance practices
- Identify and assess AI risks
- Conduct audits of the AI Strategic Plan and Implementation initiatives
- Provide meaningful recommendations to mitigate AI risks
Seminar Outline The following topics will be discussed:
Day 1
I. Introduction
- AI key concepts required to focus on potential key AI corporate usage AI Models
- Techniques used to train AI Models ▪ Natural Language Learning Processing (NLP)
- Large Language Models (LLMs)
- Machine Learning
- Deep Learning
- Datasets, AI Tokens, Inference, Algorithms
- AI Usage within Organizations General usage across all areas of an organization
- AI usage within
- Software development
- IT System Operations
- Information Security
- AI usage to support key business processes
- AI usage within 3rd party vendor products
- AI “Caution Winds” Define Corporate AI philosophy
- Risks with using Generative AI
- Risks with the integration AI within business processes
II. Understanding AI Regulations and their Organizational Impacts
• EU AI Act
• Regulations being discusses and/or enacted in the US and at the state level (such as CA SB -1047 AI Safety Bill, Colorado AI Act)
III. Understanding and practical use of AI Frameworks
• NIST AI 100-1 AI Risk Management Framework
• Responsible AI Impact Assessment Tools
• Algorithmic impact assessment tools
IV. Establishing an AI Strategic Plan
- Traditional components of an AI Strategic Plan Information Technology Current State Assessment
- Information Technology Planned initiatives
- Business Goals
- Information Technology Service Delivery Components
- Information Technology Alignment to Business Goals
- Additional components required to be included within an AI Strategic Plan AI Vision and Mission
- AI Business Opportunities translated to required Initiatives
- Assessment of Organization AI talent capabilities to meet initiatives
- Assessment of Technology Infrastructure to meet initiatives
- AI Implementation Projects and Deployment
- Monitoring and Evaluation
- Ethical Considerations and Governance
Day 2
V. Conducting an AI Impact assessment
- Criteria to identify inscope systems
- Data Assessment
- Algorithmic Assessment
- Assessment of Benefits versus Potential Risk
- Mitigation Strategies
- Oversight and Control
VI. Establishing AI Implementation Plans and Initiatives
- AI Policies, Standards and Frameworks
- Establish an AI Roadmap
- AI Use Cases
- AI Data Strategy Model Selection and Deployment
- Infrastructure and Technology
- Deployment and Integration
- Testing and Validation
- Continuous Improvement
VII. Alternative AI Audit Approaches
- Initial Audit to assess whether AI Governance Structure has been established
- Auditing the AI Strategic Plan
- Conducts Audits of AI Implementation Plans
- Enhancing IT Governance audits to cover AI
Case Studies
Two case studies will be presented during the seminar which will reinforce the understanding of the lecture materials presented. These case studies represent the AI consulting projects and audits that have been performed by the instructor in which walkthroughs are documented. The seminar attendees task is to identify the AI project issues and overall audit issues.
- Case Study #1: Conducting the initial AI Audit of an organization
- Case Study #2 Identifying the flaws within the organizations’ AI Strategic Plan
Audit Program
An audit program which covers all topics discussed will be distributed as part of the session materials.