Booklet: Outsourcing Technology Services
Section: Appendix A:
Examination Procedures

 

 

 

 

 

 

EXAMINATION OBJECTIVE: Assess the effectiveness of the institution’s risk management process as it relates to the outsourcing of information systems and technology services.

Bullet

Tier I objectives and procedures relate to the institution’s implementation of a process for identifying and managing outsourcing risks.

Bullet

Tier II objectives and procedures provide additional validation and testing techniques as warranted by risk to verify the effectiveness of the institution’s process on individual contracts.

Tier I and Tier II are intended to be a tool set examiners will use when selecting examination procedures for their particular examination. Examiners should use these procedures as necessary to support examination objectives.

TIER I OBJECTIVES AND PROCEDURES

Objective 1: Determine the appropriate scope for the examination.
1.

Review past reports for weaknesses involving outsourcing. Consider:

     
 

Bullet

Regulatory reports of examination of the institution and service provider(s); and

 

Bullet

Internal and external audit reports of the institution and service provider(s) (if available).

   
2.

Assess management’s response to issues raised since the last examination. Consider:

 

Bullet

Resolution of root causes rather than just specific issues; and

 

Bullet

Existence of any outstanding issues.

   
3.

Interview management and review institution information to identify:

 

Bullet

Current outsourcing relationships and changes to those relationships since the last examination. Also identify any:

    Material service provider subcontractors,
    Affiliated service providers,
    Foreign-based third party providers;
 

Bullet

Current transaction volume in each function outsourced;

 

Bullet

Any material problems experienced with the service provided;

 

Bullet

Service providers with significant financial or control related weaknesses; and

 

Bullet

When applicable, whether the primary regulator has been notified of the outsourcing relationship as required by the Bank Service Company Act or Home Owners’ Loan Act.

 

Objective 2: Evaluate the quantity of risk present from the institution’s outsourcing arrangements.

1.

Assess the level of risk present in outsourcing arrangements. Consider risks pertaining to:

Bullet

Functions outsourced;

Bullet

Service providers, including, where appropriate, unique risks inherent in foreign-based service provider arrangements; and

Bullet

Technology used.

 

Objective 3: Evaluate the quality of risk management

1.

Evaluate the outsourcing process for appropriateness given the size and complexity of the institution. The following elements are particularly important:

Bullet

Institution’s evaluation of service providers consistent with scope and criticality of outsourced services; and

Bullet

Requirements for ongoing monitoring.

   

2.

Evaluate the requirements definition process.

Bullet

Ascertain that all stakeholders are involved; the requirements are developed to allow for subsequent use in request for proposals (RFPs), contracts, and monitoring; and actions are required to be documented; and

Bullet

Ascertain that the requirements definition is sufficiently complete to support the future control efforts of service provider selection, contract preparation, and monitoring.

   

3.

Evaluate the service provider selection process.

Bullet

Determine that the RFP adequately encapsulates the institution’s requirements and that elements included in the requirements definition are complete and sufficiently detailed to support subsequent RFP development, contract formulation, and monitoring;

Bullet

Determine that any differences between the RFP and the submission of the selected service provider are appropriately evaluated, and that the institution takes appropriate actions to mitigate risks arising from requirements not being met; and

Bullet

Determine whether due diligence requirements encompass all material aspects of the service provider relationship, such as the provider’s financial condition, reputation (e.g., reference checks), controls, key personnel, disaster recovery plans and tests, insurance, communications capabilities and use of subcontractors.

   

4.

Evaluate the process for entering into a contract with a service provider. Consider whether:

Bullet

The contract contains adequate and measurable service level agreements;

Bullet

Allowed pricing methods do not adversely affect the institution’s safety and soundness, including the reasonableness of future price changes;

Bullet

The rights and responsibilities of both parties are sufficiently detailed;

Bullet

Required contract clauses address significant issues, such as financial and control reporting, right to audit, ownership of data and programs, confidentiality, subcontractors, continuity of service, etc;

Bullet

Legal counsel reviewed the contract and legal issues were satisfactorily resolved; and

Bullet

Contract inducement concerns are adequately addressed.

   

5.

Evaluate the institution’s process for monitoring the risk presented by the service provider relationship. Ascertain that monitoring addresses:

Bullet

Key service level agreements and contract provisions;

Bullet

Financial condition of the service provider;

Bullet

General control environment of the service provider through the receipt and review of appropriate audit and regulatory reports;

Bullet

Service provider’s disaster recovery program and testing;

Bullet

Information security;

Bullet

Insurance coverage;

Bullet

Subcontractor relationships including any changes or control concerns;

Bullet

Foreign third party relationships; and

Bullet

Potential changes due to the external environment (i.e., competition and industry trends).

   

6.

Review the policies regarding periodic ranking of service providers by risk for decisions regarding the intensity of monitoring (i.e., risk assessment). Decision process should:

Bullet

Include objective criteria;

Bullet

Support consistent application;

Bullet

Consider the degree of service provider support for the institution’s strategic and critical business needs, and

Bullet

Specify subsequent actions when rankings change.

   

7.

Evaluate the financial institution’s use of user groups and other mechanisms to monitor and influence the service provider.
 

Objective 4: Discuss corrective action and communicate findings

1.

Determine the need to complete Tier II procedures for additional validation to support conclusions related to any of the Tier I objectives.
   

2.

Review preliminary conclusions with the EIC regarding:

Bullet

Violations of law, rulings, regulations;

Bullet

Significant issues warranting inclusion in the Report as matters requiring attention or recommendations; and

Bullet

Potential impact of your conclusions on the institution’s risk profile and composite or component IT ratings.

   

3.

Discuss findings with management and obtain proposed corrective action for significant deficiencies.
   

4.

Document conclusions in a memo to the EIC that provides report ready comments for the Report of Examination and guidance to future examiners.
   

5.

Organize work papers to ensure clear support for significant findings by examination objective.
 
TIER II OBJECTIVES AND PROCEDURES
 

A. IT REQUIREMENTS DEFINITION

1.

Review documentation supporting the requirements definition process to ascertain that it appropriately addresses:

Bullet

Scope and nature;

Bullet

Standards for controls;

Bullet

Minimum acceptable service provider characteristics;

Bullet

Monitoring and reporting;

Bullet

Transition requirements;

Bullet

Contract duration, termination, and assignment’ and

Bullet

Contractual protections against liability.

 

B. DUE DILIGENCE

1.

Assess the extent to which the institution reviews the financial stability of the service provider:

Bullet

Analyzes the service provider’s audited financial statements and annual reports;

Bullet

Assesses the provider’s length of operation and market share;

Bullet

Considers the size of the institution’s contract in relation to the size of the company;

Bullet

Reviews the service provider’s level of technological expenditures to ensure on-going support; and

Bullet

Assesses the impact of economic, political, or environmental risk on the service provider’s financial stability.

   

2.

Evaluate whether the institution’s due diligence considers the following:

Bullet

References from current users or user groups about a particular vendor’s reputation and performance;

Bullet

The service provider’s experience and ability in the industry;

Bullet

The service provider’s experience and ability in dealing with situations similar to the institution’s environment and operations;

Bullet

The cost for additional system and data conversions or interfaces presented by the various vendors;

Bullet

Shortcomings in the service provider’s expertise that the institution would need to supplement in order to fully mitigate risks;

Bullet

The service provider’s proposed use of third parties, subcontractors, or partners to support the outsourced activities;

Bullet

The service provider’s ability to respond to service disruptions;

Bullet

Key service provider personnel that would be assigned to support the institution;

Bullet

The service provider’s ability to comply with appropriate federal and state laws. In particular, ensure management has assessed the providers’ ability to comply with federal laws (including GLBA and the USA PATRIOT Act );additional information. and

Bullet

Country, state, or locale risk.

   
C. SERVICE CONTRACT
1.

Verify that legal counsel reviewed the contract prior to closing.

Bullet

Ensure that the legal counsel is qualified to review the contract particularly if it is based on the laws of a foreign country or other state; and

Bullet

Ensure that the legal review includes an assessment of the enforceability of local contract provisions and laws in foreign or out-of-state jurisdictions.

   
2.

Verify that the contract appropriately addresses:

Bullet

Scope of services;

 

Bullet

Performance standards;

 

Bullet

Pricing;

 

Bullet

Controls;

 

Bullet

Financial and control reporting;

 

Bullet

Right to audit;

 

Bullet

Ownership of data and programs;

 

Bullet

Confidentiality and security;

 

Bullet

Regulatory compliance;

 

Bullet

Indemnification;

 

Bullet

Limitation of liability;

 

Bullet

Dispute resolution;

 

Bullet

Contract duration;

 

Bullet

Restrictions on, or prior approval for, subcontractors;

 

Bullet

Termination and assignment, including timely return of data in a machine-readable format;

 

Bullet

Insurance coverage;

 

Bullet

Prevailing jurisdiction (where applicable);

 

Bullet

Choice of Law (foreign outsourcing arrangements);

 

Bullet

Regulatory access to data and information necessary for supervision; and

 

Bullet

Business Continuity Planning.

   
3.

Review service level agreements to ensure they are adequate and measurable. Consider whether:

 

Bullet

Significant elements of the service are identified and based on the institution’s requirements;

 

Bullet

Objective measurements for each significant element are defined;

 

Bullet

Reporting of measurements is required;

 

Bullet

Measurements specify what constitutes inadequate performance; and

 

Bullet

Inadequate performance is met with appropriate sanctions, such as reduction in contract fees or contract termination.

   
4.

Review the institution’s process for verifying billing accuracy and monitoring any contract savings through bundling.

 
D. MONITORING SERVICE PROVIDER RELATIONSHIP(S)
1.

Evaluate the institution’s periodic monitoring of the service provider relationship(s), including:

 

Bullet

Timeliness of review, given the risk from the relationship;

 

Bullet

Changes in the risk due to the function outsourced;

 

Bullet

Changing circumstances at the service provider, including financial and control environment changes;

 

Bullet

Conformance with the contract, including the service level agreement; and

 

Bullet

Audit reports and other required reporting addressing business continuity, security, and other facets of the outsourcing relationship.

   
2.

Review risk rankings of service providers to ascertain:

 

Bullet

Objectivity;

 

Bullet

Consistency; and

 

Bullet

Compliance with policy.

   
3.

Review actions taken by management when rankings change, to ensure policy conformance when rankings reflect increased risk.

   
4.

Review any material subcontractor relationships identified by the service provider or in the outsourcing contracts. Ensure:

 

Bullet

Management has reviewed the control environment of all relevant subcontractors for compliance with the institution’s requirements definitions and security guidelines; and

 

Bullet

The institution monitors and documents relevant service provider subcontracting relationships including any changes in the relationships or control concerns.