Monday, November 22, 2010

Peer Review Points to Quality Control Deficiencies in State/OIG's MERO Audits, Job Opens for Assistant Inspector General

Peer review caused the conversion of Audit Reports to Assessment Reports, the merging of MERO with Office of Audits and State/OIG is now looking to hire an Assistant Inspector General for MERO
(scroll below for official response on the AIG job posting)

We have posted over the weekend on POGO's letter to President Obama which urged the appointment of a "truly independent and aggressive" Inspector General for the State Department (see POGO writes Pres Obama about State's Inspector General, urges appointment of a "truly independent and aggressive" IG | November 20, 2010).

One of the items in that POGO letter that caught our attention is the mention of the peer review report conducted by the National Aeronautics and Space Administration (NASA) OIG on behalf of the Council of Inspectors General on Integrity and Efficiency (CIGIE), which identified numerous troubling deficiencies in MERO’s performance.  The report went so far as to recommend that "State OIG retract any report that fails to meet generally accepted government auditing standards" or GAGAS.

According to its website State's OIG opened its first permanent office outside of the United States January 23, 2008, when the Middle East Regional Office (MERO) began operations in Amman, Jordan. The Assistant Inspector General for MERO is located in Washington D.C.; however the office director is at the U.S. Embassy in Amman, Jordan. It serves as the principal planning and coordinating office for all OIG activities within the regional area from Northern Africa to the Middle East and Central/Southern Asia. The office's purpose is to provide oversight and assistance for high-cost, high-risk Department programs located in crisis and post conflict areas and countries.

If we did not see this in POGO's letter, we would never have known about it.  The peer review document is posted in State/OIG's website, but it's four levels deep and unless you know what you're looking for, you probably would spent tons of time digging in the various report "buckets" that have no central index.

Some excerpts from the NASA OIG peer review report:

  • State OIG has two Assistant Inspectors General (AIGs) for auditing: one leads the domestic Office of Audits and the other leads MERO. The MERO AIG told us that when his division was first created, he had planned to develop a separate audit manual for MERO. However, this manual was never developed. In April 2009, State’s Acting Inspector General directed MERO to adopt the manual used by the domestic Office of Audits. Consequently, MERO auditors conducting reviews between January 2008 and April 2009 were operating with no officially documented audit policy.
MERO Deficiencies in Complying with a System of Quality Control

1. Lack of Documented Evidence in Support of Audit Conclusion – We did not always find documented evidence to support audit conclusions. GAGAS requires that auditors determine the overall sufficiency and appropriateness of evidence to provide a reasonable basis for findings and conclusions. The State OIG Office of Audits’ audit manual states that evidence is sufficient and appropriate when it provides a reasonable assurance that the findings or conclusions are supported within the context of the audit objectives. We determined for one MERO report that the evidence contained in the audit files did not support audit conclusions. Specifically, the audit documentation for the report was inadequate and finding summaries were often incomplete (MERO-IQO-09-02, “Review of Diplomatic Security’s Management of Personal Protective Services in Iraq,” January 9, 2009). We also identified two deficiencies in another report: (1) audit steps were not crossindexed to supporting work papers; and (2) auditors did not consistently follow State OIG’s quality control policies and procedures for performance audits (MERO-A-09-10, “Performance Audit of Embassy Baghdad’s Transition Planning for a Reduced United States Military Presence in Iraq,” August 19, 2009).

In addition, for two reports we found MERO did not complete quality control checklists or provide other evidence of a comprehensive quality control review to ensure the audits complied with GAGAS (“Review of Diplomatic Security's Management of Personal Protective Services in Iraq,” MERO-IQO-09-02, January 9, 2009, and “Performance Audit of the Triple Canopy Contract for Personal Protective Services in Iraq,” MERO-IQO-09-03, April 30, 2009).

According to MERO officials, its auditors did not include the elements discussed above in work papers because MERO did not begin to follow the State OIG Office of Audits’ or any other written audit manual until April 2009. Accordingly, we could not determine whether MERO audit conclusions were adequately supported by documented evidence in accordance with GAGAS.

2. Inadequate Evidence of Staff Supervision – We did not consistently find consistent evidence of adequate supervision of MERO staff. According to GAGAS, supervision involves providing sufficient guidance and direction to staff assigned to the audit to address the audit objectives and follow applicable standards. In addition, the State OIG Office of Audits’ audit manual states that it is the responsibility of the audit manager to document evidence of reviews to show that the project has met supervision standards. Three reports we examined (MERO-IQO-09-02, “Review of Diplomatic Security’s Management of Personal Protective Services in Iraq,” January 9, 2009; MERO-IQO-09-03, “Performance Audit of the Triple Canopy Contract for Personal Protective Services in Iraq,” April 30, 2009; and MERO-A-09- 10, “Performance Audit of Embassy Baghdad’s Transition Planning for a Reduced United States Military Presence in Iraq,” August 19, 2009) lacked adequate evidence of supervision of staff. Specifically, the level of direction and supervision of staff was inadequately documented in the work paper files. In addition, MERO staff signed and dated almost none of the work papers to indicate they were prepared and ready for review nor did supervisors sign and date the work papers to indicate they had been reviewed.

Insufficient Documentation of Audit Planning – We did not find sufficient documented evidence to give reasonable assurance that MERO adequately planned its audits. GAGAS requires that auditors must adequately plan and document the planning of work necessary to address audit objectives. The State OIG Office of Audits’ manual lists several elements that audit teams must document in their audit work paper files to ensure adequate planning of audits, including assessing the risks of fraud, assessing internal controls, documenting relevant laws and regulations, and documenting the audit’s scope and methodology. Based on our review, we concluded that MERO did not consistently include documentation to provide assurance that its audits were adequately planned.

3. MERO Did Not Have Adequate Control of Audit Work Papers
– MERO was initially unable to locate the work papers for one audit we requested to review (MERO-I-09-09, “Review of the Roles, Staffing, and Effectiveness of Regional Embassy Offices in Iraq,” August 25, 2009). GAGAS requires audit organizations to establish and comply with policies and procedures for the safe custody and retention of audit documentation. However, when we requested the work papers for this audit, MERO could not locate them. Accordingly, we selected another audit report for review. The MERO AIG informed us 2 months after our request that the missing work papers had been located on the MERO Baghdad server. Although we are aware that MERO auditors faced extreme war time conditions and were required to use State Department servers containing strict security access controls, upon returning to a stable working environment the auditors were required to properly document and file work papers to ensure that the information is safeguarded and readily accessible
when needed.

In a memo to the Secretary dated October 15, 2010, State's Inspector General Geisel attached the NASA OIG report and writes:
Generally accepted government auditing standards (GAGAS) require OIG organizations that perform audits or attestation engagements to have an appropriate system of quality control and to undergo external peer reviews at least once every 3 years. State OIG's response to NASA (Exhibit B to the NASA report) is included as a part ofthe external peer review report and describes the actions taken and actions planned for 2011 to address the reported deficiencies. Both the report and OIG's response will be posted on IG's website.

NASA OIG opined that the system of quality control for State OIG's audit organizations in effect for the year ending September 30,2009, although suitably designed, was not consistently followed by one of State's two audit divisions OIG's Middle East Regional Office (MERO). Consequently, State OIG received a peer review rating of pass with deficiencies.
[...]
Finally, in September 2010, I directed that all MERO activities and functions merge within the Office ofAudits, effective October 1, 2011, ensuring that only one office within OIG issues GAGAS reports. This internal reorganization will not disrupt MERO's work or change its mission and will result in strengthening our quality control system through adherence to a single standard. OIG staff and personnel will continue to be based in Baghdad, Islamabad, Kabul, Amman, Cairo, and Washington, D.C.

Read the whole thing here.

As to the MERO reports, eight are currently unavailable for download and marked "This report is currently under revision."



In a related development -- USAjobs.gov has a job announcement dated November 18 (the same day POGO released its letter to the President) for an Assistant Inspector General for OIG's MERO office. 

Job Title: Assistant Inspector General
Department: Department Of State
Agency: Department Of State
Sub Agency: Civil Service Personnel-Civil Srvc and Iraq Jobs
Job Announcement Number: CSP-2011-0006

SALARY RANGE:
    $119,554.00 - $179,700.00 /year
OPEN PERIOD:
    Thursday, November 18, 2010 to Monday, December 06, 2010
SERIES & GRADE:
    ES-0301-99/99
POSITION INFORMATION:
    Full Time Permanent
PROMOTION POTENTIAL:
    99
DUTY LOCATIONS:
    1 vacancy - Washington DC Metro Area, DC
WHO MAY BE CONSIDERED:
#     All groups of qualified individuals within the civil service.

# Noncompetitive (Current career SES, QRB certified graduates of SES candidate development programs and individuals with SES reinstatement eligibility)

Over at the OIG website, an incumbent is still listed as Assistant Inspector General for the Middle East Regional Office.  It does not look like this is additional staffing if you read the job announcement here.  Does this mean the current AIG  for MERO has quit/will quit or has been asked to take a walk?  We have sent that question to the OIG's press shop but have yet to receive a response as of this writing.

Updated @11/23 7:36 pm with OIG response:
Douglas Welty, OIG's Congressional & Public Affairs Officer responded to our inquiry about the AIG job posting, reprinted below in full:
"In response to your inquiry regarding the recent posting of a job announcement for the position of Assistant Inspector General, Middle East Regional Office with the Department of State’s Office of Inspector General, this is NEITHER a result of the resignation NOR termination of Richard “Nick” Arntson who currently fills that position. The position has been elevated to the Senior Executive Service level and, as is required, has been posted on both the OPM and OIG Websites, soliciting qualified applicants. Under OPM rules, incumbents must re-apply – and Mr. Arntson has expressed his intention to do so."




No comments: