Evaluating Machine Learning-Driven Fraud Detection: Evidence from AquaData in EPMAPS (IADB-EC-T1647)

Countries
  • Ecuador
Geographic location where the impacts of the investment may be experienced.
Specific Location
Quito
Whenever identified, the area within countries where the impacts of the investment may be experienced. Exact locations of projects may not be identified fully or at all in project documents. Please review updated project documents and community-led assessments.
Financial Institutions
  • Inter-American Development Bank (IADB)
International, regional and national development finance institutions. Many of these banks have a public interest mission, such as poverty reduction.
Project Status
Proposed
Stage of the project cycle. Stages vary by development bank and can include: pending, approval, implementation, and closed or completed.
Bank Risk Rating
U
Environmental and social categorization assessed by the development bank as a measure of the planned project’s environmental and social impacts. A higher risk rating may require more due diligence to limit or avoid harm to people and the environment. For example, "A" or "B" are risk categories where "A" represents the highest amount of risk. Results will include projects that specifically recorded a rating, all other projects are marked ‘U’ for "Undisclosed."
Borrower
Government of Ecuador
A public entity (government or state-owned) provided with funds or financial support to manage and/or implement a project.
Sectors
  • Technical Cooperation
  • Water and Sanitation
The service or industry focus of the investment. A project can have several sectors.
Investment Type(s)
Advisory Services
The categories of the bank investment: loan, grant, guarantee, technical assistance, advisory services, equity and fund.
Investment Amount (USD)
$ 0.15 million
Value listed on project documents at time of disclosure. If necessary, this amount is converted to USD ($) on the date of disclosure. Please review updated project documents for more information.
Project Cost (USD)
$ 0.15 million
Value listed on project documents at time of disclosure. If necessary, this amount is converted to USD ($) on the date of disclosure. Please review updated project documents for more information.
Bank Documents
Primary Source

Original disclosure @ IADB website

Updated in EWS Oct 13, 2026


Contribute Information
Can you contribute information about this project?
Contact the EWS Team

Project Description
If provided by the financial institution, the Early Warning System Team writes a short summary describing the purported development objective of the project and project components. Review the complete project documentation for a detailed description.

According to the IADB, the objective is to determine the causal impact of machine learning-driven inspection targeting, through the AquaData algorithm, on fraud detection effectiveness, inspector productivity, revenue recovery, and apparent losses at EPMAPS. Because the 2023 pilot did not generate an identifiable counterfactual, the design is prospective and experimental.The main question is whether using the algorithm to prioritize inspections increases inspector productivity and fraud detection effectiveness relative to the current expert-based assignment process. Two complementary questions follow: the impact on inspector productivity, measured through inspections completed, hit rates, and recovered consumption per inspector; and the cost-effectiveness of the algorithm relative to the current process, accounting for implementation, operational, and inspection costs.The knowledge gap is well defined. Utilities across the region increasingly use machine learning to detect anomalies in consumption, flow, and pressure data that may signal fraud (Lee and Kim, 2023; Romero-Ben et al., 2023), and the problem is not unique to water: electricity losses average roughly 17% of grid input in the region (Jimenez Mori et al., 2014). However, this literature remains largely descriptive and relies on retrospective comparisons that cannot separate the effect of the algorithm from selection bias, leaving utilities without credible evidence on the gains they can expect.The theory of change is direct: using existing inspection staff, the resources to operate the algorithm, and historical billing data, the project designs a data collection protocol, institutionalizes the algorithm within the commercial losses unit, and trains inspectors. The output is an operational algorithm that prioritizes connections with the highest predicted probability of fraud, which should raise the share of inspections confirming fraud and the number of inspections per day and, over time, reduce apparent losses and improve revenue recovery, fine collection, and financial sustainability.The methodology is a prospective RCT randomized at the operational sector level. Of the 110 sectors (some 720,000 active connections), eligible sectors will be randomly assigned to treatment, where inspection priority is set by AquaData, or control, where the existing process continues. The sample is restricted to active residential connections (89% of contracts and 80% of consumption) and excludes remote or unsafe sectors under an ex-ante geographic criterion. Sector-level randomization mitigates spillovers between neighboring connections. The intervention is the use of the algorithm to prioritize cases, not the inspection itself, which is the field validation mechanism. Impact will be estimated by intention to treat using OLS, with standard errors clustered at the sector level and baseline controls, verifying balance between groups.Outcomes are measured with EPMAPS administrative data: (a) the share of inspections confirming an infraction; (b) inspections per inspector per working day; (c) revenue recovered through billing adjustments and fines; (d) effective collection of issued fraud notifications, against a baseline of 30-40%; and (e) the apparent loss index at the operational unit level.Fund resources will finance the design of the data collection protocol, the digitization of inspection records, the implementation and monitoring of the randomized rollout, the analysis, and dissemination.

Investment Description
Here you can find a list of individual development financial institutions that finance the project.

Contact Information
This section aims to support the local communities and local CSO to get to know which stakeholders are involved in a project with their roles and responsibilities. If available, there may be a complaint office for the respective bank which operates independently to receive and determine violations in policy and practice. Independent Accountability Mechanisms receive and respond to complaints. Most Independent Accountability Mechanisms offer two functions for addressing complaints: dispute resolution and compliance review.

No contacts available at the time of disclosure

 

ACCOUNTABILITY MECHANISM OF IADB

The Independent Consultation and Investigation Mechanism (MICI) is the independent complaint mechanism and fact-finding body for people who have been or are likely to be adversely affected by an Inter-American Development Bank (IDB) or Inter-American Investment Corporation (IIC)-funded project. If you submit a complaint to MICI, they may assist you in addressing the problems you raised through a dispute-resolution process with those implementing the project and/or through an investigation to assess whether the IDB or IIC is following its own policies for preventing or mitigating harm to people or the environment. You can submit a complaint by sending an email to MICI@iadb.org. You can learn more about the MICI and how to file a complaint at http://www.iadb.org/en/mici/mici,1752.html (in English) or http://www.iadb.org/es/mici/mici,1752.html (Spanish).

How it works

How it works