Introduction

Urban rodent management is a core environmental public health function due to the association of commensal rodents with environmental degradation, food contamination, structural damage, and zoonotic disease transmission. Integrated Pest Management (IPM) involves structured surveillance, identification of conditions conducive to infestation, targeted intervention, and systematic evaluation through resurvey. Documentation of rodent activity through standardized inspection instruments and interventions to address environmental drivers (food, water, shelter) represent the basis of public health mitigations.

DC Health Resident-generated service requests (e.g., 311 systems) function as a major source of surveillance data. However, complaint data is heavily influenced by housing characteristics, sanitation conditions, and patterns of civic engagement (citation). Thus, 311 data represent a signal of perceived rodent activity useful for M&E functions; however, it should not be considered a direct measure of rodent abundance. Empirical studies demonstrate complaint volume is correlated with environmental predictors of rat presence, is spatially autocorrelated and introduces reporting bias. 311 data is therefore a surveillance input that is contingent on field verification.

Several public health agencies have demonstrated success in data analysis of IPM interventions including New York City’s rat “indexing” approach using standardized inspection checklists and repeated measurement of Active Rat Signs (ARS) on a block level basis. Ecological studies further emphasize that rat populations exhibit spatial persistence and localized movement patterns, making recurrence and hotspot persistence critical outcome measures.

This Monitoring and Evaluation (M&E) framework is grounded in IPM theory, structured surveillance, and recognition of health equity with specificity to reporting inequities. Effort is made to integrates complaint data, inspection verification, intervention documentation, follow-up evaluation, and routine surveys into a near real-time monitoring system capable of supporting both operational decision-making and strategic equity-informed resource allocation.

Objectives

The proposed IPM Monitoring and Evaluation framework has four primary objectives:

1. Strengthen Surveillance Quality

To establish a standardized, place-based surveillance system that integrates 311 complaint signals with structured field verification using a consistent Rodent Sign Index (RSI) or Active Rat Signs (ARS) checklist, in alignment with CDC IPM guidance.

2. Measure Program Effectiveness and Sustainability

To quantify whether IPM interventions reduce verified rodent activity over time, as measured by:

• Reduction in RSI/ARS severity at follow-up inspection
• Decline in hotspot persistence
• Reduction in short-term recurrence (e.g., 60-day recurrence rate)

3. Distinguish Service Responsiveness from Environmental Remediation

To monitor operational performance (e.g., time to inspection, case closure) while separately measuring structural remediation (e.g., sanitation correction, referral completion) consistent with IPM principles emphasizing removal of conducive conditions.

4. Incorporate Equity and Reporting Bias Correction

To address socio-spatial disparities in complaint reporting by:

• Calibrating 311 complaints against confirmed field findings
• Identifying under-reporting high-risk areas using risk-adjusted models
• Ensuring parity in response times and outcomes across high-vulnerability neighborhoods

Together, these objectives ensure that the program measures not only activity volume but verified risk reduction and equitable service delivery.

Methods

Study Design and Framework

This M&E system uses a place-based, longitudinal surveillance design consistent with CDC IPM guidance and municipal rat indexing approaches. The analytical unit is the place (parcel or blockface), allowing linkage across complaints, inspections, interventions, referrals, and follow-up visits over time.

The framework integrates three surveillance streams:

1. Resident-Generated Signals (311)

Complaint data are treated as a behavioral surveillance input. Requests are geocoded and linked to place identifiers. Complaint-to-confirmation ratios are calculated to calibrate signal reliability.

2. Structured Field Verification

All inspections use a standardized checklist documenting rodent signs (burrows, droppings, gnaw marks, sightings) and environmental conditions conducive to infestation. Each visit generates a Rodent Sign Index (RSI) score. Follow-up inspections repeat the same instrument to measure change.

3. Routine and Proactive Surveys

Independent of complaints, proactive inspections are conducted in high-risk or under-reporting areas to reduce surveillance bias and provide ground-truth verification of rodent activity trends.

Indicator Definition

Indicators are organized into five domains:

1. Operational Performance: time to inspection, backlog, documentation completeness
2. Signal Calibration: percent confirmed complaints, complaint-to-confirmation ratio
3. Effectiveness: RSI reduction at follow-up, percent improved sites
4. Sustainability: 60-day recurrence rate, hotspot persistence index
5. Equity: under-reporting gap index, proactive inspection coverage, SLA parity, outcome parity

Hotspots are defined as blockfaces within the top decile of verified RSI burden. Persistence is measured as presence in hotspot status for ≥3 consecutive months, reflecting ecological evidence of localized rat movement and environmental entrenchment.

Data Management and Integration

Data are ingested from:

Equity Adjustment

To address reporting bias documented in 311 literatures, a predictive model estimates expected complaint volume based on environmental and housing predictors. Areas with lower-than-expected complaint volume, but elevated environmental risk are flagged as potential under-reporting zones. Proactive inspection coverage targets are assigned to these areas to ensure equitable surveillance and intervention.

Evaluation Approach

Program performance is assessed through routine aggregation and structured review of data already generated through complaint intake, inspection of documentation, intervention records, and follow-up activities. The evaluation approach formalizes existing operational information into a standardized performance management cycle consistent with CDC IPM guidance.

Performance monitoring includes:

• Time-series review of RSI trends and hotspot persistence, using inspection data already collected through routine field visits. RSI scores are summarized monthly and quarterly to assess changes in verified rodent activity across blockfaces and wards.
• Before–after comparisons within targeted zones, using baseline and follow-up inspection findings to determine whether documented interventions correspond with measurable reductions in rodent activity. This relies on standard inspection checklists and does not require additional field visits beyond normal follow-up procedures.
• Monitoring of recurrence rates, defined as repeat complaints or verified rodent activity within a defined post-closure window (e.g., 60 days). Recurrence monitoring uses existing case and inspection timestamps to assess sustainability of control efforts.
• Comparative parity review across vulnerability strata, examining whether response times, follow-up completion, and verified improvement rates are consistent across neighborhoods. This analysis uses existing complaint, inspection, and contextual data and is incorporated into quarterly management review rather than creating a new operational workflow.

 [BC1]Does DC have a definition?

 [BC2]With incomplete information existing systems