--- name: mid-engagement-ir-detection description: Methodology for detecting client SOC patches, attacker activity, and security-state changes that occur DURING a red-team engagement — and converting those observations into deliverable findings. Built from authorized red-team work where the client patched a confirmed SQLi within 30 minutes of detection AND an external attacker locked multiple new accounts during a single test session. Use when (a) running ANY active engagement against a monitored target, (b) a previously-confirmed finding stops reproducing, (c) baseline timing shifts unexpectedly, or (d) you notice response patterns changing during testing. sources: authorized-engagement report_count: 1 --- ## When to use this skill Trigger when: - Running active testing against a target with active SOC monitoring - A confirmed-vulnerable finding stops reproducing on recheck - Baseline timing shifts unexpectedly (3× slower, sudden errors, new headers) - Response sizes change between test windows - New WAF cookies or headers appear that weren't there at session start - Lockout / error rates change between test windows (especially LOCKED count for credential attacks) - Engagement is "assume breach" or "white box" — client knows you're testing DO NOT use for: - Bug bounty (client doesn't know you're there; no real-time IR) - Pure recon (no state-change happening) - One-off vulnerability scanning (no temporal dimension) --- ## The core insight In a real red-team engagement against a competent SOC, the security state of the target is **not static**. It changes during your test in response to your traffic. These state changes are: 1. **Themselves valuable findings** (positive operational observations about IR responsiveness) 2. **Confirmation evidence** (mid-engagement patch = the original vulnerability was real) 3. **Classification signals** (WAF rule deployment vs code fix — different remediation depth) Anti-pattern: treating reproduction failure as evidence the original signal was a false positive. **Original PoC artifacts captured before the change are still the vulnerability finding.** --- ## The discipline — capture before, diff after ### Before any active test: ```python # Capture pre-test fingerprint of the target fingerprint = { "ts_pre": time.time(), "ip_seen": "", "baseline_response_time_ms": , "baseline_response_size_bytes": , "response_headers": , "waf_cookies": , "lockout_count_in_state": , } ``` Persist to `engagement_log/fingerprint_pre.json`. ### During the test: Log every test result with full context (timestamp, IP, payload, response code, response size, response time, headers if relevant) to JSONL append-only. ### After the test session OR on first failed-recheck: ```python fingerprint_post = same structure delta = { "baseline_time_change_ms": post.time - pre.time, "baseline_size_change_bytes": post.size - pre.size, "new_headers_appeared": post.headers - pre.headers, "new_waf_cookies": post.cookies - pre.cookies, "new_lockouts": post.locked_count - pre.locked_count, } ``` If any delta is significant — **investigate, don't retract**. --- ## The three primary IR observations ### Observation 1 — Mid-engagement WAF rule deployment **Symptoms:** - Original payloads return identical response → no signal at all on recheck - Body size identical to baseline (login page reflection) - Timing reverts to baseline regardless of payload - New cookie or header in responses (e.g., `cf-bm`, `__cf_bm`, `awselb`) - Specific keyword in URL/body now triggers different response code (403, 406, 429) **Confirmation:** retry with WAF-evasion variants: - URL-encode the payload differently (`%27` vs `%5cu0027`) - Change request method (POST → PUT, GET → POST) - Different content-type (form-urlencoded → multipart) - Slower pace (5s → 60s between requests) - Mixed-case keywords (`SLEEP` → `SlEeP`) If WAF-evasion variants restore the signal, the mitigation is at the WAF layer (bypassable). If even WAF-evasion variants stay blocked, the mitigation is likely in code. **Finding template:** ``` Subject: Mid-engagement mitigation deployed for Observation: At engagement timestamp T0, vulnerability on was confirmed via . At T0+, recheck via the original payload no longer reproduces the timing/error/size differential. [does/does not] restore the signal. Description: This pattern is consistent with the client SOC observing engagement traffic and deploying a mitigation in real time. Mitigation depth assessment: [at-WAF, bypassable] vs [in-code, durable]. Impact (positive): Client SOC has both detection-grade visibility into application traffic AND the authority to deploy mitigations within ~ of detection. Impact (caveat): The original vulnerability did exist and was exploitable for at least the engagement window before mitigation. If the mitigation is at the WAF layer only, the underlying code-level flaw remains exploitable via alternative payloads. Recommendation: 1. Verify the mitigation is in code (parameterized queries, input sanitization), not just at the WAF layer. 2. Audit the codebase for the same root cause across sister applications. 3. (Positive) Document the IR responsiveness as a capability metric. ``` ### Observation 2 — Active concurrent attacker **Symptoms:** - Many `AADSTS50053` (LOCKED) responses despite your 1-attempt-per-user discipline - Lockouts cluster alphabetically or by some other sort key - New lockouts appear DURING your engagement (diff before/after) - LOCKED rate exceeds expected baseline (in our engagement: 11% of all attempts → red flag) **Math check:** - Your discipline: 1 attempt per user lifetime - Smart Lockout default: 10 fails / 10 min - Therefore: you cannot mathematically cause Smart Lockout - Therefore: every AADSTS50053 you see was caused by someone else **Confirmation:** - Sort locked accounts alphabetically; if they cluster, attacker is using sorted username list - Compare pre-session lockout count vs post-session — new locks during your session = attacker is active *right now* - Probe a known-active "system" account (`noreply@`, `info@`, `oc@`) — if it's locked, attacker is hitting service mailboxes too (typically MFA-exempt → high-value to attackers) **Finding template:** ``` Subject: Active external password-spray campaign detected during engagement Observation: During M365 ROPC validation against the Entra tenant, unique principals returned AADSTS50053 (Smart Lockout) when probed with a single password attempt at safe pace. With our hard cap of 1 attempt per user, we cannot mathematically cause these lockouts. The locks are pre-existing and continue to accumulate during our engagement window — NEW locks observed between and . Description: The pattern (alphabetical clustering, real-time accumulation, including system mailboxes) is consistent with an external attacker performing a username-list-driven password spray attack against the tenant. Impact: An external adversary is actively attempting to compromise corporate M365 accounts. The attacker has knowledge of the user-email schema and a password-guess wordlist. (Smart Lockout differentiates valid from invalid usernames). Recommendation (CRITICAL — within 24h): 1. Open a P1 incident with the SOC. Pull Entra sign-in logs for the locked accounts over the last 30-60 days. Identify source IPs and time windows. 2. Apply Conditional Access rule blocking sign-ins from outside for non-admin accounts. 3. Enable Identity Protection's User Risk policy with auto-reset on high risk. 4. Force tenant-wide password reset for all previously-locked accounts. 5. Audit service accounts for MFA exemptions; ensure all human-interactive accounts have phishing-resistant MFA. Evidence: engagement_log/poc/m365/locked_accounts.txt ( entries with timestamps) ``` ### Observation 3 — Detection-induced rate limiting / IP blocks **Symptoms:** - Specific IP starts returning 403 / 429 / 451 after a window of normal responses - Specific IP starts seeing dramatically slower responses (3x+ baseline) - TLS handshake fails or RST mid-connection - DNS suddenly returns NXDOMAIN for hosts that resolved before - Some hosts work from one IP but not another **Confirmation:** - Rotate to a different IP and retry — if works, you got rate-limited/blocked - Compare TTL on DNS responses — sudden short TTL = active mitigation deployed - Check `Server:`, `Via:`, `CF-Cache-Status:` headers for CDN-introduced limits **Finding template (operational note, usually low/info severity):** ``` Subject: Engagement traffic detected — IP rate-limited at Observation: After ~ requests in from IP , target began returning

 for all subsequent requests. Rotation to IP 
restored normal responses.

Description: Active anti-automation control at the perimeter (CDN/WAF/origin).

Impact (positive): Volumetric anti-automation is functional.

Impact (caveat): Rotation defeats this control trivially (cloud VMs cost <$5).
A patient adversary or spray-from-residential-proxies attacker is not affected.
```

---

## State diff — the key technique

Maintain three pieces of state:

### 1. `engagement_log/baseline.json` — captured at session start

```json
{
  "ts": "2026-05-08T13:00:00",
  "source_ip": "",
  "targets": {
    "https://target.example.com/login": {
      "baseline_response_time_ms": 584,
      "baseline_response_size_bytes": 11966,
      "headers_seen": ["Server: Apache", "X-Powered-By: PHP/8.0.26"],
      "set_cookie_names": ["PHPSESSID"]
    }
  },
  "m365": {
    "lockout_count": 247,
    "valid_creds_count": 0
  }
}
```

### 2. `engagement_log/journal.jsonl` — append-only test log

Every test logs:
```jsonl
{"ts":"...","ip":"...","tool":"...","target":"...","payload":"...","resp_code":...,"resp_size":...,"resp_ms":...,"verdict":"...","notes":"..."}
```

### 3. `engagement_log/state_changes.jsonl` — observed deltas

When a state change is detected, append:
```jsonl
{"ts_observed":"2026-05-08T14:30:00","change_type":"baseline_time_shift","target":"https:////login.php","baseline_pre_ms":24412,"baseline_post_ms":90403,"interpretation":"likely WAF rule deployed","actions_taken":["tested WAF-evasion variants — no signal restoration","documented as IR-mitigation finding"]}
```

This third file is your finding evidence. Every entry is a candidate finding.

---

## Tooling — automated state-change detection

```bash
# Bash watcher — runs every 5 min during engagement, alerts on shifts

cd "$ENGAGEMENT_DIR"

# Re-measure baseline timing on key targets
for target in "$@"; do
  ms=$(curl -sk -o /dev/null -w "%{time_total}" "$target" --max-time 30)
  ms_int=$(echo "$ms * 1000" | bc | cut -d. -f1)
  echo "$(date -u +%FT%TZ) $target $ms_int" >> baseline_history.log
done

# Diff against pre-session baseline
python3 - << 'PY'
import json, time
baseline = json.load(open("engagement_log/baseline.json"))
for line in open("baseline_history.log"):
    parts = line.strip().split()
    ts, target, ms = parts[0], parts[1], int(parts[2])
    if target in baseline["targets"]:
        pre = baseline["targets"][target]["baseline_response_time_ms"]
        if abs(ms - pre) > pre * 0.5:  # >50% shift
            print(f"ALERT {ts} {target} time {pre} -> {ms}")
PY
```

For lockout-count tracking on M365:
```bash
# Run every 30 min during M365 spray
LOCK_COUNT=$(grep -c '"AADSTS50053"' engagement_log/o365_results.jsonl)
echo "$(date -u +%FT%TZ) lockout_count $LOCK_COUNT" >> lockout_history.log
# Diff first vs last to surface delta
```

---

## The "single signal recanted" rule

If a confirmed-vulnerable finding stops reproducing:

1. **DO NOT delete the original PoC.** Original timestamps + payloads + response captures are forever.
2. **Capture the new state in detail.** What's the recheck response? What's different?
3. **Try at least 3 alternative vectors** before declaring "indeterminate".
4. **If none restore the signal**, document as "vulnerability confirmed at T0, mitigation observed at T0+, mitigation depth: [WAF | code]".
5. **Both states go in the report.** The original finding + the IR observation.

This is the discipline that distinguishes professional red team from "hobbyist scanning". Your client wants the timeline of vulnerability + mitigation, not just the static state.

---

## Why this is a finding (selling it to the client)

When you tell a client "I confirmed SQLi at 14:24, you deployed a mitigation by 14:55, here's the original PoC and here's why you should still verify the fix is in code":

- **Confirmed the vulnerability existed** (auditor-grade evidence)
- **Confirmed the mitigation was deployed** (positive ops finding for the SOC)
- **Identified the depth question** (WAF vs code — different remediation cost)
- **Demonstrated red-team value** (you proved both the bug AND the IR responsiveness)

This is a more valuable deliverable than "I confirmed SQLi" alone, because it captures the engagement's full operational picture.

---

## Anti-patterns to avoid

- **"Recheck failed → false positive."** No. Recheck failed because the target changed. Investigate the change.
- **"It's no longer vulnerable, drop the finding."** No. It WAS vulnerable. The finding stays. Add a "current state: mitigated" annotation.
- **"They patched it, mission accomplished."** No. WAF rule != code fix. Verify the depth.
- **"Don't tell the client we observed their patch."** Yes, do. It's a positive finding about their IR.
- **"Don't include the locked accounts list — they'll think we caused it."** No. Math + journaling discipline proves you didn't. Include the list with the math.

---

## Bridge to neighboring skills

- `redteam-mindset` — broader discipline framework; this skill is a specific application
- `m365-entra-attack` — specific case for M365 / Smart Lockout differential
- `evidence-hygiene` — how to capture and redact PoC evidence properly
- `report-writing` — finding template for IR observations
- `bb-methodology` — note that this skill is INAPPROPRIATE for bug bounty (no real-time IR there)

---

## One-line summary

**Your engagement leaves a footprint. The footprint changes the target. Capture both states. Both are findings.**

---

## Related Skills & Chains

- **`redteam-mindset`** — This skill is a specific application of the broader red-team discipline. Engagement flow: `redteam-mindset` loaded at engagement start → baseline-capture habit built in → when response patterns shift mid-test, `mid-engagement-ir-detection` activates to capture the SOC-patch state as a NEW finding (defensive-action observed = client capability metric, not "the bug got fixed so we lose the finding").
- **`evidence-hygiene`** — Mid-engagement IR detection produces TWO states (pre-patch and post-patch); both need disciplined evidence capture or the second finding can't be defended. Engagement flow: baseline screenshots + timestamped request/response dumps at session start → response shift detected → second capture set with explicit timestamp delta → both packaged together.
- **`m365-entra-attack`** — The single richest source of mid-engagement IR signal in modern engagements. Engagement flow: M365 spray triggers AADSTS50053 lockout → baseline lockout policy captured → if lockout window changes mid-test (e.g., from 60min to 24hr) → `mid-engagement-ir-detection` captures the policy change as a finding ("CA policy hardened mid-engagement; defensive response measured").
- **`enterprise-vpn-attack`** + **`vmware-vcenter-attack`** — Critical-infrastructure CVE exploitation is the highest-noise activity; expect SOC to patch within hours. Engagement flow: confirmed VPN/vCenter CVE → baseline capture BEFORE exploitation attempt → if appliance updates mid-test, capture as defensive-action finding → report both the original CVE AND the IR-response.
- **`redteam-report-template`** — IR-observation findings get their own Subject in the deliverable, framed differently from technical-vuln findings. Engagement flow: `mid-engagement-ir-detection` captures behavior-change event → `triage-validation` 7-Question Gate (specifically: "is the behavior-change attributable to my activity?") → `redteam-report-template` packages as a "client capability observation" with explicit timeline and detection-latency metric.

mid-engagement-ir-detection

Install this skill

Comments