azcomputerguru/claudetools
1
0
Fork 0
Code Issues 59 Pull Requests Actions Packages Projects Releases Wiki Activity

radio: attach caller names to Q&A pairs from transcript intros

Browse Source 
QAPair gets caller_name and caller_role fields populated by a new
attach_caller_names(pairs, transcript_segments) helper. For each pair,
finds the active opening intro at the question_start time (8s forward
tolerance, no backward limit — a caller's call can run for 10+ minutes
and the intro happens once at the start) and attaches the speaker name.

Validation on 9-episode test set:
  19/19 Q&A pairs (100%) now have caller names attached.

Examples of corrections from oracle attribution:
  2018-s10e18 @ 73:36  Christopher (was misattributed to "Tara")
  2015-s7e19 @ 35:45   William     (was misattributed to "Tara")
  2010-05-08-hr1       Jackie x3, Bruce
  2012-03-10-hr1       Adam x2
  2016-s8e43           John, Doug
  2017-s9e30           Tom, Denise x3, Charlie

speaker_oracle.py: adds speaker_at(time, intros) helper used both by the
existing resolve_speakers() and the new caller-name attachment. Also
adds the "let's fit/bring/put X in/on" intro pattern variant (caught
Charlie at 70:21 in 2017-s9e30 that "talk to X" missed).

download_full_archive.py: SSH keepalive every 30s + per-file retry-on-
failure (up to 3 attempts with reconnect). Earlier run hung on a dead
connection at file 109 of 589 with no recovery; restarted run is now
running at ~10 MB/s vs ~2-3 MB/s before.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
Mike Swanson
2026-04-27 16:55:31 -07:00
parent 1b574caba4
commit 488bf5849e
4 changed files with 100 additions and 17 deletions
Download Patch File Download Diff File Expand all files Collapse all files

56
projects/radio-show/audio-processor/download_full_archive.py
View File

@@ -22,12 +22,22 @@ LOCAL_ROOT.mkdir(parents=True, exist_ok=True)
REMOTE_ROOT = "/home/gurushow/public_html/archive"
YEARS = ["2010", "2011", "2012", "2014", "2015", "2016", "2017", "2018"]
def connect():
c = paramiko.SSHClient()
c.set_missing_host_key_policy(paramiko.AutoAddPolicy())
c.connect("172.16.3.10", username="root", password=password,
look_for_keys=False, allow_agent=False,
timeout=30, banner_timeout=30, auth_timeout=30)
transport = c.get_transport()
if transport is not None:
transport.set_keepalive(30) # send keepalive every 30s
s = c.open_sftp()
s.get_channel().settimeout(120) # per-operation timeout
return c, s
print(f"Connecting to 172.16.3.10...", flush=True)
client = paramiko.SSHClient()
client.set_missing_host_key_policy(paramiko.AutoAddPolicy())
client.connect("172.16.3.10", username="root", password=password,
look_for_keys=False, allow_agent=False, timeout=30)
sftp = client.open_sftp()
client, sftp = connect()
print("Connected.", flush=True)
@@ -75,16 +85,32 @@ for year in YEARS:
size_mb = remote_size / 1024 / 1024
print(f" [{downloaded_files + 1:3d}] {rel} ({size_mb:.1f} MB)...", end="", flush=True)
t0 = time.monotonic()
try:
sftp.get(remote, str(local))
elapsed = time.monotonic() - t0
mbps = size_mb / elapsed if elapsed > 0 else 0
print(f" done ({elapsed:.1f}s, {mbps:.1f} MB/s)", flush=True)
downloaded_files += 1
downloaded_bytes += remote_size
except Exception as e:
print(f" FAILED: {e}", flush=True)
errors.append(f"get {remote}: {e}")
attempt = 0
while True:
attempt += 1
try:
sftp.get(remote, str(local))
elapsed = time.monotonic() - t0
mbps = size_mb / elapsed if elapsed > 0 else 0
print(f" done ({elapsed:.1f}s, {mbps:.1f} MB/s)", flush=True)
downloaded_files += 1
downloaded_bytes += remote_size
break
except Exception as e:
if attempt >= 3:
print(f" FAILED after {attempt} attempts: {e}", flush=True)
errors.append(f"get {remote}: {e}")
break
print(f" retry {attempt} ({e})...", end="", flush=True)
# Reconnect on failure
try:
sftp.close()
client.close()
except Exception:
pass
time.sleep(5)
client, sftp = connect()
elapsed_total = time.monotonic() - t_start
print(f"\n=== Summary ===", flush=True)