Mason W.Foley

Fifteen years leading QA. Lately, teaching AI to pull its weight.

Mason W. Foley

About

I've worked in software quality for more than twenty years and led QA teams since 2012, mostly on products people lean on when it counts: law-enforcement data at Thomson Reuters, clinical decision support, and most recently a platform where nurses and other credentialed healthcare providers pick up per diem shifts at hospitals. My last team was up to twelve people across seven countries and nine time zones.

I'm a QA manager who writes code. Most of what's on this site started as a question Jira couldn't answer, so I built the thing that could. AI agents write most of that code now, and I spend my time on the part I'm best at: deciding what it has to prove before I trust it.

Twenty-plus years counts from 2002. QA management roles since July 2012.

Where I've worked

  • ShiftMed2021 to 2026
  • Sharecare2021
  • Oncology Analytics2020 to 2021
  • Thomson Reuters2010 to 2019
  • AT&T2009 to 2010
  • ChoicePoint2006 to 2008

Sprint Intelligence

A scoring system that told me whether a sprint's target release date was still viable, based on every metric it tracked.

Three times a day, morning, early afternoon and evening, it pulled the data from Jira and Xray through seven extractors: story points by status, time in status, test plan progress, defect arrival rate, impact analysis, test coverage and QA activity. It compared each snapshot with the one before, had an AI model write up what changed, and rolled each sprint into a score: green, yellow, orange or red. I used it to tell every team where its sprint stood and to bring evidence to retros instead of impressions.

It ran three times a day for seven months and grew to 21 dashboard pages, about 290 test files and more than 2,100 commits.

Commits counted from git history, February to September 2026. The code stays private; nothing here links to it.

Team Orion 4.1 | Calendar Sync (Partner Integration)

Higher means more trouble. Every rule that fired, and what it added.

94 ptsCritical

RuleFactorDetailPoints
1bLimited runway1.9d left, FCC 69.23%+25
2Defect trend acceleratingtrend 6+15
2bBug load6 bugs in dev+10
4QA throughput blocked16 pts in QIP, no QAC movement+12
5cIA has no test cases (critical tier)1.9d remaining+10
5dDeployment plan (critical tier)Deployment plan not Dev Complete (ORN-412 Code Review), 1.9 business days remaining+10
8Flagged items (silent tier)4 flags+4
10Test failure rate12.5% (2/16)+8

One snapshot of one sprint, with the team, sprint and ticket renamed. Each rule that fired adds its points; the total sets the color.

How a day's data moves

  1. Jira and XrayStories, tests, defects and change history
  2. Seven extractorsOne question each, from points by status to QA activity
  3. Three snapshots a dayMorning, early afternoon and evening, each saved next to the last
  4. AssessmentAn AI write-up of what changed, with its arithmetic checked
  5. Sprint historyA rolling record of every sprint's trajectory
  6. DashboardThe score, the color and the reasons behind them

The real one ran on company data, so the code stays private. The demo here runs on a made-up company's sprints.

Selected work

Six problems, what I did about them, and what changed.

How I build with AI

AI agents write most of my code. I don't take any of it on faith.

Loaded into every agent session

CLAUDE.mdRules I write. Codex reads its counterpart, AGENTS.md.
MEMORY.mdNotes Claude keeps on my coding conventions and test guidance.
  1. Claude and Codexplan and write code

    I work in Claude Code Desktop. It lays out a plan and waits for my approval. Codex works its own branches, and each second-guesses the other.

  2. WebStormread the code

    Where the code lands. I pull what the agents wrote and read it, and when I want to understand how something was built, I step through it in the debugger.

  3. GitNexusmap the blast radius

    Before an edit, the agent reports what depends on the code it's about to change and how risky that is.

    No edit without an impact check
  4. Docker and PostgreSQLrun it locally

    Apps run the same on my machine as anywhere else, database included.

  5. GitHubopen the pull request

    Every change lands through a pull request, with automated checks on each one.

    Scope check before commit, CI before merge
  6. CodeRabbitreviews the PR

    An AI reviewer posts a walkthrough with a sequence diagram of the changed flow, then line-level comments.

  7. Unit Test Skilltests from the diagram

    A skill I wrote reads that diagram like an adversarial test designer and writes the spec and the tests.

    New and existing tests pass before a push
  8. Review skillclose every comment

    A second skill works each review comment: fix it or decline it with a reason, and fix the root cause too.

    Every comment gets a posted reply
  9. Netlifypreview, then ship

    Each pull request gets its own preview link. Merging publishes to production.

When review turns up a root cause, the fix goes back into CLAUDE.md, MEMORY.md or a skill, so the next change starts from better rules.

Across seven repos that's 454 merged pull requests, roughly 5,600 automated tests and 35 diagram-driven test specs.

On one CSV import, a four-arrow diagram became 79 tests that found nine bugs already in the code. All nine were fixed in the same pull request.

This site is built the same way.

Counted from git history and test files on October 8, 2026. Two-thirds of non-merge commits in the four main repos carry an AI co-author line.

Projects on this route

  • Sprint IntelligenceScores whether each sprint is on track to release on time.
  • Release calendarCalendar, roadmap and Gantt views for leadership release reviews, with role-based access.
  • Nonprofit portalWebsite and volunteer portal for a disaster-relief nonprofit.
  • Billing-week simulatorShows where payroll and billing weeks fall out of line and what overtime can't be billed.

What people say

When there's an issue, you're not racing the clock, you're racing Mason, who is already deep into discovery and probably has a solution.

Megan Puckett, Senior Product Manager

He never made the team feel blamed when bugs slipped through and proactively worked to find out why they did and immediately implemented mitigation strategies.

Matthew Abbott, Product Leader

He has elevated my understanding of what Quality Assurance is about, encouraging me to think outside the box, think bigger and deeper.

Nadiia Diachok, QA Engineer

And as any QA leader should, he stayed curious.

William Yarrington, Senior QA

He took ownership of quality and made sure every release was handled with care and attention to detail.

Carolina Spengler, QA Engineer

A strong QA leader and an even better people manager.

Betty Umana, Senior QA Manual Engineer

How I lead

  • Measure before you automate.The AI plan started with a time study, not a tool.
  • AI assists, people decide.Nothing signs off a release automatically.
  • A bug report carries its own evidence.Steps, environment, expected and actual results, and the linked test and acceptance criteria.
  • Ask questions in the team channel.A quiet engineering channel is a warning sign, not a good one.
  • Treat a metric like a product.Define the rule, test it, and re-check old data when the rule changes.
  • When a bug gets out, find out why. Not who.Then change the process so it can't get out the same way twice.

Off the clock

A ruby-throated hummingbird perched on a thorny stem beside an orange lantana bloom, the background a soft green blur.A black and white photograph of a symmetrical staircase in a concrete parking deck, lit from above, with a round sign reading 5 at the top.The lead singer of Molchat Doma silhouetted on stage at The Eastern in Atlanta, in black and white, arms out, with beams of light fanning through haze across the stage.

Photography

Most of these came out of a Canon EOS R5 and got finished in Lightroom. A couple are iPhone shots I didn't want to miss. Nothing here is stock.

Mason and his hiking partner under a ring of timber on a stone cairn beside the Great Glen Way, with hills and pine forest behind them.

Hiking

Mostly around Atlanta, with trips to the Smokies and the North Georgia mountains, and a week on the Great Glen Way in Scotland this past June. The camera comes along.

A storm-damaged room mid-repair, in black and white: the ceiling open to the rafters, a wall cut away to a bare opening onto the neighbor's garage, a stepladder and tools on a dust sheet.

Disaster response

I volunteer with D.A.R.E. on disaster response, and I built and maintain its website and volunteer portal, with sign-in, coordinator approvals and a photo inbox.

Visit whofixedtheroof.com

Mason's home studio: an ultrawide monitor running Adobe Premiere Pro with drone footage of green farmland on screen, above a MIDI keyboard lit blue.

The home studio

I compose cinematic cues in here: ambience and underscoring.

Get in touch

I'm looking for QA, delivery and AI leadership roles, remote or in Atlanta. LinkedIn is the fastest way to reach me.