We fact-checked our own case studies

Our first draft of the Tziyun B’Rega case study said teachers could mark a test with a pen or a pencil. We had only ever proven the pen. So the pencil came out.

That small fix is the whole idea of this story: say only what we can prove.

Key points

• We checked every claim on the case-study pages against the real code and the live sites.
• Wrong or unproven claims were fixed or removed.
• Three claims were changed: the pencil, “no back end” and “every setting is in the web address”.
• Numbers stay only where they were counted, and we use no speed, price or customer numbers.

Why we did it

Our case studies are the part of this site that people rely on most. A visitor reading them is deciding whether to hire us. A claim that is a little too big is a bad way to start.

How we did it

For each of the three projects we read the real code, the project notes and the live site. We wrote down every claim we wanted to make and marked each one: confirmed, wrong, out of date, misleading, could not be checked, or only the owner knows.

Then the person who built the projects read the audit and corrected it wherever we had it wrong. Only after that did we rewrite the case studies from the audits.

What changed

• Tziyun B’Rega. Marks made with a pen are proven, so the text says pen. Pencil is not claimed.
• Shapi-Lumda. An early line said the course had no back end. That was wrong. The course uses Firebase for hosting (keeping the site online), optional accounts and optional cloud sync. The number of lessons, 306 in each language, is counted from the code.
• Kadish Yatom. We had said every setting lives in the web address. That is true for the settings of the sheet, but not for the language and the theme.
• Everywhere. No speed, price or customer numbers.

What we left out

Things we could not prove stayed out. So did a few true things that are not ours to publish.

When you read a fact on our case-study pages, it came from those audits. Where we could not check something, we did not say it.