📓 How we built it

Methods log

Every change to how bignews.day collects or measures things, dated, newest first, including what we tried that didn't work and the mistakes we caught. A chart or a number that crosses one of these dates should be read with the change in mind. How each measure works today is on How it works; this is how it got that way. Scores in our data carry the model and rubric that made them from Oct 3, 2026 on.

📰 Whose front pages count

bignews.day reads front pages every hour, but only a select group counts toward its stories: every US outlet, plus a short list of outlets from abroad, each there for a reason: Al Jazeera, BBC, Daily Mail, Financial Times, Reuters, The Economist and The Independent. In all, 113 front pages are the whole foundation of every story, saga and front-page count on the site. BBC, Financial Times, Reuters, The Economist and The Independent are there because, when the site's maker studied the 2024 US election coverage, their front pages covered the same stories as American ones, while every other foreign outlet's front page ran a different set of stories altogether. Al Jazeera is there because Americans share its links widely. The Daily Mail is there because its US edition is among the most-read news sites in America.

The site also reads 146 other outlets in 77 countries, other British papers among them (translating those not in English), but they never count toward a story: their front pages appear on The World page and on their own outlet pages. Aggregators such as Drudge Report, Google News, Political Wire and Real Clear Politics are read as well; because they link to other outlets' stories rather than running their own, they are matched to the stories they link and never counted as a front page.

🕰️ The aisle clock, last 30 days: 1,147 stories reached the front pages of both sides, a median 3 hours apart. Left first 45% of the time, right first 30%, within the hour 25%.

📰 the 113 front pages that count

🌍 From abroad: Al Jazeera · BBC · Daily Mail · Financial Times · Reuters · The Economist · The Independent

🇺🇸 American: ABC News · Alternet · American Thinker · AP · Axios · Bloomberg · Breitbart · Business Insider · CBS News · Chicago Tribune · CNBC · CNN · Compact · Crooks and Liars · Current Affairs · Forbes · Foreign Affairs · Foreign Policy · Fortune · Fox Business · Fox News · HuffPost · Independent Journal Review · Jacobin · Just the News · Los Angeles Times · MarketWatch · Mediaite · Military.com · Mother Jones · MSNBC · National Review · NBC News · New York Magazine · New York Post · New York Times · New Yorker · News Nation · Newsmax · Newsweek · NPR · One America News Network · PBS NewsHour · PJ Media · Politico · ProPublica · Puck · Punchbowl News · Quillette · Radio Free Europe Radio Liberty · Raw Story · Reason · Red State · Rolling Stone · Salon · Scripps News · Semafor · Slate · Star Tribune · Talking Points Memo · Tampa Bay Times · The 19th · The American Conservative · The American Prospect · The American Spectator · The Atlantic · The Blaze · The Bulwark · The Christian Science Monitor · The Daily Beast · The Daily Caller · The Daily Kos · The Daily Signal · The Daily Wire · The Dispatch · The Epoch Times · The Federalist · The Free Press · The Gateway Pundit · The Guardian · The Hill · The Intercept · The Lever · The Nation · The National Desk · The National Pulse · The New Republic · The Post Millennial · The Sun · The Wall Street Journal · The Washington Free Beacon · The Washington Post · The Washington Sun · The Washington Times · The Week · The Western Journal · Time · Townhall · USA Today · Vanity Fair · Voice of America · Vox · Washington Examiner · Washington Reporter · Yahoo News · Zeteo

Read for The World page only: 146 outlets in 77 countries, from Britain Sky News · The Telegraph · UnHerd

🗓️ Every hour, on the record

Each hour our run reads every outlet's front page. Since Oct 2, 1,179 of 1,200 hourly runs landed; since Oct 29, 99.5% of the outlets each run tried came back with headlines. No hour missed since Nov 20, 4 PM.

October 2026

12 AM6 AMnoon6 PM28152229

November 2026

12 AM6 AMnoon6 PM1815

A column a day and a row an hour, midnight at the top, Eastern time. The darker the green, the more of the outlets that hour's run read: the darkest read every one, the next all but one in a hundred, the next all but one in twenty. Grey is a run from before Oct 29, when we began keeping each outlet's result. An empty square is an hour with no run: Oct 2, 6 PM to Oct 3, 7 AM; Oct 3, 9 AM; Oct 5, 4 AM to 6 AM; Nov 1, 12 AM; Nov 1, 1 AM (the second, after the clocks went back); Nov 20, 4 PM.

🎨 The part of the site each change touches (tap to show only those):

🏷️ What kind of change: a mistake caught 13 · tried, not kept 10 · new 39 · changed 213

How the parts and kinds are read

Both are read from each entry's first line by simple rules, not written by hand: the part of the site is the first one its line names (a story, a show, a motif…), or, if it names none, its next sentence; the kind comes from words like "no longer" or "fix" (🐛), "dropped" or "tried" (🗑️) and "new" or "begins" (🆕), and anything else is 🔧 changed. So a few will be filed oddly; the text is the log's own.

Changes logged each day, Oct 2 to Nov 21, 2026, oldest at the left. Tap a bar to jump to that day, or read how it ran before the log began.

🗓️ Nov 21

  1. 🧩🔧Talk against print, on the folklore page

    Two boards from In print's matching (a motif's name or tellers' words in front-page headlines, whole words, US outlets and the six British): "Crossed into print this week", the shapes whose words were in the most headlines in the last 7 days (2 or more), each with its all-time split by the outlets' lean and a mark when its first headline came this week; and "Told on air, barely in print", the shapes told on 6 or more shows whose words fewer than 3 headlines ever used. A headline using the words counts whatever it says about them. Fable's data ideas, #2.

  2. 🛠️🔧The Same Old Cry: a phrase book of 1896 and now

    (phrasebook.html). Each public motif's name and tellers' words, and 20 words of 1896 politics, looked up once in the 413,187 articles of 1896 in our Chronicling America copy (the articles printing the phrase exactly, by the full-text index), with up to three clippings as printed (search hits, not checked), beside the front-page headlines using it in the last 6 months. Counts are floors (OCR misses), and a phrase can mean something else. Looked up by a processing step, 120 seconds a run, kept in phrase_1896. Fable's data ideas, #4.

  3. 🧩🔧"How the season is being told" replaces "Told a lot, never checked"

    The folklore page's first board is now the story shapes told most on the shows and online, checked or not (genre Perennials aside, as before), each row saying how many of its claims fact-checkers examined. The board it replaces was a lead list for fact-checkers, and the checkable reading added this morning (below) only trimmed it: the most-told shapes are theories of the world and readings of events ("Political party surge", "Unpopular war"), the person: "the kinds of things for political scientists and historians not fact checkers". The readings stay in motif_checkable, no longer shown.

  4. 🧩🔧"Told a lot, never checked" leaves out what no one could check

    The folklore page's board of the motifs told most and never examined by a fact-checker was led by punditry ("Political party surge", "Enthusiasm gap"). Each of the 157 Plot, Theory and Belief motifs told 10 or more times and never checked was read once, by Claude (Sonnet readers, every claim and the note): checkable (most claims assert specific facts: an act, a number, what someone said, what a document says) 20, mixed 110, not 27. The board now leaves out the 27, keeps any motif not read yet, and quotes up to two checkable claims in each row's tip, as the site already shows them. Readings in motif_checkable (app/analysis/checkable.py). Fable's data ideas, #12.

  5. 🧩🔧First heard, on each motif page

    The first day each of our records holds one of the motif's claims, earliest first: a show (its episode's date, the show named), a post in our online sample, a fact-check (the checker named), a voter in The Focus Group, and a front-page headline using its name or tellers' words (In print's first). It shows only when two or more records have the motif. Our records begin on different days (shows Oct 2, posts Oct 5, fact-checks Sep 8, The Focus Group Jul 18, in the index as it stands), so a "first" near a record's start may only mean the record began then; each day says on hover when its record begins. The order is stated, never a cause. 912 of 1,782 motif pages have one.

  6. 📰🔧One front page, or many? A second line on the Over time page's newsiness chart

    One point a day: the share of outlets whose top three places (where a headline sat when we first saw it: places 0, 1 and 2, 0 the top of the page) held that day's most-shared story. The day's story is the one the most outlets had a headline on, headlines first seen that Eastern day; ties go to the older story. The denominator is every outlet with a news headline first seen that day. Outlets are the ones stories count (US ones, aggregators aside, plus the foreign ones in Config.exempted_foreign_media: the British six, Daily Mail and Al Jazeera); Google News stand-ins have no front-page place and are left out. Whole days only, so the day still going has no point. Newsiness counts an outlet that carries a story anywhere; this counts one that led with it. On the lab copy (50 days): median day 20% (Fable's proof figures said 24%); Nov 4, 67 of 108 outlets (Fable: 72 of 105, which a four-place top, places 0 to 3, reproduces; ours is the strict top three); Nov 14, 33 of 87 (Fable: 55%; ours 38%). Computed in one pass over the headlines each build (about 1.5 s), not kept per day.

  7. 🗞️🔧Each channel's diet, on the TV page

    A new section lists the stories most uneven between channels over the 30 days of captions up to the newest one we hold (the feed runs about two days behind, and the section says how far). For each channel, a story's share is its caption seconds divided by all the caption seconds read on that channel in the window, matched to a story or not, so MSNOW (58 hours of captions against CNN's 271) is not drowned out. A story is compared on a pair of channels only with 5 minutes or more on the two together; the ranking is the gap in share. CNN against Fox News shows the top 5 each way; the other five pairs show their single most uneven story each way. The stories are the ones the TV page already matches captions to (including merged stories); the figures are shares, not minutes, and say nothing about why a channel gave a story more or less time. Story links appear where a story has a page. Of the 30 days: CNN 9.7% against Fox 4.7% on the FAA ground stop, 3.9% against 0.1% on the Ramaswamy ad story; Fox 1.2% against CNN 0.1% on the Daytona Beach rally.

🗓️ Nov 20

  1. 🏢🔧An outlet's headline is its own, even when another outlet ran the same words

    Until now a headline was looked up by its wording across every outlet, so when a second outlet ran a wire headline word for word, the scrape only refreshed the first outlet's row: the second outlet's front-page appearance was never recorded, and stories carried by wire copy counted fewer front pages than they had. From the Nov 20 evening runs each outlet's headline is matched only against that outlet's own. Counts before this date are not recomputed, so a story carried by wire copy can show a rise in front pages at the change that is the counting, not the news.

  2. 🏢🔧Each outlet's front page is now kept in order, every run

    A headline's place on the page was kept only at its first sighting, so how it rose and fell was lost each hour. From the Nov 20 evening runs, every read keeps the page's headlines in order (front_page_order). Placement before then is known only at each headline's first sighting.

  3. 🧩🔧The aisle clock: how long a story took to cross to the other side's front pages

    Every story page with outlets on both sides (or only one) gets a line, and the methods page a 30-day figure. Each side's time is its earliest outlet's first sighting of a headline on the story. Left and right are the site's own buckets (rated left or leaning left, rated right or leaning right, as the stickers' left · center · right count them); center and unrated outlets are neither side. Google News stand-ins and aggregators are no front page. Scrape timing makes "first" fuzzy, so a gap under an hour reads "within the hour" and never names a side that led; a longer gap names the side that was first, plainly. Of 1,160 stories first seen in the last 30 days that reached both sides: median 3 hours apart, left first 45%, right first 30%, within the hour 25%.

  4. 📰🐛Google News stand-ins no longer count as front pages

    When Reuters' own page fails the scraper reads Reuters through Google News, and those headlines (about half of Reuters' headlines, 332 of 658 articles in 3 days) carry Google's link and Google's recency order, not Reuters' front page. They stay in their story, since the headline is real Reuters copy, but an outlet whose only headlines on a story are stand-ins is no longer counted as carrying it: not in "now", "over its life" or "at its peak", the story chart's lanes, a saga's outlet count, or the hourly outlet snapshot behind the wire's "FRONT PAGES: 0 → N" and the "Spreading" push. Of the 178 stories seen in the last day, 23 lose from 1 to 3 outlets over their life (29 in all; the Senate Democrats leadership story goes from 61 to 58). Snapshots already saved keep their old counts, so a chart or trend line that crosses today may step down.

  5. 🏢🔧The World page counts the US outlets on a story now, and ranks by that

    The arrivals board's "N US" pill counted every US outlet that ever ran a story (one story: 51, against 32 on its story page), and the board was ranked by the hourly snapshot's outlet count, which counts the whole hourly cluster, and a cluster overruns its story under the headline vote (Trump, Xi and Putin: 63 against 41 in the story). Now the pill counts US outlets (aggregators aside) with a headline on a front page in the last 20 minutes, and the board is ranked by that count. The world groups' "N US OUTLETS" stamp matches a group's headlines to the US ones at the nearest member instead of the group's mean (a mean of translations fell under the 0.70 line: Villepin showed 0 with Bloomberg on it), and the drawer's "foreign papers" counts those that ran the story in the last 24 hours. Earlier builds of the page are not recomputed.

  6. 🗞️🔧Bulletins and FLASHes age a story from when its coverage began

    The wire's "FRONT PAGES: 0 → N IN H HOURS", and whether a story is young enough to draft at all, counted from the story row's creation (and its split parents'), but stories are often born late from older coverage. Of 20 bulletin drafts, 9 were on stories whose first headline was 11 to 64 hours older than the row; one read "0 → 30 IN 9 HOURS" with 33 outlets already on it, the first 64 hours earlier. Now the age counts from the story's coverage: each outlet's first sighting, and the break (the first, unless one or two outlets had it alone for 6 hours or more), as the XTREME badge counts it. The FIRST line names the outlet that had it at that break, so the two lines agree. Of the 9, 3 would still draft (at 9, 9 and 7 hours) and 6 would not (1932, 2011, 2150 and 1957 are 14 to 64 hours old by their coverage; 2141 and 2100 are old by their split chain).

  7. 🧩🔧The Shape Exchange reports no percent change off a base week that was still filling

    The Nov 1 Sunday edition said claims filed under story shapes "rose 1180 percent", from 128 to 1,639, because the week before held under a tenth of this week's claims while the index was still being filled. Now when last week's volume is under a quarter of this week's, no percent is given (the motifs page drops its arrow and the Sunday piece leads with the biggest advancer); a threefold rise still counts. Changes before this date were not recomputed.

  8. 📰🐛Two fixes to the vote that places each new headline in a story

    From 18:00 to 22:00 UTC on Nov 20, 25 of 46 new stories had 2 headlines or fewer, and one hourly run made 14 of 21, because a cluster's unvoted headlines each started a story of their own. Now a cluster's unvoted headlines start a story only when they come from 3 outlets or more; fewer are left in no story for that hour and voted again at the next run, when more of their development has usually arrived. Replaying Nov 7 to 19 hour by hour, new stories of 1 or 2 headlines went from 62% of new stories to none; the score on the hand key of seven big affairs went from 0.597 to 0.601, on October's key of 15 single events from 0.733 to 0.737; stories meeting the site's katamari alert went from 2 to 3; the share of keyed headlines in no story rose from 12% to 14%. Putting the stragglers into their cluster's main story instead brought back long mixed stories, 2 to 9 over the katamari line. And when the embedding model is unavailable, the old method runs instead of the vote; it still carried the "outlet split" retired when the vote went live, so the split quietly came back. It now runs without it.

  9. 📰🆕New headlines need closer neighbours to join a story

    From the 15:00 run the vote that places each new headline counts a neighbour only at a likeness of 0.72, up from 0.68 at 13:00. Tested on thirty settings of the vote over the week of November 13-19, it left 2 lumped stories of seven against 7, with more of each story's headlines about one happening (62% against 48%); on October's stories it scored 0.733 against 0.770, within the limit we set for a change. Requiring two or three neighbours to agree did not help. Expect a few more, smaller stories, and an occasional story split in two.

  10. 🧩🔧The motif filer reads a claim in its own time

    From the 15:00 run, when the motif filer compares a claim with the motifs, its prompt gives it the date the claim was told, not the day of filing, so a claim filed or refiled late is read in its own time, and words like "next week" or "this year" mean what they meant then. A claim with no date still gets the day of filing.

  11. 🗞️🔧Sagas merge when the judge sees one continuing affair, and old "no"s are re-asked

    From the 14:00 run, every six hours a pass looks at the live sagas and merges two when the saga judge says their cores are one continuing affair, and asks again any "no" between stories that have grown since. It never splits a saga and never merges two threads of the same arc. Each pass judges for at most three minutes, so the first backlog (64 pairs of sagas and 152 earlier "no"s) clears over about three passes, roughly 18 hours; answers are kept between passes. Tested on a replay of the live sagas, merges and re-asks made 18 right joins and 2 wrong ones, with 10 loose but defensible; re-asks alone 9 right, 5 wrong (the wrong ones are pairs the answer key itself disputes), 5 loose. A version that also split sagas was dropped: 7 right splits against 36 wrong. Each merge is written to the run's log with both sagas' names and the judge's reason. Expect fewer sagas for the same affair, and saga pages that gather an affair's stories in one place.

  12. 📰🆕Each new headline now joins the story its most similar earlier headlines point to, instead of the story its hour's cluster carries on

    Until now a whole cluster of headlines grouped by meaning in an hour carried on whichever saved story already held most of its headlines, so small new developments that clustered with old coverage were pulled into the old story, creating "katamari" stories that piled every new development into one. An "outlet split", live since November 19, cut some of them but fired again and again on one live event; under the new method it no longer runs. Now each new headline joins the story that wins a vote of its five most similar headlines already in a story, first seen within the 72 hours around it, each neighbour's similarity reduced by 0.066 times the natural log of one plus the hours between them, and voting only if that reaches 0.68. Headlines in an hour's cluster that no neighbour votes for start one new story together, so a new development can start its own story beside the old one. A headline already in a story stays there. No language model is asked. When the embedding model is unavailable, the old method runs instead. The change was tested by replaying November 7 to 19 hour by hour (332 runs) against a hand key of seven big affairs (Nvidia's chief, the FAA ground stop, the summit, markets, measles, Van Hollen, Iran) sorted into 186 developments by two blind readers: the score that rewards putting each development in one story and nothing else with it rose from 0.510 under the previous method to 0.596. On the two affairs held out of all tuning, the FAA rose from 0.412 to 0.481 and Iran from 0.620 to 0.858. On October's separate key of 15 single events it rose from 0.750 to 0.770. Weaknesses found in the same test: stories hold more than one development more often on the three biggest affairs (Nvidia, the FAA, the summit), and 7 stories still meet the site's katamari alert (10 or more outlets, more than 2 articles an outlet, over 3 days) where the previous method, replayed, left 3; Nvidia's largest story keeps 1,019 headlines. A stricter setting (0.72) left 2 such stories and scored 0.613 but lost a little on October (0.733). Stories already made are not re-sorted. Expect more, smaller stories for each running affair and fewer stories that run for days under a moving title; a story card can show a few headlines that were placed in a sibling story.

  13. 🏢🔧The list of outlets that count toward a story adds two names

    From the 11:00 run the list adds the Daily Mail (its US edition is among the most-read news sites in America) and Al Jazeera (Americans share its links widely). The rule is now: a US outlet, or any outlet on the list, whatever its country. Until now the list was six British outlets (The Economist, BBC, The Guardian, Financial Times, Reuters and The Independent; The Guardian's US edition already counted as a US outlet), chosen during the site owner's 2024 US-election research because their front pages read like American news. 113 front pages now count (106 US, 7 from abroad). About 146 other outlets in 77 countries are still read and translated for The World page but never count toward a story. Expect "on N front pages" counts to rise by up to two, and Daily Mail and Al Jazeera headlines to appear in stories. The Methods page now opens with a section listing every outlet that counts, and each outlet's page carries a mark saying whether it counts.

  14. 🗞️🆕The saga judge asks a new wording

    From the 12:00 run the saga judge (Gemma 4 26B, which decides whether two stories are parts of one continuing affair) asks a new wording, drafted by DeepSeek V4 Pro under the site's rule: a saga is one continuing affair (a case, scandal, war, trial, negotiation, disaster or election); reactions and follow-up acts belong in it; stories that only share a person, place, company or broad topic do not. The wording is a short checklist: name each story's affair, then decide. Tested on 368 keyed story pairs (195 that should join, 173 that should not), each asked in both orders: it missed 27 and 32 of the real joins (one count per order) against 57 and 48 for the judge it replaces. Two blind readers sorted every join it made that the key calls wrong: none was plainly the judge's fault; they were pairs the key itself disputes or that could go either way. The judge it replaces made 3 to 6 plainly wrong joins across unrelated affairs. Its answer flipped with the order of the two stories 14% of the time, against 16%. Verdicts already given stand; only new pairs of stories are asked under the new wording. Expect fewer sagas split across the same affair (this morning one affair, the Nvidia chief's scandal, sat in three sagas).

🗓️ Nov 19

  1. 🗞️🔧Stories split when the papers move on

    From the 08:00 run a story stops taking a cluster's new headlines when three or more outlets that already have an article in it put up a second, different article, and the story model (Gemma 4 26B) agrees the new headlines are a new development: they start a story of their own, and the saga layer links the two. Until now a story on the front pages for days took each day's news as more of itself (the Nvidia story held 929 headlines from 78 outlets over ten days, twelve articles an outlet). Replayed over October, the rule left none of the 9 such stories (10+ outlets, more than two articles an outlet; at most 1.8 articles an outlet, against 4.2), and the stories matched the hand-built answer key better (event F 0.750 against 0.713: precision 0.777 against 0.657, recall 0.736 against 0.843). Expect more, shorter stories, each closer to one event, and more of them joined in sagas. Stories before today keep their headlines until a rebuild. The Lab's Golden Goose entry has the test.

  2. 🧩🆕A new judge for cutting a story in two

    When an hour's group of headlines falls into two halves that barely share words, the cut is now confirmed by Nimble 9B (a decision model, the one that already scores filings), asked in a reworded prompt, instead of Gemma 4 26B asked twice. On the held-back half of the stories answer key it made 45 right cuts and 7 wrong, against 41 and 12 (from the 07:00 run).

  3. 🗞️🔧The saga judge asks once, in a reworded prompt

    Whether two stories are one running story is now asked once in a prompt drafted by DeepSeek V4 Pro, instead of twice in two wordings that both had to say yes: 46 right joins and 1 wrong on the answer key's held-back pairs, against 42 and 1. Verdicts given before stand; only new pairs go to the new prompt (from the 07:00 run; the old verdicts were kept from the 08:00 run, after the 07:00 run spent its time asking them all again). Correction, the same day: an outside review found the prompt was chosen on the held-back pairs alone. On the other half it made 5 wrong joins against the old judge's 2, 6 against 3 over all 250 pairs, and the prompt leans toward joining when unsure ("lean toward calling it one running story"), so it is not the balanced wording first described here. Tested on a fresh set of 180 story pairs read blind, it made 13 wrong joins of 96 against the old judge's 8, with the same 70 right joins of 84. From the 12:00 run the judge asks the same wording without that leaning sentence: 3 wrong joins of 96, 64 right of 84. It misses some joins where two stories take different angles on one affair (a reaction, a market move, an accusation and the investigation of it), so it stands until the prompt is retuned; this morning's verdicts are asked again under it, the old judge's earlier ones stand.

  4. 🗞️🔧Story titles, saga names and translations reworded

    The prompts for story titles and saga names (the same rules, plainer wording, drafted by DeepSeek V4 Pro) were preferred in blind reads (titles best 29 times in 80 against 25; names 23 in 58 against 18, flagged wrong 2 against 4). Saga names are written again under the new prompt, ten sagas a run, newest first. The translation prompt's rewording was picked best in 58 of 120 reads against 33, with half the errors (the old one once turned yen into dollars); translations already made stay as they are (from the 07:00 run).

  5. 🧩🔧The filing confidence question reworded

    The yes/no question the decision model answers for each motif filing was reworded (AUC 0.796 against 0.780 on all 16,175 decided filings; 0.915 against 0.905 on the person's own). Every filing's score is asked again under the new question over the next runs; the confidence model keeps its weights until all of the decided filings have new scores.

  6. 🗞️🔧Arcs' threads drawn tighter

    Stories are put in an arc's threads by a reworded prompt that puts fewer stories in a wrong thread and leaves more in none (precision 0.890 against 0.714 on the thread key; recall lower). Arcs are drawn again a week after they last were, so the change reaches them over the week.

  7. 🏢🔧Reuters' newsletter cards left out

    From Nov 17 some cards on Reuters' page that link nowhere ("#") were saved as one article holding 44 headlines from 10 stories; they are no longer read (from the 08:00 run). Chosun Ilbo no longer brings in its Japanese, English and Chinese editions, which repeated its Korean stories (30% of its feed).

🗓️ Nov 18

  1. 📰🔧The headline judge on a faster server, then without the outlet's name

    From the 17:00 run the same judge (Qwen3.5 9B, the same weights) runs on llama.cpp's own server instead of Ollama: about 155 headlines a minute against Ollama's 126 on the same 200 recent headlines. Its news call matched Ollama's on 199 of 200, and its mood exactly on 84 to 87%. Ollama run twice agrees with itself on mood 97% of the time, so serving the same weights another way does move mood on about one headline in seven; which of the two is closer to a careful reader is being checked against the 119 hand-checked headlines. Its scores say qwen3.5:9b llama.cpp rubric:78d6c6b2; Ollama still judges if the server fails. From the 18:00 run the rubric also changed (a655608f): the judge no longer sees which outlet ran the headline, since knowing the outlet can lean its reading of the words, and the outlets are what the site compares. The rubric is otherwise word for word the same. The outlet's name was its first line, so the server re-read the whole rubric for every headline; without it the rubric is read once, and judging runs at about 230 a minute. With the name moved beside the headline (tested, not used), 11 of 200 news calls changed, 8 of them from not news to news (a fair's free concerts, a train promotion, an opinion column), so expect slightly more headlines counted as news. Headlines judged before keep their scores until a rescore; scored_by says which rubric made each. The Lab's Atalanta entry has every setting tried.

🗓️ Nov 15

  1. 🧩🆕A new judge for the headlines

    Each headline's mood (how it presents its news, good or bad), spice (how loaded the outlet's own wording is) and feelings now come from Qwen3.5 9B, not Qwen3 8B, with a revised rubric. A blind hand check of 40 headlines found two biases: plainly reported good news was scored neutral (a medal, a win, a recovery), and plain reporting words ("blames", "casts doubt") were scored as loaded. On the old model a rubric saying both fixed only the second: it still called 2 of 120 headlines good news. On the new model, tested against 119 hand-checked headlines as it runs here, the good-news sentence made mood worse (74 agreed, against 82 without it), because the new model already sees plain good news; the spice fix helped (91 against 83). So the rubric kept (78d6c6b2) has the old mood wording and the new spice wording: 83 of 119 on mood, 87 on spice. On the first 59 of those, where the old judge was also tested, it agrees 42 times on mood (the old judge 34) and 44 on spice (43); its feelings come through on every headline. It calls 16% of a week's news good news (the hand labels: 20%; the old judge 2%). Expect more headlines read as good news, a little less spice, and feelings shifted a little. Headlines scored before today keep the old judge's scores until they are rescored; charts across today should be read with that in mind. Each headline's scored_by names the judge and rubric (qwen3.5:9b rubric:78d6c6b2). The site's other quick jobs (story titles, saga names, names in the news, the Court page's tags) stay on Qwen3 8B. The Lab's Rhadamanthus entry has the comparison of six judges.

🗓️ Nov 14

  1. 🎙️🗑️HasanAbi's podcast feed retired

    Its feed has answered "not found" since its November 3 episode, and Apple's podcast directory still lists only that address. Hasan Piker's YouTube channel, which we also read, carries him; the podcast's past episodes stay.

  2. 📰🔧Politico through Google News

    From late on November 13 Politico's front page put our reader behind a "checking your browser" challenge, which we never solve. Its stories now come through Google News's listing of it (about 50 to 65 a day, in Google's order), as The Hill's, AP's and OAN's do.

🗓️ Nov 13

  1. 🗞️🆕When a story broke, and what's new

    A story's start is now when it broke, not a lone early headline: if the first one or two outlets had it alone for six hours or more before the rest came, it starts with the rest. This sets its break speed (XTREME), its NEW! badge and the card's clock, and the XTREME line itself (the fastest 5% of every story's break), which rose from 11 outlets in the first hour to 12. A card's age also counts from its first headline's sighting, not from when its article's address was first seen (a live blog's one address made the FAA's 5 PM ground stop ten hours old). NEW! lasts three hours (three hourly runs; it was two). The front-page banner leads with a story breaking now (new, and fast or not) over the biggest, saying "Breaking"; the newsiness score still comes from the biggest story. More live-blog addresses are recognised, so their running headlines don't count as rewrites on the headline-changes page.

  2. 📰🔧How we read sites, again

    Headlines are public, short and factual, and we read nothing else, so a site that turns away a reader that names itself no longer stops us: we read its front page as a browser would. We still never read articles, never sign in, never get past a paywall, and never solve a challenge page (a captcha or a "checking your browser" wall); a site behind one is read through Google News's listing of it, as The Hill, AP, Reuters and OAN are. Each front page is still read once an hour. This replaces the November 12 rule that a site that blocked our reader wasn't pushed past.

  3. 📰🔧Politico from its front page; Straight Arrow News closed

    Politico was read from its politics-news feed, whose items spanned days: about 100 headlines in four weeks, too few to place it on the outlet map. It's now read from its front page (about 60 headlines, in its own order). Straight Arrow News shut down on November 6; its feed now redirects to a farewell page. We've stopped reading it, and its past headlines stay.

  4. 🛠️🔧The code is private again

    The repository is no longer public and the site no longer links to it. Versions published before today stay under the GNU AGPL v3 they were released under. The methods log stays CC BY 4.0, and the Lab still says what each experiment tried and found.

  5. 🗞️🔧Threads

    Each arc's stories are named into threads once a week by the local model: one turn of the affair each (a front, a negotiation, a race), with a sentence saying what belongs. New stories join a thread hourly in between, and two threads are never merged by the hourly judge. Clotho tested it: it beat the old sagas on all four test sets but missed its precision bar, so some threads still hold more than one turn. A saga's pieces are now called its stories, not its parts: they are rarely in sequence.

🗓️ Nov 12

  1. 🏢🔧How we read sites

    One policy for every outlet. Each hourly run reads each outlet's public front page once, for its headlines and links: what any visitor sees, never an article behind a paywall, never a login. A site that answers with a bot check or a block isn't pushed past: its headlines come from its own feeds or from Google News's listing of it, or we stop reading it. Fact-checks' own pages are read at most one every 20 seconds per site, with robots.txt obeyed. Some outlets' terms of use forbid automated reading; we read only their public headlines, to count and compare what's covered, and link to the outlet for everything else.

  2. 🧩🔧Who checks the motif index

    Nothing a model files is shown until it's been checked. The person who runs the site did all the checking until November; since then Claude (Anthropic's AI model) has done most of it, reading each claim with its sources, and the person spot-checks a random sample of Claude's calls every week. Pages that said a person checks every motif now say so.

  3. 🗞️🔧Arcs: the affairs above the sagas

    A saga is one turn of a story (the talks, a front, a race); an arc is the affair it belongs to (the US-Iran war, the 2026 midterms, the Russia-Ukraine war), with a page of its own. Each new or grown saga is placed in an arc, or none, by gemma4:26b, shown the arcs' notes and the saga's story titles; Claude's placements are never asked again. Before it went on it was tested against blind readings of every saga, on this autumn's and on July 2024's: 92.5% and 98.6% placed right, and 90.0% and 96.3% of the sagas it put in an arc rightly there. At most 25 sagas are placed a run.

  4. 🧩🔧Every claim says who told it

    On motif pages each claim now ends with its tellers ("said on 2 shows", "told by people online", "a claim Snopes checked"), so a claim read on its own never reads as the site's own statement.

🗓️ Nov 7

  1. 🧩🔧Withdrawn claims stay out

    Withdrawing a claim (an ad, reply spam) took it out of the index but kept no record, so the next filing pass filed it again from the same show or thread: one PAC ad was withdrawn seven times from Nov 1 to Nov 7. A withdrawal is now recorded with its reason, and new claims are screened against the record: the same words (lowercased, punctuation stripped) or mxbai cosine 0.97 or more, which on the index is one sentence with trivial changes. Each skip is logged. A withdrawal stands only while its claim is out of the index, so filing it again lifts it. The 127 earlier withdrawals that still stand were read back from the curation log.

  2. 🧩🔧The reranker went untaught for a month

    The weekly teaching of Qwen3-Reranker-0.6B (one of the filing confidence model's signals) ran as a child of the worker, and was killed whenever the worker exited. None finished after Oct 8, so from then to Nov 7 the confidence model used layers taught on 753 of the person's decisions, while 11,006 have been made. It now runs as a service of its own. The first new teaching began Nov 7, and as before is kept only if it beats the untaught reranker held out.

🗓️ Nov 6

  1. 🧩🔧A recent check follows its claim through rewordings

    The second look skips filings checked in the last 30 days, found by the claim's wording, so a claim reworded after its check came back as doubted. A rewording now carries the check to the new words.

🗓️ Nov 5

  1. 🛠️🔧The news over time

    A page of charts across the whole record: every headline (314k) laid out by meaning (t-SNE on a sample, the rest placed by their nearest neighbours, colored by eight rough topics or by day, laid out again weekly from the old positions), newsiness with its spikes named, daily claims for the motifs with the biggest week (public motifs only), each day's emotion shares, and the longest sagas' lifelines.

  2. 📰🔧The news-day sticker shows its number

    It said "just another news day" with the top story on 86% of outlets, because the verdict goes by the age-weighted score (0.44; big starts at 0.45), not the raw share. It now shows the score, the 12-hour high when that decides, and a gauge marking where normal and big begin.

  3. 🗞️🔧Story titles keep names whole

    The title model wrote "Ron de santis" where every headline said DeSantis, and "Elon musk's" where headlines had a curly apostrophe. Two words the headlines write as one name with a capital inside are joined back, apostrophes match either way, and a word one headline capitalized mid-sentence stays lowercase when it isn't a name ("Midterm losses").

🗓️ Nov 4

  1. 🏢🔧🎯 A day's newsiness, by each outlet's newest headline

    Election night read as "just another news day": the results ran in a story begun Nov 2, and the score weighed every outlet by the story's oldest headline. Each outlet now counts by its own newest headline on the story, at full weight for 2 hours and halving every 3 after, so many outlets posting on one story at once is a big day, a running story included, and a headline left up from yesterday fades. The sticker takes the highest hour of the last 12, so the morning after reads big too. Replayed on the 24 days before: 5 big days where there had been 4, and election night big from 11 PM to 4 AM Eastern. Newsiness charts crossing Nov 4 change scale here. The trending list keeps its own age weighting.

  2. 🗞️🔧A shared name's rarity, counted outside the two stories

    A shared name joins two sagas only if it's rare, and it was counted over all the day's headlines, so the day's biggest story lost its own name: on election night "Senate" and "midterm" passed 4% from their own coverage, and the results made a saga apart from the midterms. Rarity is now counted outside the two sides: under 4% counts; up to 12% counts when the name is five times as common on the two sides as elsewhere; past that ("Trump"), never.

  3. 🗞️🔧Look-alike stories carried on side by side fold together

    Two stories each continued by a cluster of their own were never compared again ("Democrat Abdul El-Sayed wins Michigan Senate race" and "Abdul El-Sayed wins Michigan Senate race"). Continued stories whose titles share half their words are now put to the model with the rejoin question, four pairs a run at most; the same event folds the younger into the older. The sides of the hour's seam cut are never asked.

🗓️ Nov 2

  1. 📰🔧Older headlines stay with the part they came out in

    A saga's newest part (Stevens endorsing Rogers) opened with the previous week's feud, because the old headlines were still on front pages and clustered with the new. A continued story now leaves a headline with its story when the headline was first seen before the continued story began; a story begun this hour still takes what it clusters with. Saga 27's misplaced headlines were moved back by hand.

  2. 🧩🔧Each filing names the method that made it

    New filings carry a short hash of the filing prompts, models and signals, and the index keeps what each hash stands for, so claims filed before and after a prompt or model change can be told apart. Filings from before Nov 2 carry none.

  3. 📏🔧How the model's filings hold up

    "How the index works" shows the share of the model's filings kept when read, by how sure the confidence model was beforehand (on Nov 2: 89% of sure ones, 57% middling, 31% unsure), with who read them and the two biases: the least sure are read first, and sure ones are passed a page at a time with unfit ones held rather than counted.

  4. 🧩🔧A motif's 1896 echoes on its own page

    Approved echoes, with who checked them, now show on the motif's page (under the motif it was merged into, where it was).

🗓️ Nov 1

  1. 🧩🔧One telling makes a motif

    The number of tellers is no longer a doubt about a motif or a bar to a seed. Whoever files decides whether a telling is plain analysis rather than passing it on as a doubt.

🗓️ Oct 31

  1. 📰🔧National Post and Vanity Fair are read again

    after redesigns left their scrapers finding nothing. OAN's front page now puts a bot check in front of every request, so its headlines come from Google News, like Reuters, AP and the Post. Forbes's front page has answered 403 since Oct 27; it is read from its own feed, which carries contributors' posts too, so Forbes's headlines from Oct 31 include them.

🗓️ Oct 30

  1. 📰🔧Front-page links resolved as a browser does

    Links were glued to the front page's address as text, so the Guardian's /us page made /us/world/... (dead), France24's /en/en/..., and RFE/RL and Quillette double slashes. Every sampled Guardian link was dead. 5,425 stored addresses were repaired.

  2. 🗞️🔧Today's stories can join sagas active in the last 45 days

    , not just the past week, under the same likeness, shared-name and model checks (loose stories still need to be a week old or less). A saga quiet for a week could never take its next part: Christa Pike's execution was saga 5 on Oct 2-3, and its Oct 22 and Oct 30 stories became a new saga.

  3. 📰🔧A name's commonness from today's headlines only

    The 4% rule also counted the old headlines brought back for comparison: saga 5 brought back 472 "Christa Pike" headlines, so her name looked too common to join on.

  4. 🧩🔧Motif space

    Each verified motif's centre (the mean of its confirmed claims) and its claims, laid out by meaning (Qwen3 8B embeddings) and by shared words (TF-IDF) with t-SNE, once a day from the public layer only; a claim held since drops out at the next build. The folklore page's "stories told" now starts each name from its motif's place, so stories told alike sit side by side. Distances on a t-SNE map are only rough: near is near, far isn't measured.

🗓️ Oct 29

  1. 🏢🔧The outlet map's shape

    Shading from a smoothed count of the outlets' dots, with a dashed edge, traces the shape the day's dots make (lately an arrow: business and wire outlets forking left and right). It follows the dots, so it claims nothing they don't.

🗓️ Oct 28

  1. 🗞️🔧A story split by an hour's clustering carries on as one

    When one story's coverage splits into two clusters and the smaller part shares no headline with the story (other outlets, new wording), it matched nothing and, the story being live, was no return either, so it started a story of its own (saga 99: "RFK Jr faces backlash for anti-Arab remarks" and, from noon, "RFK Jr. faces backlash over anti-Arab remarks"). Now such a cluster is compared with the stories this run's other clusters continue: two frequent words in common, then the model's same-event question (the rejoin wording); the same event continues that story and the page shows the two clusters as one card. A different event keeps its own story, as in #147 (Oct 3, the G7 release and the diesel export ban), and the sides of a seam cut are never joined again.

  2. 🏢🔧🎯 An outlet's beat

    Independent component analysis (FastICA, one component per nine outlets, at most 8) of the outlet map's outlets × stories table, on each outlet's row as shares. A beat is kept when it comes back in 80% of 20 reruns (new seeds, 80% of the stories; outlet scores at r ≥ 0.8 and half its ten defining stories) and when those stories' labels sit closer in meaning (the site's static story embedder) than 95% of random sets of our stories, the guard against small outlets, which stand apart in ICA whatever they ran. Outlets lead it when they ran 7 of its 10 stories and those are a fifth of all they ran; others share it when they ran 4 at 5 times their usual rate. Named by a topic family (outlet_profile.TOPICS) matching 40% of its stories and twice its share of all of them, or by its stories' own labels.

  3. 🏢🔧Outlet lists by shares, feelings against the average outlet, measures against the median

    The outlets page's Spiciest | Plainest and Grimmest | Sunniest rank outlets by the share of their headlines scored loaded (1 or 2) or plain (0), grim (below 0) or good news (above 0), not by the averages. The outlet map's stories that pull each way are colored by the side that ran them more: the share of its left-rated outlets that ran a story against the share of its right-rated ones, alike within 1.5 times. An outlet page's feelings are its share of each against the average outlet's (each outlet with 5 or more headlines read counting once, from front pages now), within 2 points "about the same"; its loaded share, grim share, rewrites and wire share sit beside the median outlet's.

  4. 🧩🔧A day's newsiness; the court's stages; the divide's lists for every week

    The archive shades each day by its number, the average of its hourly news-day scores (Eastern days; its emoji is the front page's tiers on that number, so it can differ from what the front page said at the day's end, which its card keeps). The court page colors a case by its docket stage from its dates (taken, to be argued, argued; no "decided", which the list lacks) and other Court news by what most of its headlines report. The aisle's divide lists are now worked out for each charted week, and a motif listed both as told alike and as mostly one side's shows once, as told alike.

  5. 🧩🔧Folklore: "gone quiet" and "only the shows say"

    Gone quiet: a motif with 5 or more claims dated in the 14 days before the last 7, and at most one in those 7. Only the shows say: told on 3 or more shows and never by people online, a fact-checker or the voters. The motif index's cards count where claims were heard as tellings: a claim once per show that told it (by the show's lean), once online, once per fact-check, once from voters.

  6. 🗞️🔧Buzz as a count, and one-sided stories by their odds

    The headline table shows buzz as the count it always was (how many of the day's 1,000 most used words and phrases a headline uses, now words in the download), as a bar against the hour's busiest headline, the percentile moving to the hover card: as a percentile the first page of the table read "top 1%" on every row. The stories page's young one-sided stories are two lists, mostly left | mostly right, ranked by how often stories like each reached the other side within a day in our own history.

  7. 🧩🔧The aisle: "only in the center"

    A motif is listed when at least 2 center shows said it in their own voice (a host or guest, as the aisle counts sides) and no left, right or crossover show told it at all, not even in a clip it played or a call, over all time; crossover shows are their own group, with an "only on crossover shows" list when any motif meets the same rule (none did on Oct 28). The lists under the map are now colored by genre.

  8. 🏢🔧Sinclair: The National Desk as an outlet, five of its stations for research only

    To test the "barbell" (an outlet running mostly straight news around a small share of centrally made pieces, as Sinclair's must-runs sit inside otherwise local news), each hourly run reads the homepages of The National Desk (thenationaldesk.com, Sinclair's national news, on air as The National News Desk) and of KOMO Seattle, WJLA Washington, KUTV Salt Lake City, WPEC West Palm Beach and WBFF Baltimore: one request each, our user agent, headlines only, never the articles. Sinclair's terms of use forbid automated reading; as with every outlet, we read only the headlines any visitor sees on the public homepages (how we read sites: Nov 12). The National Desk is an ordinary outlet, joining stories, lean bars and counts; AllSides rates it Right (low or initial confidence, read Oct 28), and ratings.csv records it like any other, with no column for confidence. The stations are not outlets. Their national pieces are The National Desk's copy, the same piece under the same slug on every station (on Oct 28 one White House piece on socialism led all six homepages), so five stations as outlets would have made one syndicated piece look like five outlets on a story, and five mostly local front pages would have thinned every "share of outlets" measure (the news day, story coverage). So a station's headlines are kept in station_sighting under the station (link, wording, highest place, first and last seen) and never become headlines: no story, lean bar, outlet count, outlet page or icon. Nothing is dropped because another site saved the same headline first. The National Desk's homepage is kept there too, so app.sinclair.sightings() can say per station headline whether The National Desk's homepage ran the same piece (national_desk; strict, as its homepage shows about 20 pieces at a time) and on how many of our Sinclair sites it ran (sites; two or more is syndicated but not always central: WJLA and WBFF, neighbours, share regional pieces, so section says news/local or news/nation-world). On the saved homepages: The National Desk 25 headlines, KOMO 87, WJLA 75, KUTV 90, WPEC 93, WBFF 90. From the first hourly run with this change (the earliest station_sighting.first_seen marks it).

  9. 🏢🔧The outlet map's broad group is "outside the partisan webs", and look-alikes must agree

    The 50-outlet cluster first called "wire and mainstream" is everyone the two partisan webs leave out, One America News Network, Newsmax and The Epoch Times among them, so it's now named for what it isn't. And an outlet is given a type (or family) only when at least two of the three outlets it behaves most like share it: on Oct 28 that took One America News Network (two of its three look-alikes in the right partisan web) and a few left outlets on the web's edge out of their types.

  10. 🧩🗑️The Election Almanac is dropped, and the Replay is published

    The Almanac's chances were set by hand, not drawn from the data, and the person didn't want a guess at which motifs would grow passed off as a forecast; it was never published and its page and code are gone. The Replay, built for the preview the same day, is now on the site, with its short quotes of the replayed passages; the sources page says so.

  11. 📰🗑️The Play page came down the same day

    The person didn't want the headline games (Real or satire?, Guess the lean, Same story, two papers); the page, its card and its code are gone.

  12. 🏢🔧Breitbart's first sightings from its feed too

    About a fifth of Breitbart's articles were first seen a day after the date in their address: late-night posts sit low on its homepage (median position 17 against 8) or reach it only the next morning, which made Breitbart look late to stories. Each hourly run now also reads its RSS feed (feeds.feedburner.com/breitbart, one request, our user agent) and keeps what it lists in feed_sighting. A feed item is not a front-page headline and never becomes one: no position, no story, no lean bar, no "on the front pages" count. When the front page later lists an article the feed listed in an earlier run, the article's first sighting (article.first_accessed, the "first seen" on story cards and chips) is the feed's time; its headlines keep their front-page times, so the story page's "first on a front page", "who stayed on it" and the first-hour count are unchanged. From the first hourly run with this change (Oct 28; the earliest feed_sighting.first_seen marks it). Articles seen before then keep their old times. The same article listed again under another section's address (65 of 397 late ones) isn't matched by the feed and stays late.

  13. 🗞️🔧Momentum lines and the crossing watch

    Story cards and story pages under 12 hours old can carry one line on how stories gathering like them did, and the stories page lists young stories mostly one side is covering. Both are lookup tables of the site's own stories (app/analysis/momentum.py), not a fitted model, rebuilt once a day from the stories born in the last 30 days that are at least 48 hours old (905 on Oct 28, 170 of them wide). A story's state is its outlets, the outlets first seen in the last three hourly runs (2.5 hours) and its hours since it first made a card (story.first_seen); it went wide at 20 or more outlets. Each story counts once in each cell it passes through in its first 12 hours (24 for crossing). A cell with fewer than 20 stories gives way to a coarser one (the hours band dropped; for crossing, then the wire/center split too), and with none big enough nothing is shown. The momentum line shows only when its cell is well over the base rate: at least 1.75 times it (and 10 points over) is "📈 gaining fast" with 3 or more new outlets, else "📰 big for its age"; a slow story says nothing. The crossing watch takes stories under a day old with 5 or more rated outlets, at least 80% of them on one side and fewer than 3 on the other, and gives the share of such stories (by side, a wire service or center outlet on it or not, hours so far) that had 3 or more outlets from the other side within the next 24 hours; both directions are counted and worded the same way. Membership is final membership, as in the Oct 28 study (a headline that joined later counts from its own first sighting). On Oct 28 the cells were small for crossing (24-72 stories) and showed left-leaning one-sided stories reaching the right about 3-5 times in 10, right-leaning ones reaching the left about 1 in 10-15; unlike the study, a wire or center outlet on a right-leaning story did not go with more crossing (1 of 18; too few to show on its own).

  14. 🏢🔧The outlet map and outlet fingerprints

    A new page places every outlet with at least 20 of our stories and 100 headlines in the last 28 days by which stories it ran: a correspondence analysis of outlets × stories (ran it or not; stories at least three of those outlets ran). On Oct 28 that was 75 outlets and 981 stories; the first two axes hold 5.9% and 4.6% of the differences. The first runs from business, tech and world news to the political fight, with the partisan outlets of both sides at the same end; the second from crime and immigration stories to Trump-critical ones. An axis' sign is arbitrary in the maths, so each is pointed by the lean ratings: the first's high end is where outlets rated far left or right gather (rank correlation with |lean| +0.58 on Oct 28), the second's where left-rated ones gather (with lean −0.70). The ratings only point the axes; they place no one. A second view sets outlets by wire (the share of its stories AP or Reuters also ran, how close its headlines are to theirs on those stories, how often near word for word, its vocabulary against theirs on equal samples, and how much of its front page is shared stories) against heat (loaded scores, combat verbs like "slams", sensational words, anger and disgust, each side's labels for the other, minus neutral feeling): each the mean of those measures' ranks on a normal curve. The AP and Reuters are measured against each other, so they're left off that view. Each outlet's page now carries its fingerprint: wire and heat as percentiles among the profiled outlets, its three nearest outlets in the full behaviour space ("behaves most like"), its place on the map, and its type. Types are Ward clusters on about fifty behaviour measures in eight groups weighted alike (coverage, agenda, timing, sidedness, headline form, heat, labels, churn), named by anchor outlets (a cluster holding more than half a type's anchors, and no other type's majority). Each type is taken at the cut of the tree (2 to 10 clusters) where it's most stable, and shown only when it comes back at least 0.75 the same (mean best Jaccard) across 100 reclusterings of random 80% samples. On Oct 28 five held: the outlets outside the partisan webs (50, 0.94; first called "wire and mainstream"), the right partisan web (13, 0.92), the left partisan web (12, 0.77), and within it the left Trump-watch (3, 0.90) and left opinion (5, 0.82); the mainstream's finer types (business desks, explainers and others, 0.44 to 0.68) didn't, so mainstream outlets carry only the broad family. A type named for a side isn't shown on an outlet rated on the other side or center (on Oct 28 that kept The Sun, rated lean right, out of the left partisan web it clustered with). The features reproduce the Oct 27-28 study's (rank correlation 0.93 to 1.0 per measure), except that bylines aren't stripped. Rebuilt once a day (about 13 seconds) and kept in outlet_profile.json. Outlets the site builds no stories from (most outside the US and the UK) and the aggregators aren't profiled.

  15. 📰🔧Bylines off the headlines

    Red State's and Townhall's cards, and Scripps News's, put a section label and the author's name inside the headline's link ("…but There's a Catch Susie Moore"), and The Gateway Pundit's trending list its view count ("68.2K views"), which also made a new "headline" each time the count moved. The scrapers now leave those parts out. Headlines stored before keep them (3,951 on Oct 28, about half of Red State's and Townhall's) until scripts/clean_glued_titles.py --apply is run; scores the model gave the glued wording stay either way.

  16. 📰🔧Photo credits off the headlines

    NBC News, CNN, ABC News and The Christian Science Monitor link a story's photo on its own, and the photo's credit sits inside that link, so the link read as a headline: "Saul Loeb / AFP via Getty", "Chelsea Stahl / NBC News", "• Analysis Mark Felix/AFP/Getty Images" (CNN's also brought the label on the photo, and a video's caption). Bloomberg's front page did the same until it moved to its feeds on Oct 11. The scrapers now leave the credit out, so a photo's link reads as nothing and is dropped, and a text that is only a credit (ending in an agency after a slash or "via") is never a headline for any outlet; "Koch agrees to buy Getty Images" and "AP sources: …" still are. Stored before: 1,228 on Oct 28 (NBC 571, CNN 423, ABC 164, Bloomberg 55, the Monitor 10, and 5 of NBC's under articles Drudge Report linked first), the first headline of 632 articles. The model scored every one not news, which kept them out of stories and the word cloud, but they still count: the edits page's rewrites per 100 headlines count them (NBC's 8.3 a week is 13.5 without them), a credit seen between two wordings hid that rewrite (36 in the week), and the outlet fingerprint reads an article's first wording, so NBC's share of news articles was 0.78 against 0.90 without them, and CNN's 0.54 against 0.78. On the person's word ("Delete them") they were deleted the same day with their 2 story links and the 33 articles left with no headline (scripts/clean_photo_credits.py --apply; backup data.db.before-photo-credit-delete-2026-10-28). Measures from before Oct 28 that read headlines counted them.

  17. 📰🔧One spelling for James Talarico

    The transcriber's list of names to expect spelled him "Tallarico", so most show transcripts did too, and the names page counted him twice. The list has his name right now, transcripts fix the old spelling, and the names page joins the two.

  18. 🏢🔧Names: named more by the left or the right, against the day's mix

    The day's mix is the share of left-leaning outlets among the left- and right-leaning ones naming anyone today. A name is listed for a side when at least 6 left or right outlets named it, its share is 10 points or more past the mix toward that side, and that side named it at least 2 outlets more than the mix would give it; ranked by how many more. The names are colored by how new they are to the news (first named in any saved story in the last 2 days, this week, or before), as the model gives no kind.

  19. 📰🔧Headline changes without the model's reading

    The edits page and the outlet pages no longer show the language model's note on what a rewrite changed, or the "more loaded / plainer wording" and "better / worse news" tags (and their filter buttons). Its 15,049 judgments (qwen3:8b) called 63% of rewrites more loaded for outlets on every side, and 6.8% of its notes only repeated a label. On Oct 28 that was a note on 2,949 of a week's rewrites and a tag on 505. The rewrites themselves, their before and after, and each outlet's count stay; no new judgments are asked for.

  20. 📰🔧Live pages aren't headline edits

    The headline-changes count skipped live blogs only when the headline said "LIVE" or "live updates". It now also skips "Live Score" match pages (News 18, Times of India), title-case labels ("Israel Elections Live:") and pages whose address marks them live (/liveblog/, -live-updates, -live-score-, the Guardian's /live/). On Oct 28 that took 186 of a week's 3,367 rewrites out, 46 of them live-score pages.

  21. 🧩🆕The Election Almanac

    A forecast of which of 30 election motifs surge in election week (Nov 3-9), with a lead side for each and five answer calls, to be frozen before Nov 3, 00:00 ET (scripts/freeze_almanac.py records the SHA-256 of the forecast's canonical JSON) and scored on Nov 17 (app/analysis/almanac.py). A surge: the motif's share of the window's tellings is at least twice its share in the baseline week, Oct 20-26, with at least 3 in the window. The baseline is that week alone because show transcripts before the Oct 20 fix caught about 3.1 characters a second of speech against about 15.7 since (claims per episode went from about 7 to about 24 at a steady ~80 episodes a day): an Oct 3-26 baseline mixed thin weeks with full ones, so any show-told motif would look like it surged. Scored by the Brier score against a reference forecaster that gives every motif 0.148, the share of 27 election motif-weeks that doubled in the week of Oct 13 against the weeks before (thin transcripts on both sides). The draft's 0.271 also counted the week of Oct 20 against thin weeks, where the fix alone made shows' motifs double. Days are the index's: a show's is its episode's publish day in UTC, so an episode out after 7 PM ET counts as the next day. A frozen forecast that no longer matches its hash is not scored, and its test fails.

  22. 🎙️🆕The Replay

    A new page lists the passages heard word for word on many shows: the same 12 words in the same order in our transcripts of three or more different shows, over the 14 days up to the newest transcript (the page shows those heard in the last 7). Shared runs a word or two apart in an episode are one passage; pieces of one clip that a transcript broke apart are joined when they sit within 30 words of each other in at least three quarters of the same episodes. Passages are sorted by rules read off their words: a transcription loop (fewer different words than 35% of its words) is left out; "paid for by", "approve this message" and the like make a political ad; phrases such as "promo code", "terms apply" or a web address read out ("at wayfair com"), or shopping words making up 6% of it, make a sponsor read, as does a piece sitting right against one in half its episodes. Everything else is a clip. On the Oct 27 data (1,861 transcripts) it found 284 passages in about 4 seconds; the top one, the Ramaswamy ad featuring Amy Acton's mother, on 23 shows. Times are the feeds' publish times; the time in an episode is the start of the transcript segment where the passage begins.

  23. 📰🔧Headline games (🎲 Play)

    Two word models (TF-IDF and logistic regression) pick each day's puzzles, trained on the 21 days before the puzzles' window and scored on the window itself, after stripping scraper residue (bylines glued on the end, "3 hours ago", "via Getty", view counts, kickers). Real or satire? sets two or three satire titles (from left- and right-leaning satire feeds) the satire model takes for news among real front-page headlines from the same three days it takes for satire; the real ones come only from news reports (news score 0.5 or more) by center, leaning or unrated outlets, since the strongly partisan outlets' satire-looking headlines were mostly outrage pieces about named people. Guess the lean uses headlines from the last two days that the lean model reads at 0.85 confidence or more and gets right (on a held-out week, 17% of headlines at 91% precision; 62.6% right overall against a 41% baseline); the answer is the outlet's AllSides rating. Same story, two papers takes, among the six biggest stories of the last 30 hours, the left-rated outlet's most left-typical headline and the right-rated outlet's most right-typical, sharing at least one word that matters. Scores count both kinds of right answer. Offensive words, quizzes, cartoons and headlines naming an outlet are left out.

  24. 🧩🔧Sides counted on what the show itself said

    Each show telling now carries who said it, as the show-claims pipeline heard it: host, guest, caller or a clip the show played (for a claim retold on several shows, the speaker counting most among that show's tellings, host first). Where the site counts sides, on the aisle's left-to-right placement, it now counts only shows whose host or guest said it, once per motif per episode. Before, a show counted when any claim of a retold group was heard there, clips included: 629 of the 4,489 show tellings on Oct 27 were clips, and 15 of the left's 19 "The impostor" tellings were left shows playing the attack ad on Amy Acton, mostly to rebut it. Guests count because the show booked them (center shows' tellings are 44% guest); counting hosts alone halved the sample and left the divide between the sides about where it was. 21 of the 607 motifs heard on the shows came up only in clips, calls or unknown voices and leave the aisle. A dot's height still counts every telling, and the motif pages' "came up on" lists are unchanged: they say where a story was heard, not who said it.

  25. 🧩🔧The weekly divide index

    (the aisle page). Each Tuesday-to-Monday week, the Jensen–Shannon divergence (bits) between the motifs left-leaning and right-leaning shows' hosts and guests said (one per motif per episode), less its mean over 500 shuffles of the lean labels among that week's whole shows (as many left shows as there were); the chart's band is the shuffles' 5th to 95th percentile. 0 means no more different than shows picked at random. Raw JSD is never shown: it mostly tracks sample size. A week needs 40 tellings and 4 shows a side; the week in progress is left out, and so are days (only 7 of 23 beat the floor in the Oct 27 probe). Weeks before Oct 20 rest on partial show transcripts (about 3 characters a second of audio kept, against about 16 since the transcriber fix; about 7 claims an episode against 24) and are drawn hollow. First values: 0.16 (Oct 3–5), 0.10, 0.18, 0.23 (Oct 20–26). The latest week's shared motifs are those said by 2 or more shows a side with weighted log-odds |z| < 1; its one-sided motifs have the largest |z|, said by 2 or more shows on that side.

  26. 🧩🔧Folklore: told a lot, never checked; what only voters say

    The first lists the motifs with the most distinct claims told on the shows and online (4 or more) and no claim examined by a fact-checker we follow, everyday talk left out, each with the left and right shows whose host or guest said it: a list of leads, not of falsehoods. The second lists the motifs whose only claims come from the voters in The Focus Group (33 on Oct 27; by a hand count in the probe, 17 of them praise for a candidate).

  27. 🧩🗑️No more "answered N days after"

    Motif pages no longer say how many days after a motif its answer was first told. In the Oct 27 probe the answer came after its move in 26 of 47 pairs, against 26.5 expected from the two motifs' sizes alone: the bigger motif simply shows up first. The answers themselves stay.

  28. 🗞️🔧Who stayed on it

    (story pages). For each rated outlet, the hours from its first headline on the story to the last sighting of any of its headlines on it (headline.last_accessed); left and right by the sign of its AllSides lean, center and unrated outlets left out. With 3 or more outlets a side, the page says which side kept it up longer when the two medians are 24 hours or more apart, and says nothing otherwise. Over the 481 stories that qualify the sides come out even (median right minus left about +2 h); 28 stories have right outlets a day or more longer, 25 left. A sighting's time follows the scraper's cadence, and outlets turn their front pages over at different rates.

🗓️ Oct 27

  1. 🎙️🔧Show claims tied to stories

    What the shows said now reaches the story pages ("🧩 How it's being told") and the front page's cards ("🧩 told as"). A show claim is tied to the story on the front pages it is nearest in meaning to (mxbai embeddings), among the stories running from two days before its episode to a day after, only when it is at least 0.75 alike and 0.04 closer than the next story; otherwise it is tied to none. Calibrated on the 392 Bluesky narratives the story model had tied: the nearest story agreed with the model's 85% of the time, and fell in the same saga 92%. About 1 in 14 show claims clears the bar, so the panel shows mostly on the bigger stories, and a tie can be wrong.

  2. 🧩🔧"Came up on", not "told by"

    Where the site counts the left, center and right shows behind a motif, a show counts when one of the motif's claims was heard there: told, reported or argued against. Tellings don't yet record which, so these counts say where a story came up, not who believes it.

  3. 🧩🔧Arguing against a story

    The site used to say a motif "is the same whether people tell the story or argue against it". Not quite: an answer often has a shape of its own (Voter fraud is answered by Voter suppression, Lawfare by No one is above the law) and is filed under the answer's motif. Where no answer has a motif yet, the arguments against a story are filed with its tellings. The site's notes now say so.

  4. 🎙️🔧Each show's signature

    A show's page lists the motifs it tells far more than the other shows: weighted log-odds with an informative prior (Monroe, Colaresi and Quinn 2008), the prior a weight of 10 tellings spread over the motifs by their share of all tellings. Its nearest shows are by cosine similarity of their motif counts, whatever their lean.

  5. 🧩🔧The motifs' words in headlines and on TV

    Motif names and the tellers' phrases (two words or more) are looked for word for word in the last three days' headlines and captions. Plots and everyday talk are left out: a plot's name is what a plain report says ("found dead", "mass shooting"), where an argument's or a theory's ("rigged election", "radical left") is the telling itself. A headline can still use a motif's words to report on it.

  6. 🧩🔧The motif map is the aisle

    The force-directed map is replaced by a chart: each motif placed left to right by the share of its shows that lean left or right, (right − left) / (right + left + 2) so a motif few shows told sits nearer the middle, and up by its tellers on a log scale; answers are arcs. A motif rises when told at least 3 times in the last 7 days and at least twice as often as in the 7 before; it fades when told a third as often or less.

  7. 🧩🗑️Out of the public index: watch lists and donation appeals

    Straight news and any other watch list (sinks for plain reports, kept so the models learn what isn't a story) no longer appear among the public motifs or their rankings. Folklore leaves out retold "claims" that are non-political appeals for money: on Oct 27 the top card was a pet-charity appeal posted once each by 285 accounts with no replies, a spam wave's shape.

  8. 📰🔧One side's wording

    "D.C." was read as the words "d" and "c", so the left's "D.C. golf" and the right's "DC golf" each looked like a phrase only that side used. Abbreviations with dots are now read as one word, and light verbs ("puts", "takes", "makes") count as headline grammar, not framing.

  9. 🗞️🔧Saga names

    The naming prompt now asks for neutral words true of every part. Two names were corrected by hand: "California noncitizen voting scandal" (now "California noncitizen ballot dispute") and "Trump attacks El-Sayed and Minaj", whose first part was Trump praising Minaj (now "Trump's Michigan rally").

🗓️ Oct 26

  1. 🎙️🔧Show claims grouped around a centre

    A claim told on two or more shows is now grouped with only the claims close to it and to each other (mutual neighbours at 0.84), around its most central telling, rather than chained through any pair alike enough: at 0.78 one chain had joined 4,436 tellings. The words a claim was filed under are kept when its group is redrawn, so a filed claim isn't filed again as a new one.

🗓️ Oct 25

  1. 🎙️🔧Show claims need to be 0.84 alike to count as one claim retold

    (from 0.78). Judged by hand on 70 pairs: at 0.78 to 0.80 about 4 in 14 pairs were one claim, at 0.84 to 0.86 about 10 in 14, above that nearly all. At 0.78 about half the two-show claims were two claims glued together.

  2. 🧩🔧Claims worded as a dispute are split, one claim a side

    "Arguments exist over whether..." isn't a claim anyone tells; such a claim is now split into each side's own claim, and the claim writers are told not to word one that way.

  3. 🏢🔧The Washington Post and The Washington Times

    are read again, the Post through Google News and the Times through its headlines feed, after both stopped coming in. A scraper coming back after failed runs no longer stops the hourly run.

🗓️ Oct 24

  1. 🏢🐛One outlet's failure no longer fails the hourly run

    its headlines are just missing for that hour.

  2. 🛠️🔧Visits are counted with GoatCounter

    no cookies, nothing personal kept.

🗓️ Oct 20

  1. 🎙️🐛Transcripts without Whisper's repetition loops

    Whisper decoded each stretch of audio with the text before it as context, its default, and a repeated phrase fed itself: "it is all happening, it is all happening…". 951 of 2,016 transcripts held a loop of five or more repeats, a median 12% of their text, and the speech under a loop was lost. From Oct 20 each stretch is decoded on its own (condition_on_previous_text off), and transcripts carry the label "no-carryover". On Oct 28 the shows' transcripts from before then were made again the same way, so the claims taken from them now rest on transcripts without the loops. Left as they were: the hourly newscasts (NPR News Now, ABC News Update, Bloomberg), whose presenters aren't tellers, so no claims come from them, and 14 Focus Group episodes from July to mid-October.

🗓️ Oct 18

  1. 🎙️🔧News briefings' presenters aren't tellers

    In the outlets' daily news briefings (BBC Global News, Reuters World News, WSJ What's News, Up First, CNN 5 Things, Morning Wire, NBC's Top Story), what the presenter reads out is the news, so it no longer counts toward a show claim being retold, and doesn't reach the motif index. The clips they play and the guests they talk to still count, as on any show. The hourly newscasts were already left out.

  2. 🧩🔧The checker's quick tabs: ✅ sure claims and 🚫 likely misfits

    The claims to judge listed every sure filing in one fold above the claim, 418 on Oct 18, and passing one filing of a claim left the claim to come back for the rest. Now two tabs of their own list them, a claim a row, a page at a time (10-100 rows a page). ✅ sure has only claims whose every waiting filing is past the sure line (277 of 582), so passing a row finishes the claim. 🚫 misfits has filings the confidence model puts under 30%, none ticked. The model is never sure of a no: held out, the person took out 74% of the filings under 30%, and 86% even under 10%. So the person ticks what to take out; what's left on the page either waits for its card or is checked as fitting. The model's held-out test now records how often the filings under that line were taken out.

  3. 🧩🔧⏸ Hold

    A claim can be put on hold, to look at later: it leaves the claims to judge, ✅ sure and 🚫 misfits for a ⏸ held tab, its filings still waiting, until it is taken off hold. Before, a sure claim left unticked came back each time the list loaded. A hold is no verdict: the confidence model doesn't read it.

🗓️ Oct 15

  1. 🗞️🔧A saga's parts in the order of their latest news

    Parts were numbered in the order they broke, but a part's title tells its latest news (a live story's title moves on with it), so a long-running part came first under today's title: the Fort Hood saga's part 1, "Trump cancels livestream of Fort Hood shooter's execution", was its newest development, after part 5. Saga pages, story pages and the front page's saga cards now order parts by when each was last on the front pages; each still shows when it broke and how long it ran.

🗓️ Oct 14

  1. 🧩🔧Flabby motifs opened into their tellings

    Pandora's drafts (Gemma's reading of each of the person's motifs of 10+ claims: the distinct stories told inside it, each with a note and its claims) are in the checker's 🧩 tellings tab. A telling the person makes a motif rests on the broader one and takes its ticked claims, which leave the broader one (or stay in both); this is not read as "not this motif" by the confidence model, since the claims still tell the broader shape, only more exactly. Each decision is also Pandora's verdict.

  2. 🗞️🔧A story is titled once more when it leaves the front pages

    Titles were written only while a story was live, from its newest headlines, and stood for good once it left; but headlines can move to another story afterwards, so a part could keep a title for news it no longer held (saga 48: "Senators Collins and Jackson debate in Maine" stood over ten Georgia headlines). Now, two hours after a story leaves, it is titled once from the headlines it ended with, saga parts first, the past week's stories over the next day or so. The title prompt now also says to give people only the roles the headlines give them (the titles had made Rep. Mike Collins a senator).

  3. 🧩🐛The confidence model no longer learns from the answer

    One of its signals counts the motifs a claim is in. In training it was counted as the index stands now, so a filing the person had taken out was already missing from the count, and the model could partly read the person's verdict off it (the Danaids, Oct 12: worth about 0.01 of AUC; the sure line held at 95% right). Training now counts the claim's motifs with the judged one among them, as they stood when it was judged; at scoring an unchecked filing counts itself the same way. The model retrains on it daily.

🗓️ Oct 13

  1. 🗞️🔧Who's in the news, today only

    The names page shows the people, places and groups in today's stories (from midnight ET), those in two or more stories or carried by 15 or more outlets, widest first, each with its first three stories and the rest folded. A title before a full name is dropped when counting ("Rep. Ilhan Omar" is Ilhan Omar; "General Motors" stays), and a name that is a common noun in WordNet and never written with a capital mid-sentence in our headlines ("president", "senate") is not a name.

  2. 🗞️🔧A story split by one hour's clustering is joined again

    While both parts are on the front pages, the bigger keeps the story and the smaller starts a new one; when the two clusters joined again, the joined cluster went to whichever part held more of its headlines, often the young one, and the older story ended there (Christa Pike: eleven days ended at 7 AM on Oct 13, and a part split off at 1 AM, holding the same discharge headlines from Oct 10, carried on). Now a cluster holding a fair share of headlines from two stories both live lately is put to the model (the same event or not, as for a story's return); the same event, and the older story continues with the younger folded in. A new development (a resignation, a ruling) is still a story of its own in the saga.

  3. 🧩🔧Carrying words

    A filing can now carry the tellers' own words that carry its motif ("religion of peace", said sarcastically, under a crowd claim), written by the person in the checker (one phrase per ';'). Each motif gathers them into a phrase dictionary, counted by filing. They are evidence of how a motif is told in the tellers' own terms; they are kept, not yet read by any model. A phrase can belong to several motifs and means different things said sincerely or sarcastically, so it will be a finder and a tracker, never the filer.

  4. 🧩🆕The claim organizer: a claim from posts can be split into the tellings it holds

    Claims from posts sit in 3+ motifs 30.5% of the time (Oct 13; 10-15% for the other sources), and the Chimera found their paraphrase groups stitch tellings together. A second round now asks Gemma which of a claim's posts tell each of its motifs; when the motifs fall on different posts (a motif across the whole group counts as a layer, not a telling), it drafts one child claim per telling, each one side's assertion in its own voice, as a proposal for the person; no split is kept with its reason. Nothing changes until the person approves. An approved split takes the claim out of its motifs under a new curation-log action, split, which the confidence model doesn't learn from (an unfile would have read as "not this motif"); the claim stays in the index as the telling (tellings), and its children are filed as new claims with its source, story and a split_from link. From the first applied split, a claim from posts can leave the 3+ count without any filing judged wrong, and the filings count gains its children. Psyche (in the experiments' queue) runs it alongside the filing: on the Chimera's 160 claims against the person's filings, and forward on posts claims since Oct 6, its splits going to the proposals for the checker. Watched against these baselines: posts claims in 3+ motifs 30.5%, posts claims the person also filed elsewhere by hand 45.9%, sure share 44.7%.

🗓️ Oct 12

  1. 🏢🔧Bloomberg from its own feeds

    Its front page has answered every request with a captcha since Oct 11, 20:04, and we don't get around bot checks; its official section feeds (politics, markets, economics) still answer, so its headlines come from those, articles only. Their order is the feeds' (newest first), not the front page's, so anything weighted by a headline's place on the page treats Bloomberg's as a list from Oct 12 on.

  2. 🧩🔧Posts are tied to news stories by the links they share, where the model finds none

    A paraphrase group whose posts share an article in one of our stories is tied to that story when the model's own tie (embeddings, then Gemma) finds nothing; where both tie, they agree by story id 62 times in 65, and the model was the better of the two in the rest. On two weeks of reports this tied 27 more of 855 groups (389 in all). Guardian links now match whether or not they carry the edition (/us/world/... as we read it, /world/... as people share it): 60 of 71 shared Guardian links once missed now match, which also feeds a group's shared-side lean. Past filings backfilled: 258 of 783 posts filings now carry a story.

  3. 🧩🐛The shortlist's held-out test is honest now, and its training too

    Held out, a claim that was its motif's only one leaves that motif empty, a look nothing in real filing has; the weights learned to find exactly those, so the held-out top 12 read 86.7% (Thumbelina). Both trainings (the plain weights and the learned shortlist) now leave such rows out, and the test counts them as misses: about 73% at top 12 over all filings, about 85% on motifs of two or more claims. The dashboard's shortlist line steps down on this date for that reason, not because filing got worse.

  4. 🧩🔧Plain news is watched and filed again

    A claim judged plain news, in a motif the person marks as watched (Straight news: the checker's watch mark) or with no motif (a person's "tells no story" or the filing model's none), is no longer final: it is on a watch list (motifs/watch_list.json: 126 claims with no motif on Oct 12, and Straight news's 4 once marked; 3 claims with no motif have no words left anywhere to file) and filed again weekly against the index as it has grown, and at once when a narrative thread tells it again on a later day, in the 3 AM runs (at most 60 claims or 5 minutes a night). Filing again uses filing's own shortlist and judge; each pass is logged with the day the claim was reported and the motifs picked (motifs/refile_log.jsonl), so "a report at t0, told as motif X at t1" is on record. A real motif picked becomes an unchecked filing, marked as refiled, for the person to judge; a no puts the claim back with no motif. A watched motif picked means still plain; a new name is logged, never made. A show retelling the claim isn't detected yet (it needs claims compared by meaning); the weekly pass stands in.

  5. 🧩🔧A filing keeps the story its claim was told about

    A narrative's claim carries the news story the report tied it to (the model's tie, "same event" or "same issue"), a fact-check's the story whose card showed it; the Focus Group's and the shows' claims carry none (an episode covers several stories, and nothing cheap says which). So which motifs a story is told in, in time order, is a join (motif_index.story_motifs), with the plain report (Straight news) as its baseline: the person's decision that Straight news is a sink and a watch list. A story id is the site database's story, kept across hourly runs; a story folded into another is followed to it. Filings from before today were given theirs from the reports they came in: 212 of 768 narrative filings and 25 fact-check filings, over 81 stories.

  6. 🧩🔧Claims are written short and plain, by the rules read from the person's corrections

    Every prompt that writes a claim (posts, shows, the Focus Group, fact-checks) now carries, after its own instruction, the rules read from the person's corrections, a rule to write one short plain sentence (usually under 20 words, what is claimed, not who reports it), and 8 of the person's corrections of claims from the same kind of source as examples (fact-checks had the 5 latest of any source). This is the way the Brothers Grimm found closest to the person's wording on Oct 10 (0.784 alike against 0.758, and the one the blind judge preferred), never deployed until now. Claims written from today may be shorter and worded differently from earlier ones of the same kind; measured weekly (Cordelia).

  7. 🧩🔧The checker's "might fit better" suggestions come from filing's own shortlist

    For a weakly filed claim, the 12 motifs the confidence model weighs as alternatives were ranked by the plain six-fact weights, while filing has used the learned shortlist since Oct 8. They are now ranked by the learned shortlist's weights whenever filing uses them (the plain ones otherwise), the claim held out of its motifs as before. On 488 motifs the person added a claim to by hand, the 12 candidates held the person's motif 68.4% of the time against 62.9% (Castor and Pollux); 4.7 of the 12 change for a claim. Procrustes and Isis take their candidates from the same function.

  8. 🧩🔧The taught reranker is kept only if it judges better than the untaught one

    Each weekly teaching of Qwen3-Reranker-0.6B on the person's decisions now also scores the same decisions, on the same text, with the untaught model, and keeps the taught layers only if their held-out AUC is higher; otherwise the untaught reranker is used (and the confidence model retrains on its scores) until the next teaching. Both AUCs are kept with the teaching. Measured first (the Magic Mirror): on Oct 8's teaching's own decisions the untaught one scored 0.776 against the taught one's held-out 0.758, and on 838 decisions made since, 0.738 against 0.739: no sign the teaching helps, nor that it hurts.

  9. 🧩🔧Motifs count their occasions

    Each motif's kept claims are joined into occasions (alike by mxbai at 0.72, from one fact-check or show claim, or sharing a name found in at most 25 of the index's claims and not a common word); two or more occasions is attested, one is placed. Counted hourly after filing; the map draws placed motifs faint. On Oct 12: 288 of 616 motifs attested. An estimate, from Fable's reading of the index against the praxis.

  10. 🧩🔧A motif can say what it isn't

    (not_this), read by the filing model, the judge and the element drafter; a related link can carry the person's reason (related_notes). Neither changes anything until the person writes one.

  11. 🧩🆕Seeds can be filed into

    A seed (a motif the person makes with a name and note and no claims) was never offered to the filing model: every shortlist was built from motifs with claims, so the praxis's reason for seeding didn't hold (found in Fable's review). Now up to 2 of the person's seeds most like a new claim by name and note (at least 0.45 alike) join its shortlist, outside the learned weights, which lift motifs with no claims unearned (Jack). A filing into a seed is never passed as sure. Measured weekly (Persephone).

  12. 🧩🆕What each new claim is shown is logged

    (motifs/shortlist_log.jsonl): the motifs shown, the seeds among them, the pick, and the next motif number then, scored weekly against the person's final word (Prometheus). The shortlist's held-out recall (86.5% at 12) is measured on filings it had already found; forward, on the Oct 8 weighting, it was about 60%, mostly motifs the person made after the claim arrived.

  13. 🗞️🔧Stories get a second pass: cut where their words fall apart

    The person's idea (Oct 11), tested as Atropos and Rumpelstiltskin: stories are still formed by meaning (mxbai embeddings, 0.80), then each story of 12+ outlets is compared by its headlines' words (TF-IDF fitted on the story's own processed headlines) and split at the cleanest normalized cut if it scores under 0.6, each side at least 6 outlets, up to three cuts deep; but only when Gemma 4 26B, asked two ways, says the two sides report two events. On a week of stories, cuts under 0.6 confirmed that way were two events 18 of 18 times; on the last day's stories the score alone would have cut 9, three of them one event, so the confirmation stays. A story split this way keeps its id on the side holding most of its headlines.

🗓️ Oct 11

  1. 🧩🔧The motif index is all rights reserved

    On the site, in its Markdown and SKOS exports, and in the footer of every page of the daily archive (the build gives kept pages today's footer; the 346 stored copies were rewritten to match): reusing it now needs our permission. It was CC BY 4.0 from October 8 to 10 and CC BY-NC-SA 4.0 from October 10 to 11; copies taken then keep those licenses. The motif casebook (the person's rulings with their reasons) left the public repository with it, kept beside the index in the data folder; its earlier versions remain in the repository's history. The other docs stay CC BY 4.0 and the code AGPL. The Wayback Machine holds no copy of the site from after June 2024.

  2. 🗞️🔧Story titles keep up with the story

    A story's title was written again only when its outlet count doubled, but stories are kept for days and their news moves on: "Tennessee inmate survives botched execution attempt", written Oct 2, still headed nine days of Christa Pike coverage that had moved on to her leaving hospital. Now a live story's title is written again once it's 12 hours old and new headlines have come in, from its 30 newest headlines, stating the latest development. Titles already written are refreshed over the next runs, 25 an hour at most. Until the afternoon of Oct 11 this didn't happen: the rule read each headline's time after the front page had made it display text, and as text "Oct 9" sorts after "Oct 11", so no story looked to have news since its title. The Trump–Russia diesel deal's part kept its Oct 9 title over two days of Trump calling for Zelensky to be replaced.

  3. 🗞️🔧Saga charts drop to nothing between sightings

    A saga's spread chart drew each part from snapshot to snapshot, so where no part was on a front page for days it sloped across the gap: a part gone on Oct 4 was drawn until Oct 9. Now each part falls to nothing an hour after it was last seen.

🗓️ Oct 10

  1. 🛠️🔧Licensing narrowed

    The motif index (on the site and in its Markdown and SKOS exports) is now CC BY-NC-SA 4.0 with credit to bignews.day, and commercial use needs permission; the site's own writing and readings are all rights reserved. They had been CC BY 4.0 since Oct 8. Third-party data keeps its own licenses (AllSides CC BY-NC, Wikipedia CC BY-SA, VoteHub CC BY). The code is open source again, under the GNU AGPL v3 or later (it was MIT until Oct 8, then proprietary), and the repository is public; the docs (methods, praxis, casebook, experiments) are CC BY 4.0.

  2. 🧩🆕New motifs are named the way the person names them

    The filer and the proposer used to name a new motif in "three to seven words, terse like a folklorist's label", and the person renamed or rejected every such name. They now follow the praxis's naming rules (docs/motif-praxis.md): an idiom, a catchphrase or the tellers' own words, or a known story whose plot is the shape; no abstract or topic labels; one to five words. Tested on 101 motifs the person had renamed (P2): abstract labels went from 51% of names to 10%, five words to three; the person judged the names far better. Motifs already named keep their names.

  3. 📏🔧One model fewer

    Whether a newly named motif is one the index already has is now asked of Gemma 4 26B, not Qwen3 30B, which did only this: on the person's 33 merges and 44 "not the same" verdicts Gemma found 20 merges to the 30B's 18 and joined the same 4 not-same pairs, faster (M1). The two no longer trade places on the card mid-filing.

  4. 📏🔧Gemma 26B writes the claims from posts and fact-checks

    The nightly report's narratives (each group's claim and labels, and the check of which posts are about it) and the fact-check labels were written by Qwen3 8B; Gemma 4 26B now. On the person's corrected claims Gemma's wordings came closer to theirs (W1: posts 0.799 against 0.775, fact-checks 0.791 against 0.746 alike), and Qwen3 8B looped or invented details. Labels already made stay; the headline scorer stays on Qwen3 8B, so the news, loaded and emotion series don't change.

🗓️ Oct 9

  1. 🧩🔧The genre drafter is told what each genre is

    It used to see only five of the person's motifs in each genre; now it also gets each genre's line from docs/motif-praxis.md (or the person's own 📝 description of it) and the tests for telling close genres apart. On the person's 453 genre calls it was right 53% of the time before and 66% after (Theories 38% to 72%, Plots 57% to 73%: G1 in docs/filing-experiments.md). Proposed genres are drafts, as before.

  2. 🧩🔧The judge checks each motif's must-have element

    Each motif now has one sentence saying what a telling must contain to be an instance of it (drafted by Gemma 26B from its name, genre and note, again when they change), and Nimble 9B is asked whether the claim, as told, contains it. On the person's 96 rulings of Oct 9 (the casebook's hard cases) the judge's AUC rose from 0.54 to 0.79; on all 897 decisions from 0.801 to 0.811 (J2 in docs/filing-experiments.md). The confidence model retrains on the new answers; fits from the old ones stand until then.

  3. 🧩🔧The check list goes least sure first

    The ✅ check tab used to list the filings the confidence model was surest the person keeps first; now those it can least tell (a fit nearest even), and 🎯 today gives 13 of its 20 a day to such torn filings (10 before, in a wider band: fits from 20% to 80%). A simulation on the person's own decisions (E6 in docs/filing-experiments.md) found the model learns as much from 150 checks in this order as from ~550 at random, and more slowly still in the old order. The sure ones still pass in one step from their own fold.

  4. 🧩🆕A new judge in the confidence model

    Its yes-or-no on each filing now comes from Nimble 9B, a decision model (a calibrated probability in one pass), instead of Gemma 4 26B: on the person's 817 decided filings it judged as well (AUC 0.824 alone against 0.818; 0.895 in the model against 0.894) in a fifth of the time. (It doesn't quite fit the card: 2 GB of its 9.5 run on the CPU; the 4-bit build that fits judged worse, 0.797 against 0.818.) The model retrains on Nimble's answers; fits from the old one stand until then.

  5. 📏🆕Two more embedders in the filing shortlist

    Qwen3-Embedding 8B and Snowflake Arctic Embed 2 each compare a claim with every motif's name and note and with its nearest claim (E11: of twelve embedders tried, this pair helped most). The learned shortlist, retrained with them on the person's 470 confirmed claims, puts their motif in the top 12 for 85.7% held out (83.9% before; the plain weights 80%). The confidence model weighs them too.

  6. 📏🔧Nimble judges the link proposals too

    The 💡 related and rests-on proposals' chance of approval (best fit) now weighs Nimble's yes or no instead of Gemma's 0-10 score: on the person's 301 decided proposals it ranked approvals above rejections better (AUC 0.772 against 0.755, in 20 of 20 test splits). The judge's reason no longer shows.

  7. 🧩🔧Claims without their teller

    The Focus Group and show readers now write the claim itself ("Defunding the police isn't a federal issue"), not "The voter believes..." (it had named a guest's analysis a voter's). Who said it stays with the quote.

🗓️ Oct 8

  1. 🧩🔧"Kind of" is now "rests on"

    The one link that ranks motifs, until now "X is a kind of Y", now reads "X rests on Y": X only makes sense given Y, as a kind of it, or as a case, argument or figure by which it's told ("Magic money tree", an argument, rests on "Politicians' empty promises", a theory). Every kind-of link still holds as one; a survey of the 83 found about 18 that had only ever been right this way (an archetype or argument resting on a theory). The rule of Oct 7 that the link stays within one genre is gone, and the links it took away are proposed back. The proposer, its judge, the workbench, both maps and the export say "rests on"; the data is unchanged.

  2. 🧩🔧How sure a filing is

    Each claim the model files under a motif now gets a fit: the chance the person keeps it, from a small model trained on their own decisions (723 so far: 572 filings kept, 151 taken out). It weighs how alike the claim and motif are (the filing shortlist's measures, the claim held out), how the motif ranks among all motifs for the claim, how many motifs the claim is in, where it came from, and whether the person has curated the motif. Tested with each claim held out: AUC 0.83 (the shortlist's score alone: 0.74); at a fit of 85% or more it passes 64% of the filings the person kept, and 95% of what it passes they kept. The check list goes likeliest first, and the filings over that line can be passed in one step, except a filing in a motif made for that claim alone, or from a source with fewer than 30 of the person's decisions (the shows, for now). Not used on the public site: what's public is still only what the person has checked. Later the same morning, on the person's word: only filings in their own motifs (marked done) get a fit or are learned from; a motif the model made and nobody has shaped measures nothing (a claim had scored 100% in the motif just named from it). Retrained so: AUC 0.82, sure from 95%, where 96% of passes were kept. By midday the fit weighs many more kinds of evidence (app/analysis/motif_signals.py): the motif's note alone, its keywords, the claim rewritten as the bare shape of its story, the motifs of the most similar filed claims, a second embedding model, the person's groups, a cross-encoder reranker (Qwen3-Reranker-0.6B) and the filing model's own yes or no with its probability. Tested on 749 of the person's decisions held out by claim: AUC 0.885; at a fit of 85% or more it passes 76% of the filings they kept, 95% of what it passes kept (29% at that precision the morning before). Boosted trees did no better than the plain weighting, and both level off by half the decisions: more checking alone won't move it much. Fits are worked out in the hourly run and kept on the filings. The person's confirmed filings get one too: the lowest of the model's own, a second look for a hurried yes. In the afternoon, from the first experiments (docs/filing-experiments.md), one more: the claim against each motif's note and nearest claim with the day's news taken out. The main directions the latest 6,000 headlines vary along are mostly topic (a country, a storm, a trial); projected away from both sides, what's left leans to how a story is told. Held out, it brought 1.3 points more of the person's motifs into the top 12, with nothing of their filings in it to leak. The directions are worked out once a day.

  3. 🧩🆕New motifs come with the model's note, genre and groups

    A motif the model makes for a claim no motif fits used to arrive bare: no note until it held three claims, no genre or group until the person gave one. Now the hourly run drafts all three straight away: the note from its name (the claims only to see how it's told), the genre judged against examples of the person's own motifs in each genre, and up to two groups, each the model's yes among the three groups whose motifs are nearest. The genre and groups are marked as the model's guesses (🤖 in the checker) until the person marks the motif done or sets them by hand; till then nothing learns from them (genre examples, group centers, the group signal of the filing model and the public pages read only the person's), and a merge leaves them behind.

  4. 🧩🔧The public motif map, readable on a phone

    On a phone the map came after a screen and a half of explanation and filters, and then drew all 350 names at once, an unreadable heap. Now the explainer and the key fold away on small screens (open on wide ones), so the map comes first; names show only where they fit at the current zoom, the most telling first (the most claims, what others rest on), the picked motif and its neighbours always, more as you zoom in, the groups' names placed first; related lines stay faint until their motif is picked; and lines between motifs that only share a claim are off unless asked for (told together isn't related).

  5. 🧩🔧🎯 Today's most useful decisions

    The person can't confirm motifs for hours a day, and needn't: the confidence model learned nearly as well from half their decisions as from all of them. What teaches it most per minute is a few decisions of the right kind, so the workbench's 🎯 today tab gathers about twenty: the filings it's torn on (a fit nearest 50%, one per claim), the confirmed filings it now doubts that have a better motif to offer, the motifs it made that nobody has shaped yet (keep as drafted, or open and change), and the likeliest proposals for new motifs and groups. The rest still gets filed and scored; the public site shows only what they've checked.

  6. 🛠️🆕A dashboard of everything

    (the checker's 📈 Dashboard, app/dashboard.py): whether the machine keeps up (each hourly run's minutes against the 45-minute limit, feeds or outlets not coming in, the card's heat and load, models loaded into memory each hour), what came in each day (headlines, outlets, side-feed items by kind, transcripts and hours of audio, fact-checks and whether their pieces were read), what was made of it (claims filed, what waits for the person, proposals, episodes by kind), the motif index's shape and growth, the models' own held-out tests and the latest experiments, and the person's curation by day and kind. Read live, each part again once it's a minute old, in the background.

  7. 🛠️🔧The hourly run keeps to its time

    The 3 PM run was stopped by its 45-minute limit before it filed any claims, and the 5 PM run took 44 minutes: the day's additions and the backlog of podcast episodes newly let in added up. Each step after the site is published now gets what's left of 40 minutes at most, ten of them kept back for filing claims and their fits; a step with no time left waits for the next run and says so in the log.

  8. 🎙️🔧Episodes labeled news or evergreen

    Some shows spend an episode on history or a life story. Each new episode of the podcasts, call-ins and video channels is now read from its title and blurb as on the week's news, evergreen, or a mix (ten at a time, once each). A label, not a filter: evergreen episodes are still transcribed and their claims still read and filed (motifs live in history talk too), but the news goes first in the transcription queue, and a claim counts as retold this week only when shows on the news tell it.

  9. 🧩🔧The shortlist weighs every signal

    The motifs the filing model chooses among for a new claim were picked by six likenesses from one embedding model. They're now picked by every signal of the filing experiments (keywords, the note alone, the claim's bare shape and its layers, its nearest filed claims, a second embedding model, the person's groups, the news taken out), weighed on the person's confirmed claims and retrained daily. Held out, 83.9% of the person's motifs are in the top 12, against 79.8% before: about one more of their motifs in every twenty reaches the filing model. It's used only while its daily test beats the plain weighing. Each new claim costs two more questions of the filing model (its bare shape, its layers), asked once and kept.

  10. 🧩🔧The reranker taught the person's taste, in production

    Experiment E9 (docs/filing-experiments.md) found the cross-encoder, its top six layers trained on the person's decisions, judged held-out claims better (AUC 0.765 to 0.796). Weekly at night it is taught again on the CPU, in a process of its own: three models that each leave a third of the claims out give every decision an honest score for training the confidence model (a reranker that learned those very decisions would look better on them than it is), then one model learns from them all and scores new filings. The confidence model retrains whenever a newly taught reranker appears; each reranker's scores are kept apart.

  11. 📏🔧Embeddings on the CPU

    Ollama's log showed the card spending about nine minutes an hour loading models: each embedding model (mxbai, nomic) loaded beside the filing model pushed it out of the card's memory, and it was loaded again a moment later (242 times in six hours). Embeddings now run on the CPU (24 cores: 27 texts a second for mxbai, 61 for nomic), so the filing model stays on the card.

  12. 🎙️🔧Shows' own transcripts before Whisper

    Seven of the 66 podcast and call-in feeds publish a transcript of each episode in the feed itself (Podcasting 2.0's podcast:transcript: Breaking Points, Verdict with Ted Cruz, Clay Travis & Buck Sexton, the Jesse Kelly and Michael Berry shows, Bloomberg News Now, Jubilee's Surrounded; mostly iHeart's, timed WebVTT with speakers). Those episodes are now taken from the show: their cues joined into each speaker's sentences, the speaker kept, sponsor reads trimmed as before. No GPU, so they come in even when the model holds it, and Whisper's ten minutes an hour go to the shows that publish nothing.

  13. 🧩🆕The proposer suggests new motifs

    The person expects to need many more motifs and wants the model to propose them. Claims that fit nowhere (no motif, but those the person said tell no story; or filed weakly with nothing better on offer) are each read as the bare shape of its story; where shapes cluster, two or more claims telling one story, the model sees them with the five nearest motifs and, reading as a folklorist would, either names a new motif (a terse label, a scope note in the tellers' terms, its genre, the claims that are of it) or says a motif covers them already. One 💡 proposal per new motif; approving makes it with its note and genre and files its claims, in one undoable step. A single claim isn't a story told again, so it isn't proposed (the nightly filing still names those).

  14. 🧩🆕The proposer suggests new groups

    On the person's ask ("can it run cluster analysis?"), the nightly proposer clusters their done motifs by what each covers (name and scope note: with their claims, motifs clustered by the week's topics, a plane scare with a Reddit sleuthing motif), keeps the tight clusters of 3 to 12 that no group already mostly holds, and asks the model whether each is a family of stories the way their groups are; if so it names it in their groups' style and leaves out what doesn't belong. One 💡 proposal per family; approving it makes the group with its motifs in one undoable step. A family the model turns down is asked again only once its motifs change.

  15. 🧩🔧Fact-check claims read from the piece, not the headline

    The person often opened a fact-check to see what was actually claimed, so their filing rested on more than the one line the models saw. Each fact-check's own text is now kept (app/analysis/factcheck_text.py): from the feed where it carries the whole piece (PolitiFact, FactCheck.org, Lead Stories, NewsGuard), otherwise read from the page, 20 seconds apart per site, at most 24 pages a run, robots.txt obeyed. The labeler reads the piece's opening and gives the claim as its tellers state it, who says it and where, plus two or three sentences of what the piece shows; the person's own corrections of claims (46 so far) are shown to it as examples. A claim already filed keeps its wording (the reading from the piece is kept beside it), so nothing filed changes under the person. The checker's 'where it came from' shows the piece's reading and its opening.

  16. 🎙️🐛Five podcasts' episodes were being dropped since Oct 4; six video channels had moved

    A health check of the side feeds found The Daily, the Brian Lehrer Show, the Megyn Kelly Show, WSJ What's News and NBC's Top Story with nothing new in four days: their feeds had begun giving every episode the show's own page as its link, so each new episode looked already stored. An episode whose link another shares is now told apart by its guid. The YouTube feeds of the Young Turks, Timcast IRL, Benny Johnson, Matt Walsh, Candace Owens and Destiny pointed at channels gone quiet (some for a year); each now follows the channel its handle names. Dan Bongino's and Flagrant's channels have posted nothing since 2025 and early 2024: dropped, their podcasts carry them. The 145 outlets' front pages and every hourly run of the last day were fine. So it doesn't happen silently again, each hourly run now checks that every outlet was seen on its front page in the last six hours and that every feed that posts regularly has something new within four times its usual gap (three days at least), and that no feed is stuck with a handful of items; what isn't is a warning in the log and a 🩺 box on the checker's 📊 tab (app/health.py).

  17. 🧩🔧Weak fits come with where else they might go

    The person's time is better spent correcting weak filings than hunting for motifs: for each claim with a filing the confidence model gives under 50% (one nobody has checked, or one they confirmed that's up for a second look), the hourly run scores the twelve of their motifs the shortlist ranks highest that the claim isn't in, and keeps the best three from 30% up. The checker shows them under the claim ("might fit better") and under each second-look row: + files it there too, ✕ says it isn't that motif (never suggested again).

  18. 📰🔧Top stories as full cards again

    The front page's nine top stories (ranked as before) are the stories page's own cards again, every outlet's headline on each, the lighter cards of Oct 6 having read as boring. Each keeps a bar of who carries it by lean, now in five bands (left, leans left, center, leans right, right, plus unrated) instead of three, so a story carried by the far left reads apart from one carried by the center-left.

  19. 🧩🔧Folklore and Rumors are one page

    Folklore and rumors (folklore.html) is now one catalog of what's told, from three places, each marked on its card and filterable: retold online (Bluesky and Mastodon, as before), told on the shows (a claim told on two or more of the shows we transcribe, or by two or more callers: which shows, how many callers, the tellings by the shows' lean; never the quotes or who called), and fact-checked (the old Rumors page; a check already linked from a narrative's card isn't repeated). The model's built-in genre (conspiracy theory, contemporary legend…) is gone from the cards: a card's genres are now those a person gave the motifs it's filed under. rumors.html sends visitors to the fact-checks.

🗓️ Oct 7

  1. 🧩🔧Claims from the shows we transcribe

    What people post (Bluesky and Mastodon) leans left, so the folklore page heard little of what's told on the right. Every podcast, call-in show and video show we transcribe (about 400 episodes a week: 157 right, 132 center, 105 left) is now read for the claims told on it, by the same model and checks as the focus groups: each claim's quote must be in the transcript and support it, and each says who told it (host, guest, caller, a played clip). A claim reaches the motif index only once it's told on two shows or by two callers: one host's take isn't folklore; told again elsewhere, it is. Quotes and callers stay off the site.

  2. 🧩🔧A better shortlist for filing claims

    Filing a claim, the model chooses among the motifs most like it; when the motif a person would have chosen wasn't among them, they added it by hand (over 200 times). The shortlist was the 8 closest by one measure. Now several measures of likeness (the motif's description, its nearest claim, the center of its claims, its size, its neighbours in the kind-of tree) are weighed by a small model trained each day on the person's own confirmed filings, and a shortlisted motif brings its broader motif and its kinds along (about 12 shown). Re-filing all 372 confirmed claims, each kept out of what it was tested against: the model found 375 of the 763 motifs the person had them in (322 before), 47 of the 206 they had added by hand (33), with no more picks the person had taken out (16 both ways).

  3. 🧩🔧Proposals sorted by how likely they're approved

    About half the model's kind-of and related proposals were rejected. A second read by the same model, asked how likely the person was to accept each one, was little help alone: it gave most approved and rejected proposals the same 2 or 3 (and a first prompt that called the person strict rejected nearly everything). Weighed together with plain facts about the two motifs by a small model trained on the person's 144 decisions, it does better: tested on decisions it hadn't seen, the least likely tenth of the approved marked a line below which fell 29 of 65 rejected. The checklist is sorted by that chance, and those below the line are folded at the bottom, ticked, for the person to skim and reject at once; nothing is hidden.

  4. 🧩🔧The public motif map looks like the working one

    The site's map was drawn once (Oct 6) and missed a day of layout work on the checker's map. Both now draw through one script (static/motif-map-layout.js): each group placed on a ring of its own, links out of a group pulling weakly, a group drawn as a blob around its members with non-members kept out, a dot's fill its genre and its outline its place in the kinds, and one color per group and genre on every page. The site shows genres only once a checked motif has one. Editing stays on the checker.

  5. 🧩🔧A motif a person made and wrote a note for is done

    Marking it done was a second step after writing the note, and 92 motifs the person had made (or renamed) and described sat unmarked, off the site. Now saving a note of theirs (or keeping the model's draft) on such a motif marks it done, with the claims it holds then; one they unmark stays unmarked. The 92 were marked done: 332 motifs on the site, 741 claims (each claim still read for named accusations first). A model's motif with no person's name on it still waits for a person.

  6. 🧩🔧A merge keeps everything

    Merging one motif into another moved its claims, related links and kinds, but lost its own broader motifs, its groups, its genre, its note and the person's "not the same" verdicts, and its claims seen when it was marked done showed as new again. Now all of it comes along (a broader motif only where it can't make the motif a kind of itself; the note and genre only where the motif kept has none).

  7. 🧩🔧A claim a person checked counts as seen

    A motif reaches the site once a person marks it done, with the claims it held then; claims filed since waited, marked new, until it was marked done again, even ones the person had checked ✓ one by one in the meantime. A claim checked ✓ or filed by hand now counts as seen: no longer new, and shown with its motif. The model's own filings since still wait. 554 claims show on the site instead of 431; motifs marked new went from 99 to 34. (The checker's organizer and singles pages were dropped too; the workbench does their work.)

  8. 🧩🔧A correction proposer for the motif index

    gemma4:26b reads over the motifs and proposes small fixes, each one change a person approves or rejects in the workbench's 💡 proposals checklist: a typo in a name or scope note (only a small edit counts, not a rewrite), one motif a kind of another, two related, two the same motif (merge), a motif into one of the person's groups. Candidates are found cheaply first (motifs alike in meaning, motifs sharing a claim, motifs near a group's members) and only those put to the model. Approving runs the person's own action (logged, undoable); a decision is kept, so a rejected proposal never comes back, and one overtaken by hand drops out. It runs once a day from the 5 AM hourly run on (never in the run that makes the narrative report, which nears its 45-minute limit), at most eight minutes, going on in the next run if cut short. The model's own "no" and its typo reading are kept with a mark of the motifs as they were (name, note, about how many claims), so a motif that changes is looked at again. It also reviews the links already made (related, kind of): one the model calls unrelated comes up as a proposal to take it away, and one it keeps isn't read again until either motif changes.

  9. 🧩🗑️No more villain

    The folklore labeller named who each narrative casts as the villain (Propp's part), and its picks were too often wrong to show. It no longer asks, and the Folklore page, the checker and the reports leave the part out, old reports included; the victim and the hero stay. Fact-checks' labels still carry a villain field, unused and never shown (rewording that prompt would relabel every fact-check and the claims filed from them).

  10. 🗞️🔧A story back on the front pages stays one story

    A news cluster continues the saved story that holds most of its headlines; one that left the front pages and came back hours later under fresh headlines shared none, and became a new story. The physics Nobel was on one noon run on Oct 6, gone, and back at 5 PM as a second story: a saga of two near-identical parts. Now a cluster that continues no story is compared with the stories that left the front pages in the last 48 hours; one sharing two of its frequent words is put to gemma4:26b: the same news event told again, or a different one (the next game of a series, a new ruling, an arrest after a crime)? The same event continues the old story. On the 42 pairs the rule would have asked about in the week before, it joined only the Nobel pair (the first wording refused it over one stray headline about the medicine prize; it now goes by most headlines). The two Nobel stories were merged by hand; a merged story's page redirects to the one kept, and TV, radio and narrative links to it follow.

  11. 🧩🔧Narratives linked to news stories by the bigger model

    Which front-page story a retold narrative is about (its card on Folklore, and where it shows on story and saga pages) was asked of qwen3:8b, which put a retold accusation against a YouTuber on the Cornell rape case and the threats against the Cornell accuser on a different part of the saga. Asked again of gemma4:26b, the 346 links it had made differed on 42; read by hand, Gemma was right on about 25 of them and the small model on about 11, and Gemma joined fewer wrongly (5 to 7) and missed far fewer (3 to about 20). From tonight's report on; earlier reports keep their links.

🗓️ Oct 6

  1. 🧩🔧Named people accused of crimes

    An outside reader found the motif index, a story page and a saga page showing a claim retold by eight people online that accused a named YouTuber of a serious crime: an unverified accusation against someone who holds no public office. (This entry named him and quoted it until Nov 12; we don't want to add to a pile-on.) Now every claim the site shows from people online or from voters (motifs, folklore, story and saga pages) is first read by gemma4:26b: does it say a person it names committed a crime or abuse? Officials, candidates and household names stay named, and so does anyone our outlets' front-page headlines have named in three or more articles (the model didn't know Howard Lutnick is in the cabinet). Anyone else is replaced by who they are ("A YouTuber is a rapist…"), and their posts, cast and earlier tellings aren't shown with it; a claim whose name can't be swapped out cleanly, or that hasn't been read yet, isn't shown. Fact-checkers' claims are shown as written. Two hand-kept lists override the model: names never shown (never_named.json) and names always shown (always_named.json). Story and saga pages also show a claim found twice in one night's report, in nearly the same words, once.

  2. 📰🔧A lighter front page

    The front page had become a dashboard, a corpus and a reader at once (an outside reader counted 36 links on one story card). The story cards, every outlet's headline on each, moved to their own page, Every story (stories.html). The front page keeps the cloud and puts the nine hottest stories (ranked as before) in short cards, each with three things: how its coverage spreads across the lean scale, one framing contrast (a phrase only one side uses, skipping phrases made only of the story's title words, or the most-quoted phrase), and one sign from beyond the front pages (TV, radio, people retelling it, a fact-check). Sagas follow, then the trend boxes. Each saga has a page of its own (saga-.html) following it across its parts.

  3. 🗞️🗑️Sagas: no more joining by persistence

    An outside reader found three sagas holding a part from another storyline. All three were the old judge's yeses, and one shows the flaw: the Supreme Court climate case and an overview of the court's new term were judged separate 25 times, then joined on the 26th, because each hour the stories had new headlines, so a new sample to ask about, and one yes was kept for good. Now a verdict is kept for the pair of stories (saga_pairs.json) and never asked again; the judge sees each story's most central headlines, not ones spread evenly across it (stray headlines from a neighbouring storyline had stood in for a story); and a newcomer is judged against the saga's part nearest to it. The judge's wording now says that different angles on one event, its consequences and reactions are one story, and that a different focus is no reason for "separate": on the 46 labeled pairs it found 7 of the 11 true running stories (5 before) and still joined none wrongly. The three wrong parts were detached (the Nebraska rally from the diesel order, the court's new term from the climate case, two Iranians charged over a plot against Jews from the RAF Fairford bombers story); two sagas ended. A check of every saga against this judge would also have split four borderline ones (Alito's two stories, the Saudi-Houthi fighting, Paxton's campaign, measles in two states) and one clear one (two headlines on one Ohio rally); those were left as they are, for a person to judge.

  4. 🧩🔧Each narrative keeps all its posts

    The nightly report now keeps the private keys of every post in each narrative, not only ten sample texts, so a person checking a claim sees everything it was found in. The texts stay in the post store under its 30-day limit (a deleted post is gone from it too); the reports of Oct 4-6 had their keys rebuilt by grouping their posts again (361 of 367 narratives matched).

  5. 🎙️🔧Jubilee's Surrounded, transcribed

    Jubilee's weekly Surrounded (one guest against 20-25 people who disagree with them) joins The Focus Group and the call-ins as ordinary people speaking for themselves: archived from its podcast feed and transcribed on our GPU in the same tier, for research. Its Middle Ground has no audio feed, and its YouTube feed is now mostly short clips of its commentary show, so neither is followed.

  6. 📰🔧The nav follows a story downstream

    Two links (every story, sagas) and four menus in the order a story travels: 📰 front pages (every headline, outlets, headline changes, emotions, who's in the news, the Supreme Court, the archive), 📡 on air (TV, radio, shows and newsletters), 🧶 online (folklore, rumors, the motif index) and 🛠️ how it works (now with the methods log, which wasn't in the nav). The old grab-bag "trackers" menu is gone.

  7. 🧩🔧Scope-note drafts by Gemma 4 26B

    A motif's draft note is now written by gemma4:26b, not qwen3:30b-a3b, after drafting notes for the 49 motifs whose notes the person wrote and comparing them with theirs: Gemma's were closer in meaning (0.73 against 0.71) and told the kind of story where the 30B restated a single claim, and the 30B gave up on 10. A draft that opens with the motif's own name ("Breaking ranks occurs when...", half of Gemma's) is asked again.

  8. 🧩🔧Narrative threads judged by Gemma 4 26B

    Whether a narrative told today is one told on an earlier day is now asked of gemma4:26b, not qwen3:30b-a3b, after a test on the 32 pairs the live code had asked about (labeled by Claude): Gemma found 18 of 21 retellings in both runs and wrongly joined 1 of 9; the 30B found 15 and 17, missing plain repeats (the same Nobel prize, Sánchez's snap election). The threads were rebuilt from the three daily reports with it: 17 narratives told on two or more days (was 16).

  9. 🧩🆕New motif names matched more often to the motifs already there

    When the filing judge names a new motif, its name is first checked against existing ones, but only those at least 0.7 alike by meaning were offered to the model. Tested against the person's merges: the motif a duplicate was later merged into reached the model for only 7 of 31. At 0.6 it reaches it for 20, and the model found 14 (against 7), joining 2 of 26 pairs the person had said were not the same (against 1 of 11). The floor is now 0.6; the model stays (gemma4:26b, gemma4:12b and qwen3:8b did no better).

  10. 🧩🆕Widely seen Bluesky posts, embedded

    Until now no post was ever shown, only the model's summary of what a narrative's posts share. Now each narrative can show up to two of its own Bluesky posts that were already widely seen: 25+ likes, reposts, quotes and replies together, or 3+ from an account with 5,000+ followers (Bluesky gives no view counts). They're embedded with Bluesky's own embed, never copied, so a post its author deletes disappears from our pages, and shown posts are looked up again every six hours. Never shown: anyone who has asked Bluesky not to show their posts to logged-out visitors (one in five of the posts in a test sample), accounts labeled bots, posts or accounts with a moderation label, and anything from Mastodon. To do this the sampler now keeps each Bluesky post's address (at://...) with its text, under the same 30-day limit; the nightly report keeps the 20 posts closest to each narrative's claim; each hourly build looks a few batches up on Bluesky's public API (at most 8 calls, 10 s apart). The thresholds are a first guess, to check against the first nights' counts.

  11. 🗞️🔧Story pages: a week of retellings, later fact-checks, and voters

    A story page showed retellings only from the latest nightly report, tied by the story's label (which gets reworded), and fact-checks only if they were found while the story was on a front-page card: 3 of 160 pages had any. Now each day's last report of the week is read; its story links are tied by id (saved from Oct 6 on), or by the same label, or by the label of the story around then that shares at least half its words; a narrative told on several days shows once, on its latest day (51 stories have retellings, up from 37). Fact-checks are matched for every story of the week at build time, in their own cache, so one that came after the story left the front page still appears. And a new card, "the same shape, told by voters", lists what Focus Group voters told that's filed under the same verified motifs as the story's retellings, in our words, with the episode: the first place motifs connect a story to other material.

  12. 🧩🆕The motif index can be exported

    The workbench's 📦 export (and scripts/export_motifs.py) writes the index as a readable catalog (Markdown), a spreadsheet (a row per claim), JSON, or SKOS in Turtle for the planned mapping to prior catalogs (docs/motif-catalogs.md). By default only verified motifs, with the claims they held when verified and only a person's notes, the same as the site; "everything" adds unverified motifs and marks draft notes.

  13. 📰🔧One-sided wording: the story's own words don't count

    "Only the right says 'bakker dead'" was on the front page while the left wrote "Bakker dies": a phrase one side used, but not a framing. A phrase now counts only if at least one of its words (stemmed, with dead/death/dies folded together) never appears in the other side's headlines on the story. On three days of stories this dropped 39 of 101 phrases, mostly vocabulary ("federal judge", "former rep", "terror plot" against "terrorism plot"); "killed" and "died" are kept apart, since that choice is framing.

  14. 📰🔧Word cloud: no made-up words

    The cloud folds plurals to their singular, and the folding turned "dies" into "dy" (WordNet's -ies rule), so on Oct 6 a word "dy" gathered every death story of the day (Jim Bakker, Dennis Hastert, the Kenya Ebola case). Now the cloud picks nouns before folding, never folds to a word of two letters or fewer, leaves words in -ics alone, and drops "dies". On the day's 10,477 headlines this also took out verbs that had passed as nouns ("calls", "plans", "vows", "warns") and two more mangled words ("leaves" as "leaf", "discusses" as "discus"); the top 25 words didn't change. Also: the top word is sized against the runner-up, not the smallest word, so it no longer dwarfs the cloud, and on a phone it's no longer dropped for lack of room.

  15. 🧩🔧One claim, told several ways

    A person can now say two claims in the motif index are the same claim: the one folds into the other in every motif either was in, its words kept as a variant of the kept claim, and a later telling in exactly those words is filed as the kept claim, not as a new one. A motif's claim count then counts claims, not wordings.

  16. 🏢🔧Outlet chips: the face is the headline's feeling

    Each outlet's chip on a story card showed 😠 for any headline whose mood was below zero, a leftover from the 2024 site, so nearly every chip looked angry, even on obituaries whose headlines were mostly sad. It now shows the headline's own strongest feeling (😱 fear, 🤬 anger, 😭 sadness…; none when neutral). Its mood is compared with the other outlets' headlines on the story (it had included itself), and when they agree the tooltip says "same mood as the other outlets" instead of "+0.00". Most outlets do agree: mood is a five-step scale, and the same event usually gets the same step. Found by an outside reader.

  17. 🧩🔧Only verified motifs on the site

    The motif index grows with the model's filings, but the site now shows a motif only once a person has looked over its claims and marked it done, and shows only the claims they saw then; claims filed since wait until they mark it done again. Unchecked motifs stay in the index and in the curation tools. On Oct 6, 234 of 261 motifs had been marked done.

  18. 🗞️🔧Sagas: the judge is Gemma 4 26B

    On 46 pairs of stories labeled by hand (11 of them one running story), it agreed on 40, joined none wrongly and took 2 seconds a pair; Qwen3 30B-A3B agreed on 41 but joined one pair wrongly and took 33 seconds. Gemma finds a few fewer true parts (5 of the 11 against 7), so a saga may gain a part an hour or two later than before, but a wrong join, the kind a person has had to veto, is rarer. Verdicts already cached are kept.

  19. 🎙️🔧Focus Group: a claim must be what its quote says

    Since Oct 5 a voter claim's quote had to be in the transcript, but nothing checked that the quote said the claim: "Politicians cheat on their spouses but still get elected" was kept with a quote about politicians telling you what you want to hear, and filed in the motif index. Now Gemma 4 26B is asked whether the quote is evidence for the claim (the voter says it, or a central part of it, in any words), and a claim it isn't evidence for is dropped (kept on record with the reason). A first wording ("does it support the claim as worded?") passed only 6 of 16 sound claims; the one in use passed 14 of 16, turning down two that added what the voter didn't say, and still caught the bad ones. Claims read before were checked the same way, in the wording a person had corrected them to: 26 of 231 were dropped (one said a voter praised a governor the voter had said was "not my favorite") and taken out of the motif index.

  20. 🎙️🐛Transcripts: names Whisper mishears

    35 of 46 mentions of AIPAC in our podcast and Focus Group transcripts had come out as "APEC" or "APAC", and Hegseth and Whatley were misspelled too. Whisper now gets a list of names and terms to expect (fixed ones such as AIPAC, Hegseth, MSNOW, and the 50 most-named people and groups in recent stories), and known mishearings are corrected after transcription, sentence by sentence and only where it's safe: APEC is left alone in a sentence about the Asia-Pacific summit, and "a PAC" is never touched. The same corrections were applied to the transcripts already made (14 changed) and to the Focus Group claims drawn from them (10), five of which were already in the motif index and were corrected there through its record of corrected wording.

  21. 🎙️🔧Focus Group and radio running order on Gemma 4 26B

    Each tested on its own work: on 10 newscasts, Gemma's stories passed the first-words check 96% of the time (Qwen3 30B-A3B 81%) with nearly the same front-page picks; on 12 Focus Group transcript parts every model's quotes were found in the transcript, but Gemma's claims were the voters' own, each with the voter's side, where Qwen3 30B-A3B took a host's analysis for a voter's.

  22. 🗞️🔧Story pages: following a story downstream

    Every saved story seen in the last week has a page, and its card on the front page links to it. The page follows the story as it spread and changed: the first front page to carry it (a headline first seen before the story began is left out: it joined later), its peak, its first minute on TV and on the radio, the day people were found retelling it; then the front pages over time with the aggregators linking it, the phrases outlets quoted and the wording only one side used; TV minutes by channel and the captions; the radio newscasts and its place in each; the shows, investigators and satire on it; what people retell and the names in it; the fact-checks; and the saga it belongs to. Each run's findings around a story are kept (story_extras.json), so its page keeps them after it leaves the front page. Every link is made by our tools and can be wrong. Charts: how many front pages carried it at each hourly run, by lean (an outlet counts while one of its headlines on the story was on its front page, within half an hour of the run); and who carried it when, a bar per headline from when we first saw it to when we last did, with its TV captions, radio newscasts and the day it was retold online beneath.

  23. 🎙️🔧TV and radio on the story cards

    Each card shows its minutes on screen on each news channel and the hourly newscasts that carried it in the last day (and how many led with it).

  24. 🎙️🆕On TV

    The captions along the bottom of the screen (chyrons) on CNN, Fox News, MSNOW and BBC News, as the Internet Archive's TV News Archive reads them by OCR about once a minute (its "Third Eye" service, running since 2017), with how many seconds each stayed up. One request a run; each day is kept as sent. The OCR is noisy ("NICOI I E WAL ACE DRECENTS" for the program title Nicolle Wallace Presents), and a line often runs a headline and a guest's name together, so lines are split, the clock and logos set aside, near-identical lines grouped, and a local model (Gemma 4 12B) says what each is (headline, name, promo, ad, junk) and corrects headlines and names for OCR errors only, with the program and the day's story labels as context. On a test batch Gemma 4 12B invented nothing; Gemma 4 26B "corrected" a steel plant in Iowa to Ohio and Qwen3 8B kept garbled promos as headlines. Each headline is matched by meaning to the stories on the front pages at the nearest run; the page shows each story's minutes on each channel beside its front-page rank, and each hour's longest-running captions.

  25. 🧩🔧Motif filing upgraded

    Claims are now filed by Gemma 4 26B judging the 8 closest motifs side by side (each by its name, scope note and three of its claims): which of them, none to three, is the claim clearly an instance of? Only when none fits is it asked, separately, whether the claim tells a recurring story worth a new motif; a plain report gets none. Tested on 60 of a person's settled filings, each held out: the old method (pick or name from the 15 closest, Qwen3 30B-A3B) chose their motif for 37%; the new one 53% on the current index (65% on the bake-off's candidates, with 66% of its picks theirs). Asking for a new name in the same call as the judging cost several points, so the two are separate questions. Which model does which job, and how each was tested: docs/models.md.

🗓️ Oct 5

  1. 🧩🔧Choosing motifs, tested against a person's own filings

    The 160 claims a person had settled on the motif board (each held out of the index in turn) were filed by the live method (the 15 closest motifs by name and claims, one pick-or-name call to Qwen3 30B-A3B) and by a new one (three de-named "shapes" per claim, candidates found by shape, a yes/no check on each of six). The live method picked the person's motif for 37% of claims, 52% of its picks theirs; the new one 47%, but only 28% of its picks theirs. Finding candidates by shape was the weak part: the person's motif was among the 6 closest by shape for 58% of claims, by the claim's own words 74% (82% of the closest 10). Shapes stay out. A third design, the 8 closest motifs by the claim's words judged side by side in one call ("which of these, none to three, is the claim clearly an instance of?"), was then run with seven local models on 60 of the claims (the person's motif among the 8 for 46 of them, so 77% at most): gpt-oss 120B picked it for 62% (56% of its picks the person's; 29 s a claim), Qwen3.5 9B 60% (48%; 1 s), Qwen3.5 35B 58% (50%; 3 s), Gemma 4 12B 58% (46%; 2 s), Gemma 4 26B 57% (54%; 2.4 s), Qwen3 8B 53% (42%), and the live Qwen3 30B-A3B 52% (52%; 4.6 s). Differences of a few points are within what 60 claims can tell apart; every model beat the live method's 37%. Qwen3.5 under Ollama returned an empty list whenever the schema asked for a list of fixed strings, so its answers are asked for as numbers.

  2. 🧩🔧A claim may have no motif

    Until now a claim whose last motif a person removed was filed again next run, and the model was asked for one to three motifs per claim, so claims that only report an event were forced into one. Now the model may give none ("a claim that only reports an event or states a fact, with no story told around it, gets none"), a claim whose last motif a person removes keeps none and isn't filed again, and on the motif board a person can mark a claim "no motif: not a story", which takes it out of every motif for good.

  3. 📏🔧Thresholds rechecked on the bigger embedding model (mxbai-embed-large)

    Three measures still matched headlines with the small static model (potion-base-8M) at thresholds set by eye. Each was tested on the day's data:

    • Sagas: 118 pairs of saved stories sharing a name, judged by the 30B ("one running story?"): 8 were. Both models separate them equally well (AUC 0.965 and 0.963), so sagas stay on potion; the gate to the judge drops from 0.58 to 0.54, which lets all 8 through instead of 6 (20 questions to the judge instead of 17).
    • Wire share: of a week's 339 outlet headlines sharing 70% of their words with an AP or Reuters headline, all of them copies when read, potion at 0.9 kept 258 (dropping copies such as "White Sox beat Guardians 3-0 in Game 1 of ALDS"); mxbai at 0.85 keeps all 339. Now on mxbai at 0.85, after the word rule: 242 copies in the week's news headlines instead of 201.
    • Curators: 200 aggregator headlines (Google News, Drudge, RCP, Political Wire), each with its closest saved story, judged by the 30B ("same event?"): potion at 0.7 made 60 links, 46 right; mxbai at 0.8 makes 75, 60 right. The judge was strict (it called "Rasmussen no-hits Yankees… Rays win ALDS opener" a different event from the Rays' ALDS opener), so both are better than these numbers. If Ollama can't embed, wire share and curators fall back to potion at their old thresholds.
  4. 🧩🔧Narratives across days

    A narrative in one day's report (posts by many people telling one thing) is now compared with the narratives of the last 14 days: the three closest by meaning (mxbai, at least 0.7) are put to the bigger local model (Qwen3 30B-A3B), which says whether it is the same narrative told again (the same claim about the same people or event) or a different one. Linked days make a thread; Folklore cards show the earlier days a narrative was told and by how many people. The first two days (Oct 4, a six-hour report, and Oct 5) gave 3 threads out of 7 questions: the Nantucket air-ambulance search, Saquon Barkley's injury and a disputed Bills call.

  5. 🎙️🆕On the radio (#159)

    The hourly newscasts of NPR (NPR News Now) and ABC News (ABC News Update), which we already transcribe, are now split into their stories in the order they aired. The bigger local model (Qwen3 30B-A3B) reads each transcript with the list of the 40 stories most outlets had on their front pages at the nearest run, writes a short headline for each newscast story, and says which front-page story it is, if any (the same event, not the same topic). Splitting at reporters' sign-offs alone missed anchor-read items. ABC's ad wrapper (a promo before the anchor's "ABC News, I'm ...", a sponsor read after "This is ABC News") is cut off by that pattern first: the model's own ad calls were unsteady. A story is kept only if its first words occur in the transcript after the previous story's (once the model copied the front-page list as a newscast, reusing one real opening for all of them), and a story told twice is kept where it first aired. The page sets each hour's newscasts beside the front pages' biggest stories and counts how often a newscast led with their biggest one. Newscasts from before Oct 4, 13:05 UTC have no front-page snapshot to compare with and are left out.

  6. 🧩🔧Rumors stated the way their tellers state them

    The one-line summary of a fact-checked claim sometimes stated the fact-checker's correction instead of the rumor ("the video shows Muslim women queuing for a clothing sale, not free childcare"); 10 of the 80 in the motif index read that way, so motifs filed from them described the debunking, not the story. The summarizer is now told to state what the rumor's spreaders say is true, never the correction, and those claims were rewritten ("a video shows Muslim women queuing for free childcare"). Motif names follow the same rule: the story as told ("Caught on camera"), not the verdict ("Historical footage misattribution"); analysts' words like "narrative" and "controversy" were dropped from names.

  7. 📏🔧Hand labels

    A headline checked by hand on our label-check page now carries the person's mood, loaded-wording and feelings labels in every measure (the model's where the person agreed), marked as hand labels so no rescore replaces them. Only a few dozen headlines, chosen evenly across the model's labels; they also measure the model: of the first 19, mood matched 11 (16 within one step, 1 opposite sign), loaded wording 14 (18 within one), feelings 12. Of the 7 checked since the Oct 4 rescore: mood 5, loaded wording 6, feelings 7.

  8. 🧩🔧Motifs reused, and checked by hand

    Named one claim at a time without seeing the index, nearly every motif was a one-off (223 of 259 held a single claim), and the same name was coined as separate entries ("Blame shifting" four times; now merged). Now the model sees the 15 motifs closest to a claim before naming it, files it under one that fits, and coins a new name only for a shape none of them covers; a new name already in the index, word for word, is that motif. Re-filing 20 claims on a copy of the index, 17 found an existing motif (the old way, 1 of 12), though some fits are loose while the index's names are young. A person checks filings one by one ("is this claim an instance of this motif?"); a no takes the claim out of that motif for good.

  9. 🧩🔧Motifs for political news, and cleaner names

    Folklore groups that are news reports or shared reactions got no motif, but news is powerful when it confirms a story people already tell (a Russian lab worker's plague death, retold as a bioweapon): political news is now filed in the motif index too. Non-political news, sports picks and shared topics aren't (a WNBA semifinal "prophecy" had become "Valkyries to defeat Aces"). Motif names over seven words are dropped: the model sometimes gave the claim's own sentence, or echoed its instructions, as a name. 25 such entries were removed from the index (10 from sports and moods, 15 sentence names), and their claims refiled where they had no other motif.

  10. 🗞️🔧Names merged on the "mentioned:" filters

    The model names one subject several ways (Trump / Donald Trump, GOP / Republican Party, Supreme Court / Supreme Court of the United States); names now pass through aliases to one name, seeded for the common cases and curated by hand.

  11. 🗞️🔧A saga taken apart by hand, and a saga tracker

    The 8B judge had joined an Energy Department employee's arrest for aiding the Houthis with the Yemeni offensive against them ("Yemen-Houthi military conflict"); the 30B keeps them apart, and saved sagas never come apart on their own, so it was taken apart by hand (as the Iran plot saga was on Oct 4). A new Sagas tracker lists every saga kept, with each part's time on the front pages.

  12. 🗞️🔧Sagas: a looser name rule and a bigger judge

    Two stories could become parts of one saga only if a name rare on the day was in 30% of both stories' headlines; the RAF Fairford bail story and the bombers-pulled-from-Fairford story (0.67 alike) never qualified, since "Fairford" was in 42% of one and 10% of the other. Now 30% of one and 10% of the other is enough to ask the judge (6 more pairs over the week's 91 stories). The judge moves from the 8B, which called the Fairford pair "related cases but different outcomes", to the 30B. Two fixes were needed before it could be trusted. Cut off mid-reason, or answering a bare true/false, it said no after reasoning its way to "the same developing story" (Cornell); it now finishes its reason and answers in words. And the second wording asked about a story "followed over time", which two groups on the same development aren't (it called FlyDubai "redundant"); it now counts the same development and later developments alike. On 14 hand-labeled pairs, 13 agree; the 14th (an Energy Department arrest and the Yemen campaign, which the 8B had joined) it keeps apart, which we think is right. Sagas already saved don't come apart. First new sagas: the Fairford plot, and Alito's remarks (retirement, intimidation of the Court).

  13. 🏢🔧Reuters and AP titles lose Google's source tag

    We read both through Google News, which tags each title with the outlet; we removed the tag as a name (" - AP News") but Google has lately tagged by domain as well (" - apnews.com", " - reuters.com"), switching back and forth for the same article: 306 of the 364 Reuters and AP articles stored with more than one title in the last three days differed only by the tag (all but 8 were already ignored as minor rewrites). Both forms are now removed as headlines come in. The tag had made "AP News" a name in AP's stories on the "mentioned:" filters; names are now checked against headlines without it.

  14. 📰🔧Quotes inside one another count once

    Outlets often cut the same quote differently ("Bad Things", "world should accept some bad things", "We Should Accept Some Bad Things Happening For The Benefits"); as separate chips they filled a story card with one quote and pushed other quotes past the four-chip limit (7 of 28 cards with quotes this morning). A quoted phrase that sits inside another, whole words, now joins it: one chip counting every outlet that used any of the wordings, shown as the wording most of them used (the longer on a tie), the others in its tooltip.

  15. 🗞️🔧Stories by who and what they name

    The local model names the people, countries, places, organizations and groups each current story is about (up to six, by their common short names, remembered per story). A name is kept only if the story's headlines actually contain it (asked about an OPEC+ story, the model added Russia, Iran and Iraq), and the United States is left out (nearly every story is about it). Names in two or more current stories become "about:" filters over the story cards (renamed "mentioned:" the same day: often a story only mentions the name). Not sagas: these are unrelated stories that name the same subject.

  16. 🧩🔧Our own motif index replaces Thompson's chapters

    Thompson's Motif-Index is built from folktales and fits modern political rumor poorly, so the site no longer shows it. Instead we build our own: each folklore narrative and each fact-checked claim gets one to three motif names from the model (reusable framings, no names or dates, two-sided when contested), and each is filed under the closest existing entry the model judges the same shape (candidates at 0.7+ similarity, forced choice with "new"), or starts a new entry (M001, M002…). The naming and matching go to the bigger local model (qwen3:30b-a3b); a person merges, renames and deletes entries in an organizer on the label-check page, which suggests merges by name similarity. First fills, with the 8B and one motif per claim: at 0.6 vague early entries snowballed (one took 16 unrelated claims); at 0.76 almost nothing merged (111 motifs from 115 claims), and the 8B still made absurd matches (a tax-vote claim filed with a harassment story). Folklore, Rumors and the Motif index now share their own "folklore" menu.

  17. 🛠️🐛Gap: no runs from 3:04 to 7:10 AM Eastern

    The desktop's idle timer suspended the machine during the 3 AM run's GPU transcription (which had grown to its full 10 minutes with the new call-in and podcast feeds); it never resumed, so the 4, 5 and 6 AM runs and the nightly folklore report were lost until a cold boot at 7:10. Headlines live on front pages only during those hours are missing. Fix: each run holds the desktop's sleep lock until it's done, and a missed nightly report is made up by the next run after 4 AM.

🗓️ Oct 4

  1. 📏🔧Mood rescore done

    (8:22 PM; 20,378 stored headlines plus 1,441 that arrived during the run). Over 15,425 news headlines, 79% kept the same mood and 1.1% flipped sign; all leans read grimmer, right-leaning outlets most (average mood -0.60 to -0.76; left -0.50 to -0.62; center -0.29 to -0.39; RedState -0.78 to -1.06), as expected once a headline's own dismay counts. Spin: 77% the same; right-leaning outlets' average rose (0.65 to 0.72) from counting outrage bait, the others held or dipped. Old scores: data/archive/scores-before-rescore.csv.

  2. 🧩🔧Rumors: are they circulating?

    Each fact-checked claim is looked for nightly in the last 72 hours of our Bluesky and Mastodon sample: posts at least 0.72 alike by meaning are candidates, and the model reads up to 12 one at a time, saying whether each is telling the claim, arguing against it (sharing the fact-check counts), only about the news around it, or something else. The Rumors page shows counts of people, never posts. Stance matters here (unlike for a story's shape): the closest posts are often people sharing the fact-check or the news report itself. First look (half a day of sample, 66,722 posts): 15 of 91 claims seen. Weak spots: some fact-checker items are explainers of real news, so "telling it" is people sharing news; single posts can be misjudged.

  3. 📰🔧Beyond the front pages

    The front page's "Investigations" and "On the shows" link lists are gone (we're not an aggregator): each piece now shows on the story it covers (🕵️ investigated by, 🎙️ on the shows), and a new page lists what the shows, newsletters, streams and investigative desks discuss, tagged by subject by the local model (one to three from a fixed list of 35), plus a directory of all 121 sources beyond the front pages and what we do with each. Subject tags pad: asked for one to three, the model gives two or three even for teaser titles; asking for one unless others are plainly discussed only partly helps.

  4. 🧩🗑️Conspiracy scope held back

    Even asked first whether a secret plot is claimed, the 8B model called 43 of 94 fact-checked claims conspiracies (e.g. "Jon Husted pushed for data centers and tax incentives"). The scope shows only in local previews until a confidence cascade (the model's own answer probabilities, with unsure answers sent to a bigger local model) is calibrated against hand checks. Rumor class and subject stay on the site.

  5. 🧩🔧Rumor shapes: three open label sets, and a Rumors page

    Thompson's index fits folktales, not modern political rumor: in a blind test (151 claims: folklore narratives and fact-checked claims; up to 16 candidate entries each by meaning), the local 8B model picked a motif for 30 of its first 53 claims and the user accepted 1 of 6 checked; a strong model (Claude, in-session) picked 5 of 151, and the user accepted both checked. Specific motifs stay off the site. Instead every narrative and fact-checked claim gets three short labels from the study of rumor, concepts rather than anyone's text: rumor class by what drives it (wish, dread, wedge; Knapp 1944, DiFonzo and Bordia 2007), conspiracy scope (event, systemic, superconspiracy; Barkun 2003), and a subject family (our own list, after the chapters of urban-legend collections). The new Rumors tracker lists the fact-checkers' recent work with these labels, filterable; verdicts are always the fact-checkers' own, behind their links. Survey of other schemes (SemEval 2025 Task 10 narratives and roles, UK election narratives, EIP, Brunvand, ATU, Berezkin, EUvsDisinfo, NewsGuard and more, with their licenses) on #145.

  6. 🧩🔧Narrative labels from one point of view, and only when most posts are about it

    The labeler now names the claim most posts share (one or two posts' claim isn't the narrative), says for each part (villain, victim, hero) whether the story has one before naming it (it used to fill every part: "hero: the Bills"), and casts parts and side from the tellers' point of view. Each narrative's sampled posts are then asked one by one whether they're about its claim (telling it or arguing over it alike); under half, it's not counted. On the side: the model's guess is unchecked (it called trans people's own posts "right"), so the site shows a side only from evidence, the AllSides lean of outlets whose articles the posts share (two or more rated shares); the guess shows only in local previews. News reactions get no cast or motif. Re-run on the flagged groups: the Jets penalty and the trans group's misreading are fixed; perspective still sometimes mixes ("Canadians in Florida").

  7. 🧩🔧How a claim's motif is judged

    A motif is the story's shape as its tellers tell it: not whether it's true, and not whether a poster tells it or argues against it. (Calling a claim a "false accusation" puts a verdict into the classification; that's the fact-checkers' part, shown separately.) The site presents shapes only in the tellers' voice ("the story casts…"). The model's prompt and the hand check ask the same question.

  8. 🧩🐛A folklore card withheld after a misreading

    "Trans women are predators and their identities are inherently tied to dark kinks", told by 12 people and labeled right-wing, was a group of mostly trans people talking about their own gender; one post's line, from one trans woman arguing with others, became the group's "shared claim". It's withheld by hand (data/narratives/withheld.json). Cause: the finder groups posts by topic and the labeler writes a claim even when most posts don't concern it. Fix (next report): a narrative counts only if most of its sampled posts are about its claim, telling it or arguing over it alike.

  9. 🧩🆕Fact-checks (#153)

    Seven fact-checkers' feeds are archived (PolitiFact, FactCheck.org, Snopes, Lead Stories, Full Fact, NewsGuard Reality Check, Science Feedback; Check Your Fact was dropped: its feed is mostly the Daily Caller's ordinary news). Each check from the last week is tied to a current story, and each from the last 30 days to a folklore narrative, the same way as satire: the closest three at 0.6+ similarity, then the model picks one or "none". Shown with its title (which usually carries the verdict) on story and folklore cards.

    • Checked by hand on Oct 4. Below 0.58 the closest pairs were mostly another claim on the same subject (FactCheck.org on Trump's taxpayer-funded ads matched Ken Paxton's ads at 0.56). The first prompt ("the same event or the very claim") made the model answer "none" even when its own reason said the check was about the story; asking for "N claim" / "N event" / "none" made it worse (no story ties at all). Asking only for the number, and saying a check of a fake video or rumor about an event is about that event: 7 ties, 6 right (FlyDubai, Cornell ×4, Christa Pike), 1 on the same subject rather than the same event (an AI-safety check tied to the "Super Intelligence Force" narrative). The satire ties (now the same code) were unchanged, 3 of 3.
  10. 🎙️🆕Call-in shows archived and transcribed (research only, #153)

    Seven shows whose free feeds carry full hours with callers: Jesse Kelly, Clay Travis & Buck Sexton, Michael Berry, Mark Levin (right); Brian Lehrer (WNYC), KQED Forum, 1A (public radio). No free feed on the left carries callers (Thom Hartmann's and the Majority Report's caller hours are YouTube-only or for paying members), so public radio stands in there; the sample leans right. C-SPAN's Washington Journal, which sorts callers by party line, has no feed and its archive runs on a lag, so it's out. Never shown; callers are private people, so only patterns will be published.

  11. 🎙️🆕Satire (#139): which stories become jokes

    Ten satire sites are read every two hours (the Babylon Bee; the Onion, Borowitz, New Yorker humor, McSweeney's, Reductress, the Hard Times, NewsThump; Duffel Blog, ClickHole; leans by reputation). Each joke from the last three days is offered the closest current stories with mxbai-embed-large similarity 0.5 or more (up to three) and the model picks one or "none". Shown only as 🃏 "joked about by" on the story card, never as coverage or in any measure.

    • Checked by hand on Oct 4. With no similarity floor, the model tied 6 jokes to stories and 2 were wrong, both on a shared word ("Woman survives two minutes in Primark" -> a botched execution; a paste-eating Marine -> a Marine arrested in Japan). Asking it to name the event the joke mocks first made it worse (9 ties, 4 wrong). Every wrong tie was under 0.48 similarity and three of four right ones over 0.54, so with the 0.5 floor: 3 ties, all right. Missed: the Bee's oblique Cornell joke (0.44). With only the fallback embeddings, satire is skipped rather than matched on another scale.
  12. 📏🔧Mood redefined: how the headline presents the news (rubric b31d654f)

    Mood was how good or bad the event is for the people it affects, whoever reports it. For political news that depends on whose side you're on, so the model picked a side itself and a reader couldn't check it: RedState's "Oh, Hell No: Judge Rules Federal Noncitizen Voting Ban Unconstitutional" scored ☀️ upbeat+ (good for noncitizens). Mood is now whether the headline presents its news as good or bad, from the outlet's own words and tone; plainly reported harm is still grim. Spin now also counts outrage bait in plain words ("Oh, come on:").

    • Tested on 21 headlines (12 hand-checked in the label check, nine outlets' headlines on that ruling): mood exact 13 vs 10 under the old rubric, within one step 19 vs 16. On the hand-checked 12 alone, exact 6 vs 6 and within one 10 vs 9; the one sign flip (the Daily Wire's "Leftism's appetite for the destruction of order" read as upbeat+) is fixed. The ruling set's expected moods are the assistant's reading, not a hand check.
    • Every stored headline is rescored with the new rubric (--rescore-outdated, between hourly runs). The old scores are kept in data/archive/scores-before-rescore.csv with the rubric that made them. Mood before and after Oct 4 means different things, so any mood trend starts here.
  13. 🧩🐛Shortened links scrubbed (privacy fix)

    Bluesky writes links in a post's text shortened and without https:// ("youtu.be/…", "twitch.tv/someone"), so the scrubber missed them: 4,998 stored posts kept a full link, some naming an account. They now become their site like every other link, and the stored posts were rewritten. Posts need six real words to be grouped: a run of emoji and a video link is promotion, and a ring of such posts had reached the page as an 11-person "conspiracy theory".

  14. 🧩🔧Folklore page floor: 10 people

    In the first full report (25,095 accounts), half of the 60 retold narratives had five to nine tellers, and those were mostly a handful reacting to one news item or game. The page shows narratives told by at least 10 people, or 1 in 2,500 accounts sampled if that's more; the report keeps the rest.

  15. 📰🔧Shared article links kept (research only)

    A link in a post to an article on a site we scrape is kept whole (without its query string), since it ties the post to a story exactly; other links are still cut to their site.

  16. 🧩🔧What people say, unprompted (research only, #153, #142)

    Each run samples five minutes of Bluesky's public stream (Jetstream) and three pages of mas.to's federated timeline, on a thread during the scrape. Kept: post text, reply/quote flags, a salted fingerprint of the author. Handles in text become "@someone", links just their site; images and video are never fetched. Skipped: non-English (by script and common words, since posts often don't say), posts their authors labeled sensitive, sex spam, Mastodon accounts that haven't opted in to being searchable or are marked as bots. Deleted posts are deleted here too; raw text expires after 30 days. Once a night the day's posts are grouped into paraphrase groups (mxbai embeddings, mutual nearest neighbours at 0.78, accounts posting more than 20 times in six hours and bare link shares left out), and each group of 5+ people is scored for wording variety (one minus mean word overlap): varied wording from many people is a told narrative, the same words copypasta. The local model labels the biggest groups: the shared claim, whether it's retold or just a shared topic, genre (rumor, contemporary legend, conspiracy theory, folk belief, joke formula, testimony, news reaction...), Thompson Motif-Index chapter and a motif, Propp-style roles (villain, victim, hero), politics and side. Each narrative is matched to current stories: the model chooses among the three closest stories ("same event", "same issue" or, most often, "none"). A yes-or-no check, one candidate at a time, agreed to nearly anything (a Drake Maye fumble "matched" voters calling J.D. Vance "a goober"); the forced choice linked 12 of 60 narratives on Oct 4, 10 of them rightly. Matching narratives to The Focus Group transcripts (12 episodes, Ep50-61, transcribed Oct 4) was tried and dropped from the page: the passages rarely overlap a day of social posts, and the yes-or-no matches were wrong almost every time. The first report (40 minutes of stream, 15,430 posts) found 13 retold narratives, among them a folk belief that Trump is being kept alive by doctors because "they need him alive" and a contemporary legend of "Julie bots". Reports stay in data/narratives; nothing is published.

  17. 🗞️🔧Stories use a bigger embedding model

    Four models were compared on the day's 6,733 headlines at equal coverage (the threshold at which each put about 700, 900 and 1,100 headlines into stories of 6+ outlets), with precision from cross-outlet pairs sampled inside each model's stories and recall from a shared pool of 657 pairs sampled across every model's similarity range, all judged by the local language model under two wordings (agreement only; about 80 judged pairs per cell, so ±0.04). At ~900 headlines: potion-base-8M (until now) precision 0.77, recall 0.57; mxbai-embed-large 0.91, 0.57. At ~1,100: 0.82 / 0.64 against 0.88 / 0.68. potion-base-32M and nomic-embed-text fell between. Stories now use mxbai-embed-large through the local Ollama at 0.80 (about 1,000 headlines in stories); its vectors are cached by headline, so each run embeds only new headlines. If Ollama can't embed, stories fall back to potion-base-8M at 0.70. Sagas, wire share and aggregator matching keep potion-base-8M, whose thresholds were tuned on its scale.

  18. 📰🔧Each side's wording

    Story cards show two-word phrases that outlets on one side of the lean scale put in their headlines and no outlet on the other side did ("hero pilot" and "FlyDubai hijacker" from the right against "extremism concerns" and "terrorist act" from the left on the FlyDubai attack; "Trump doxes" against "Trump urges" on the senator's phone number). Our outlets lean left as a group, so a story needs 3 or more rated outlets on each side, and a phrase needs 2 or more outlets and a quarter of its side's outlets, with none on the other side. Function words and headline filler don't count; phrases the same outlets used back to back are joined ("small Texas town stopped Trump's"). No model involved.

  19. 📰🔧Every-headline file packed

    headlines-table.json now lists each row's values in a fixed column order, with outlets (and their lean), topics, stories and feelings listed once and referred to by position, and URLs without "https://": about 12% smaller compressed (keys were a third of the raw file, but compression already removed most of that; URLs and titles are the bulk). The page unpacks it, and the download button saves the rows with named fields as before.

  20. 📰🔧Cloud paper by spiciness

    Each word's scrap of paper is colored by how loaded the wording of its headlines is, white (plain) through cream to peach (spicy), instead of a random tint.

  21. 🗞️🆕Supreme Court page (#144)

    The term's cases come from the Court's Granted & Noted list (a public-domain government record); what each is about comes from its question presented on Wikipedia's list of pending cases (CC BY-SA), which the local language model puts in a few plain words ("Cook County AR-15 gun rights case"). Both are fetched at most weekly. Headlines naming the Court or a justice are read by the model with the outlet and its country (India's Supreme Court had been slipping in): whether each is about the US Supreme Court, which of the glossed cases it's about, a few topic words, and the stage it reports. A small model reading a list of thirty cases matched every term preview to five or six of them, and two headlines about Justice Alito and the Dobbs leak to the Arizona voter case, so a suggested case is kept only if the headline shares a word specific to that case (from its gloss, parties, question presented or the state court it came from, counting only words in at most two cases' texts) and the model, asked about that case alone, agrees it clearly refers to it. A distinctive party name ("Suncor", never "Congress") ties a headline to its case as well. Each case in the news gets a card like the front page's story cards: the lean of the outlets covering it against all Court coverage, mood, loaded wording, feelings, quoted phrases, and each side's most loaded headline side by side. Court news about no case on the docket is grouped by topic; docket cases no headline covered are listed. Window: 14 days; each outlet counts once per card.

  22. 🗞️🗑️Story coherence check tried, not adopted

    The model was shown each story's three most central headlines and asked about each loosely tied member (best similarity to that core under 0.75); rejected ones were taken out and clustered again among themselves. On Oct 4's headlines (labels as in the threshold test above, 90 pairs per setup): at 0.70 it raised precision from 0.87 to 0.91 but cut recall from 0.79 to 0.73; at 0.67 and 0.65 it didn't help, and the biggest stories kept their size (they were real stories: the FlyDubai attack ran to 121 headlines). All within the noise of the sample, so stories stay as they were.

  23. 🗞️🔧Story threshold re-tested; it stays at 0.70

    Stories are still the connected groups of headlines whose embeddings are 0.70 alike or more. On one day's headlines (6,888) the local model judged about 1,000 headline pairs, under two wordings, keeping the pairs both wordings agreed on. One set was spread across the similarity range; it measures how many same-story pairs end up in one story (recall). The other was drawn from inside the stories each threshold would make, grouped by the highest threshold that still joins each pair; it measures how often a story's headlines really belong together (precision). Pairs that only join below 0.70 are the same story 73% of the time between 0.675 and 0.70, 51% between 0.65 and 0.675, and 16% between 0.625 and 0.65, because low thresholds chain unrelated stories (the largest group grows from 127 headlines at 0.70 to 451 at 0.60). Scored with precision counting double (F0.5), 0.69 and 0.70 were best and within noise of each other. Lowering to 0.65 catches more same-story pairs (recall 0.79 to 0.88) but drops precision from 0.85 to 0.75. Splitting the chains instead with Louvain communities or mutual nearest neighbors scored lower. A threshold has no gradient (scores move in steps as it crosses pairs), so it was swept every 0.005 from 0.55 to 0.80.

  24. 🗞️🔧Saga links checked by the language model

    Before two stories first join a saga, the model reads a few headlines from each side by side and says whether they're one running story; the similarity and shared-name rules still apply first. A shared name alone had linked separate Supreme Court cases and separate plots by Iranian nationals. Verdicts are cached (saga_judgments.json); those two sagas were taken apart.

  25. 📰🆕Headline A/B tests (#119)

    Every wording Slate tests on a front-page card is recorded each run with when it was first and last up; when one is left, it's the winner. Shown on the headline changes page. Recording begins Oct 4. Checked on Oct 4 whether other outlets expose their variants the same way (each homepage once): none do. Outlets using Chartbeat's or Optimizely's headline testing run it in the reader's browser, so the variants never appear in the page a scraper reads.

  26. 📰🔧Headline download

    The every-headline page links its rows as JSON (the file the table already loads).

  27. 📰🆕Quote selection (#149)

    Story cards list the phrases outlets put in quotation marks in their headlines (one headline per outlet, up to 4 phrases, most-quoted first), each tinted by the lean of the outlets that quoted it. Phrases of 2 to 80 characters count (an apostrophe inside a word doesn't open a quote); matching ignores case and punctuation, and each outlet counts once per phrase.

  28. 📰🆕Daily editions begin (#125)

    At each run the front page is saved as that news day's edition; past days are published as fixed pages under /YYYY/MM/DD/ with an archive index. Editions start Oct 4; earlier days have none.

  29. 🏢🆕Outlet pages (#126)

    Each outlet gets its own page: live headlines and the stories they're in, recent rewrites, and the mix of feelings its headlines stir, over the outlets page's 30-day window.

  30. 📰🆕RSS feed (#123)

    feed.xml lists the current stories; each item keeps its id across runs while the story lives.

  31. 🏢🆕Aggregators aren't outlets (#151)

    Google News, Drudge Report, RealClearPolitics and Political Wire no longer count toward stories, lean, the news-day sticker or the cloud (they mostly link to other outlets' stories); their live headlines are matched to stories (embedding 0.7) and shown as "picked up by" on the cards.

  32. 🏢🆕Wire share (#152)

    Outlet cards show the share of an outlet's news headlines over 7 days that are AP or Reuters headlines near word for word (embedding 0.90 and 70% of words shared; checked by hand). Outlets mostly rewrite wire copy: on Oct 4 the highest was about 11%.

  33. 🗞️🆕Story snapshots and trend arrows (#133)

    Every run saves each story's lean, mood and outlet count (story_snapshot). Cards show arrows when lean or mood moved over the last 6 hours (needs 2+ hours of history): lean 0.15 / 0.35 / 0.6, mood 0.1 / 0.25 / 0.45 for one, two or three arrows.

  34. 📏🗑️Bright side removed

    Its picks (hope/joy plus a "widely good news" model check) read as feel-good filler rather than a measure.

  35. 🗞️🔧Blindspots move onto story cards

    Same rule; the separate box is gone. A blindspot's card shows a lean meter (left/center/right counts) with a tick where an average story splits, and a 🙈 filter shows only blindspots.

  36. 🎙️🐛Transcription: temporary failures retry

    Out-of-memory and network errors are no longer recorded as failures (they stopped every item for good on the first prod run); only a missing or unreadable file is. Transcription waits for the language model to unload first and skips the round if it can't. The test suite no longer calls the real language model (it was loading it onto the shared GPU mid-transcription).

  37. 🎙️🆕More shows

    News outlets' own daily podcasts shown (Reuters World News, BBC Global News, WSJ What's News, Bloomberg News Now, Politico Playbook, The Economist's Intelligence, CNN 5 Things, the Guardian's Today in Focus, Morning Wire); more political YouTube channels shown (Pakman, Secular Talk, Brian Tyler Cohen, MeidasTouch, TYT, Adam Mockler, Timcast IRL, Benny Johnson, Ben Shapiro, Dan Bongino, Matt Walsh). Archived only: ABC News Update (hourly), NBC Top Story, Al Jazeera's The Take, Steven Crowder, Candace Owens and long-form talk (Rogan, Theo Von, Flagrant, Jimmy Dore, PBD, Pod Save America's channel). 72 sources, 37 shown.

  38. 📰🐛Headline changes: junk prefixes

    A rank from a "most read" list ("4 , ") or a view counter ("114.7k views : ") before a headline is stripped when scraping and ignored when comparing versions, so a story moving from #4 to #2 is no longer a "change".

  39. 📰🔧Headline changes: how a rewrite changed

    The language model reads both versions side by side and says, in a few words, what the rewrite changed ("added the death toll"), cached once per change. "Plainer wording" / "reads as better news" notes show only when that side-by-side reading and the two versions' own scores agree on the direction; either alone was noise (identical headlines came out "plainer").

  40. 🛠️🔧Backups every run

    Each run first takes an online copy of the database (newest 5 kept), besides the nightly copies (30 days).

  41. 🗞️🔧Trending ranks by what's on front pages now

    "Trending in the news" ranks stories by the share of outlets carrying them on their front page right now, weighted by age the same way as the news-day sticker (full weight for 12 hours, then halving every 24), instead of every outlet that covered them in the last day. A story outlets have dropped falls down the list. Items show both counts: on front pages now, and in all.

  42. 🗞️🔧Sagas are kept across days

    Sagas are saved (saga table, story.saga_id). Each hour, today's stories are merged with the last 7 days of saved stories, starting from the saved sagas, so a saga grows or merges but never loses a part. Linking now needs a shared distinctive name (a word outlets capitalize mid-sentence) rather than any distinctive word, and hyphenated words split ("UK-Iranian" carries "Iranian"). Checked on Oct 3-4: Cornell keeps all 4 parts; a false link ("Trump rally in Alabama" with "Ohio layoffs before Trump rally", via "rally") is gone.

  43. 🎙️🔧Podcast transcription

    Archived podcast audio is transcribed on our own GPU with Whisper (faster-whisper large-v3-turbo, int8), after each hourly build, hourly newscasts first, for items up to 3 days old. Sponsor reads at the start and end are trimmed. Transcripts are kept with the model's name, for analysis only.

🗓️ Oct 3, evening

  1. 🎙️🆕Shows archive begins

    40 newsletters, podcasts and political video channels are collected into side_item (append-only), each feed read at most every 2 hours with conditional requests. Sources are sorted by how they follow the news (news of the day vs. thinking, #135), not format; only news-of-the-day ones are shown on the site.

  2. 🗞️🔧Stories: different money stays apart

    Headlines that both name dollar amounts more than 3x apart can't link ($90 Medicare checks vs. a $5,000 promise); $90 vs. "nearly $100" still can. Headlines without amounts unchanged.

  3. 🗞️🔧Stories: a split story gets two titles

    When one saved story's coverage splits into two clusters in an hour, the bigger part keeps the story and its title and the smaller becomes a new story (before, both showed the same title).

  4. 📰🔧Headline changes: live-blog filter

    Only an all-caps LIVE tag or phrases like "live updates" mark a live blog; the plain word "live" no longer does, so ordinary rewrites containing it now count.

  5. 📰🔧Scraping

    Bare photo credits with no text left after cleaning are dropped; hrefs with stray spaces are kept.

🗓️ Oct 3

  1. 📏🔧Score provenance

    Each scored headline now records which model and rubric version scored it, when, and the model's own note on who the event affects. The rubric id is a hash of the prompt and schema, so it changes on any edit to either.

  2. 🛠️🔧Trend sightings

    Every appearance of a trend in a source's list is now logged with its rank (before this, only first and latest sightings were kept).

  3. 🏢🔧Outlet ratings

    Lean switched from MBFC to AllSides (5 levels, CC BY-NC 4.0); reliability from Wikipedia's perennial sources list (CC BY-SA 4.0). Outlets AllSides doesn't rate are left out of every lean average.

  4. 🏢🔧Our lean estimate

    Wording-only model (tf-idf + ridge) trained on rated outlets over 30 days; published only when leave-one-out rank agreement is 0.45+ and the outlet is 0.55+ from center. Never counted in lean averages.

  5. 📏🔧Emotions

    Ranked top three per headline, averaged ranked-choice style (3:2:1). All headlines rescored with this rubric (14,404).

  6. 🗞️🔧Stories and sagas

    Stories: headlines linked at embedding similarity 0.7+, six or more outlets, 24-hour lookback. Sagas: stories whose centers are 0.58+ similar and share a distinctive word.

  7. 📰🔧News-day sticker

    Live headlines only; a story's weight is full for 12 hours, then halves every 24 hours.

  8. 📏🔧Duplicates merged

    2,470 duplicate articles and 1,468 duplicate headlines merged (backup kept).

  9. 🏢🆕New outlets

    11 added from their feeds (TPM, Puck, The Washington Sun, The Lever, Mediaite, Straight Arrow News, UnHerd, Just the News, The Daily Signal, The American Conservative, Washington Reporter). Vox and National Review switched to their feeds.

🗓️ Oct 2

  1. 🛠️🆕Archive begins

    The current database starts this day; anything earlier isn't in it.

🗓️ History

  1. 🛠️🔧2024-01 to 2024-08: built by hand

    as Maudlin: per-outlet scrapers, the database, the word cloud, word-list sentiment (VADER, AFINN). About 680 commits.

  2. 🛠️🔧2026-10: rebuilt with AI assistance

    (Anthropic's Claude as a coding assistant) for the 2026 midterms. The direction, design and decisions are the maintainer's; the assistant wrote and tested much of the new code. Separately, the site's measures come from a small open model run locally (see above for its provenance).