Coleman McCormick

Archive of posts with tag 'Research'

February 7, 2024 • #

Whatever happened to the industrial R&D lab? →

Ben Southwood looks at the waning of the big R&D labs:

Readwise, Books, and Spaced Repetition

August 7, 2020 • #

In his piece “Why Books Don’t Work,” Andy Matuschak made a strong case that books are a poor medium for knowledge transfer. Even with the most advanced book experiences today (like digital ebook downloads to a Kindle), if you took away the digital e-ink screen, a reader from the 16th century would still recognize books as no different than what they had. We’ve added digital on-demand access, dictionary lookups, and the ability to have a library in your pocket1, but the fundamental model for conveying the knowledge is still what Gutenberg would recognize, based on the “transmissionism” mode of teaching.

Spaced repetition

Matuschak quotes this great passage from Carl Sagan in Cosmos:

What an astonishing thing a book is. It’s a flat object made from a tree with flexible parts on which are imprinted lots of funny dark squiggles. But one glance at it and you’re inside the mind of another person, maybe somebody dead for thousands of years. Across the millennia, an author is speaking clearly and silently inside your head, directly to you. Writing is perhaps the greatest of human inventions, binding together people who never knew each other, citizens of distant epochs. Books break the shackles of time. A book is proof that humans are capable of working magic.

Knowledge is transmitted, as if by magic, across the decades and centuries. This makes it all-the-more unfortunate how bad our brains are at retaining all that information. We have a mechanism for cheap, reliable knowledge transfer, yet are still bad at hanging onto that knowledge.

One can also be reading books for enjoyment. The act of reading itself can be fun, even if the signal strength of retention is less than perfect. Fiction is like this, of course, where the primary goal is entertainment, not education. Not that there’s no wisdom embedded in fiction — in fact, I would make a case that fiction offers deep insights worthy of remembering2. But I even see nonfiction works on my shelf that I remember enjoying years ago that I’ve mostly forgotten about, certainly in any conscious way that’s useful to me.

The defining purpose of nonfiction, though, is to educate, to convey ideas in a way that disseminates them to a wide audience and allows wisdom to compound over years by connecting dots in readers’ minds. Writers spend hundreds of hours distilling their ideas into works of a few hundred pages that we blaze through in a couple of weeks, retaining little.

Spaced repetition

Purely linear transmission is not the best model for understanding, but it’s the best that we have available to us today, cheaply and readily accessible. People like Andy Matuschak and his collaborator Michael Nielsen are busy behind the scenes working on this problem of how to build tools for thought that can harness the novel advantages of today’s technology. They experimented with this idea in their quantum.country project, using the complex subject of quantum computing combined with a “mnemonic medium” that integrated spaced repetition testing. The results they’ve shown from this experiment are promising evidence for the technique to increase retention. It’s a simple approach — interspersing simple questions within the text — but the problem is one of medium. Our existing reading and teaching tools don’t have affordances for this today.

Until we make headway in those new areas, what can we do to get more out of reading? How can we extract and retain the right ideas from what we read without having to reinvent the nature of books themselves?

Enter Readwise

One of the most useful tools I’ve discovered in the past year is Readwise, a service that’s working to solve this problem and enhance reading retention through a simple workflow:

  • Readwise syncs your highlighted passages from Kindle, web articles, and even tweets
  • See a sampling of those highlights in your inbox each day for review, through email or their mobile app (what they call your “Daily Readwise”)
  • Highlights are selected randomly from your archive, and can be resurfaced with whatever regularity you prefer

It’s such a simple idea that, like all great innovations, makes the most of the pre-existing infrastructure around it. The goal is to help readers retain what they read. I love it because of how simple it is. Readers like me aren’t looking for something scientific or complex; even an incremental improvement in reading comprehension and recall is enough to enhance the overall nonfiction reading experience.

Because I read so much and highlight copiously, my Readwise has over a hundred books, each with dozens (if not hundreds) of highlighted passages. At last check I have around 5,000 highlights in the archive. As they come through in each day’s review, I regularly get to see things I highlighted years ago from books I sometimes barely remember reading. There have been numerous times where a passage has spurred me to go and re-download the book on my Kindle and skim back through. This trigger is exactly what I want out of a service like this: a reason to be more diligent in reading practice, highlighting, and regular review. Just in the past year or so of using it, I’ve been able to dredge quite a bit of fleeting knowledge back up into memory. Without a service like Readwise (even with highlighting), it’s highly unlikely I’d ever remember much more than a two-sentence synopsis of most books in my library.

Readwise follows a spaced repetition model for increasing recall. True spaced repetition systems use specific algorithms to extend the time between recall tests (like the Leitner system). For example, you might first get quizzed on an item a day after first being shown it, and if your answer is correct, then you’ll be asked again in 5 days, 10 days, et cetera. The correct/incorrect answer provides a feedback loop to the algorithm to best estimate the spacing for resurfacing it again.

Tuning your reviews

Since not all the books in your archive are of equal importance to you, you can tweak the frequency that highlights are resurfaced on a per-book basis. I only have a couple in my library that I’ve turned down. Usually the quantity of highlights in a book is a good proxy for how interested I am in retaining info from it, so books with very few highlights are already less likely to appear in the daily batch. You can also dial in the preferences for new versus old books. You can have it favor more recent reads to review information while the reading is fresh, or favor pulling up more items from farther back in time.

Tuning your Readwise reviews

Integrations

The most commonly used integration is probably their Kindle sync service. It’s certainly the most high-volume for me. But in addition Readwise can sync from iBooks, and even has a slick camera-based OCR tool for clipping sections from physical books3. You can also pull in highlights articles through Pocket and Instapaper, and even save tweets or threads to include in your reviews. They’ve also got a super slick integration with Notion, if that’s something you’re interested in.

Active recall

A key feature related to the native concept of spaced repetition is Mastery mode, which allows you to generate flashcard-like questions from specific highlights. On each highlight shown in review, you can add it to your Mastery catalog, either generating a question & answer flashcard or a fill-in-the-blank version of the quote (a technique known as cloze deletion). I only do this for concrete statistics and facts that I find notable enough to want to remember. Depending on the types of works you read most frequently, though, this could be incredibly helpful, especially for content like digital textbooks.

In my now-hundreds of Daily Readwise reviews, there have been countless times that a highlight pulled up from the archives has prompted a thought or idea that I jotted down in my notes. Occasionally they’ve even spurred such deep thinking (usually because I see it in a moment of already thinking about a similar idea) that I haul off and write a blog post from it. This for me is the one of Readwise’s core values. Since writing is a medium for learning, a tool in the belt that helps you synthesize ideas for writing is a powerful one.

Readwise has been in everyday usage around here. I recently had a 110 day streak that I broke a week ago, but still I make it a point to pop it open every day when I get the morning push alert and flip through the clips it assembles.

Future Ideas

One unsolved (and maybe unsolvable) area is a way to address audiobooks. Certainly the technologies exist to do playback, capture, and speech-to-text transcription, but it’s a question of integrating these all together in a system that would work. Audible is the largest player by far, but it generally has poor support for integrations of any type, and also generally innovates at a snail’s pace. I’m not familiar with other audiobook players, but maybe one day there’ll be a way for a new entrant to encroach on Amazon’s monopoly in this space.

For podcasts there’s a new player called Airr that’s doing something interesting with this, using a feature they call “AirrQuotes.” It allows you to clip a segment of audio from a podcast, along with the text transcript to send to another app. I could see a future integration here where you could have podcast clips automatically transcribed and added to your Readwise archive. (Update: Airr integration is now live within the Airr app, like they’re reading my mind)

I’ve added a post-processing step to my reading to collect the noteworthy ideas, forcing myself to write a concise summary and bulleted list of the salient takeaways that resonated. I’ve done this now with my last few books and it’s been a fantastic way to parse through the content a second time — sort of like the first “active recall” review. This extra passthrough to aggregate thoughts into a system helps drive compound interest on the ideas.

It’s rare for new productivity tools to stick with me this long. All of the tools in my daily routines are ones I’ve relied on regularly, and it takes a while for new ones to really click. Readwise clicked for me early and earned its staying power right away. If you’re an avid reader, you’ll love it.

  1. Okay, let’s be honest: this is a phenomenal innovation. 

  2. Science fiction especially isn’t just my favorite fiction genre for entertainment value, I also believe there’s a lot to be learned about invention, creativity, human behavior, psychology, and more from good speculative works. Check out Dan Wang’s comments on this topic

  3. I’ve been using this a lot lately and it’s fantastic. Works great for any books you can’t (or don’t want to) read in e-reader format. 

Weekend Reading: Figma Multiplayer, Rice vs. Wheat, and Tuft Cells

November 23, 2019 • #

🕹 How Figma’s Multiplayer Technology Works

An interesting technical breakdown on how Figma built their multiplayer tech (the collaboration capability where you can see other users’ mouse cursors and highlights in the same document, in real time).

🌾 Large-Scale Psychological Differences Within China Explained by Rice Versus Wheat Agriculture

A fascinating paper. This research suggests the possibility that group-conforming versus individualistic cultures may have roots in diet and agricultural practices. From the abstract:

Cross-cultural psychologists have mostly contrasted East Asia with the West. However, this study shows that there are major psychological differences within China. We propose that a history of farming rice makes cultures more interdependent, whereas farming wheat makes cultures more independent, and these agricultural legacies continue to affect people in the modern world. We tested 1162 Han Chinese participants in six sites and found that rice-growing southern China is more interdependent and holistic-thinking than the wheat-growing north. To control for confounds like climate, we tested people from neighboring counties along the rice-wheat border and found differences that were just as large. We also find that modernization and pathogen prevalence theories do not fit the data.

An interesting thread to follow, but worthy of skepticism given the challenge of aggregating enough concrete data to prove anything definitively. There’s some intuitively sensible argument here as to the fundamental differences with subsistence practices in wheat versus rice farming techniques:

The two biggest differences between farming rice and wheat are irrigation and labor. Because rice paddies need standing water, people in rice regions build elaborate irrigation systems that require farmers to cooperate. In irrigation networks, one family’s water use can affect their neighbors, so rice farmers have to coordinate their water use. Irrigation networks also require many hours each year to build, dredge, and drain—a burden that often falls on villages, not isolated individuals.

🦠 Cells That ‘Taste’ Danger Set Off Immune Responses

I’ve talked before about my astonishment with the immune system’s complexity and power. This piece talks about tuft cells and how they use their chemosensory powers to identify parasites and alert the immune system to respond:

Howitt’s findings were significant because they pointed to a possible role for tuft cells in the body’s defenses — one that would fill a conspicuous hole in immunologists’ understanding. Scientists understood quite a bit about how the immune system detects bacteria and viruses in tissues. But they knew far less about how the body recognizes invasive worms, parasitic protozoa and allergens, all of which trigger so-called type 2 immune responses. Howitt and Garett’s work suggested that tuft cells might act as sentinels, using their abundant chemosensory receptors to sniff out the presence of these intruders. If something seems wrong, the tuft cells could send signals to the immune system and other tissues to help coordinate a response.

Given the massive depth of knowledge about biological processes, anatomy, and medical research, it’s incredible how much we still don’t know about how organisms work. Evolution, selection, and time can create some truly complex systems.

A Network of Science

November 22, 2019 • #

A beautiful visualization project from Nature converts 150 years of scientific papers into a 3-dimensional network diagram, making concrete the network of citations and references linking together the history of discoveries.

Progress Studies

September 16, 2019 • #

A few weeks back, Tyler Cowen and Patrick Collison co-authored this piece for The Atlantic calling for research into the study of progress1. From the thesis of the piece:

Progress itself is understudied. By “progress,” we mean the combination of economic, technological, scientific, cultural, and organizational advancement that has transformed our lives and raised standards of living over the past couple of centuries. For a number of reasons, there is no broad-based intellectual movement focused on understanding the dynamics of progress, or targeting the deeper goal of speeding it up. We believe that it deserves a dedicated field of study. We suggest inaugurating the discipline of “Progress Studies.”

This is an idea I’ve been increasingly interested in with my reading selection and my content here on the website — from contemporary works in the camp of embracing the enlightenment and its benefits like Nick Christakis’s Blueprint and Pinker’s Enlightenment Now, to the political philosophy of The Federalist Papers and historical background in The Origins of Political Order. Common threads emerge in optimism and a desire to understand the dynamics that have allowed humans to flourish over the course of the past few centuries.

Jasmine Wang from OpenAI wrote this excellent follow up post full of related prior art and links to past literature on the theme of scientific progress. As she says in the post, the goal is for it to become a “wiki” of sorts to establish an organic review of the state of what we know about how we make progress — How does it happen? How do we measure it? What are its drawbacks?

The list of books and articles is a gold mine of interesting material. A few I’ve bookmarked for future reading:

If you’re also interested in joining up in this conversation, there’s a Slack group that’s formed, now at about 300 members. In the week that I’ve been following along the conversation, it’s showing some signs of hope that it could be one of those rare corners of the internet with civil conversation and discussion on a broad range of topics. I’ll keep following this thread and see where it leads.

  1. Linked in an edition of Weekend Reading last month.