On Our World in Data, we present thousands of metrics on hundreds of topics.

But there are many more topics that we could work on, and metrics we could present. How do we choose them?

How do we choose which topics to cover?

We cover a topic if we believe it helps our readers understand one or several of the world’s largest problems. More specifically, this means that a topic will fit many of the following criteria:

• It affects many countries and people. This can mean that it concerns every person, such as health. It can mean that it affects many people in all countries, such as poverty. Or it can mean that it affects many people in fewer countries, such as malaria.
• It comes with great costs or benefits. The costs or benefits can be direct, and shorten people’s lives or mean they lead happier lives. An example is the COVID-19 pandemic, which has immediately affected people’s well-being. But the costs or benefits can also be indirect, and worsen or alleviate other problems. An example is agricultural production, which affects many people’s access to nutrition.
• It poses significant risks. This means that it may not impose great costs at the moment, but may do so in the future. An example is nuclear weapons, which have not been used in decades but whose use would be devastating.
• It will remain important, or become more important in the future. Poverty is an example of a topic that will remain important, as many people remain impoverished even if fewer people live in extreme poverty than in the past. Artificial intelligence is an example of a topic that will become more important, as technological advances continuously expand its effects on people’s lives.
• It is helpful to understand other topics. Many of the topics we focus on are problems in themselves. But we also provide data and research on major changes that help us understand and address these problems. An example is population changes, which are crucial to better understand energy and education needs.
• It is poorly understood. This means the public knows little about a problem or frequently misunderstands it, such as when related data is not described well. An example is plastic pollution, where data and research were often missing from the public conversation.
• It is neglected elsewhere. This can mean that other organizations do not cover it, or do so in a limited fashion. An example is biodiversity, where data on global changes are hard to find elsewhere. This also means that if others cover a topic well, we are less likely to cover it ourselves.
• It has data on it. This means that other organizations or individuals are collecting and publishing data on the topic. We do not collect data ourselves, and instead make the data and research of others easier to access and understand.
• We have expertise on it. If we have someone on our team with deep knowledge of the area, we are more likely to cover the topic. Ideally, we would have both a researcher and a data scientist with this expertise. An example is democracy, where we expanded our work as our team grew.
• We have funding available for it. While most of our funding comes from unrestricted resources, including reader donations, we partially fund our work through grants that cover work on specific areas. Importantly, we only apply for these grants if we have editorial independence: that they are on topics we want to cover in depth anyway, and there are no requirements on how to cover the topic.

We evaluate ourselves how a topic fits these criteria. But we rely heavily on related research, especially research that is peer-reviewed.

How do we choose which metrics to provide?

For each topic, we work to provide the best metrics to understand it. What metrics are 'best' will often depend on our specific questions. Overall, a metric we provide will fit many of the following criteria:

• It is quantitative. This can mean numerical measures, such as the number of people living in extreme poverty; or categorical measures, such as classifications of countries as either democratic or autocratic. We do not systematically provide information that is highly specific, such as personal experiences of living in poverty or under dictatorship.
• It captures what we are trying to measure. This means that it neither leaves out anything essential, nor includes anything irrelevant. For example, an inadequate measure for whether a country is a democracy is the share of the population that voted. Looking only at voter turnout ignores whether citizens had more than one choice at the ballot box. And at the same time, it inadvertently considers citizens that were coerced to vote.
• It covers large parts of the world. True to our name, we seek metrics which cover as much of the world as possible. Only then can they help us understand global differences and changes.
• It covers a lot of time. This means both that the measure goes as far back in time as possible, and that it is as recent as possible. It then can help us understand both historical and very recent developments.
• It is comparable across time and space. This means that we prefer metrics that can be compared across years and countries. This allows us to evaluate whether countries are making progress or falling behind, and how countries are doing relative to another.
• It is reliable. This means that the metric is consistent, i.e. it captures the phenomenon similarly when measured repeatedly, and therefore is precise, and captures the phenomenon with little error. A consistent and precise metric makes us more confident in what it tells us about the world.
• Its construction is transparent. This means that we prefer metrics that come with a detailed description of how it was constructed, why it was constructed in this way, and with the underlying code and raw data. We, and you as our reader, then can evaluate its strengths and weaknesses in detail.
• It is easy to understand. This means that the metric captures something that people are broadly familiar with, and they can broadly make sense of its construction. It then can provide answers that people beyond experts can learn from.
• It is difficult to misuse. This means that the metrics cannot easily be taken out of context and be misrepresented. This does not mean that the data cannot have flaws — we still provide flawed data if we think that we can learn something from it.
• It is maintained well. This means that the data source updates the metric frequently, and provides reasonably up-to-date data. We often favor data from international institutions (such as the World Bank and the UN) and research institutions (such as the Global Carbon Project and the Varieties of Democracy project) over data from individual academic publications, because the former have the mandate and resources to keep this data up-to-date.
• Its values differ a lot from the same measure by another trusted source. This means a metric captures disagreement across sources. It then helps us to be appropriately uncertain of our answers in light of disagreeing sources.
• It is accessible. This means that the data is published in a publicly accessible document and is licensed to be reused by us and preferably others. Only then can it help people answer their questions, on and beyond our site.
• We have the tools to visualize it. This means a metric is structured such that our in-house visualization tool — the Our World in Data Grapher — can display its information well. For example, our maps are set up to visualize national data, and currently cannot display metrics at the sub-national level or gridded data.

The topics and metrics we present are not set in stone, and we keep thinking about which ones to add. So if you think a topic or metric fits the criteria outlined here, please reach out to us at info@ourworldindata.org.

Acknowledgements

I thank Edouard Mathieu, Esteban Ortiz-Ospina, Hannah Ritchie, and Max Roser for their very helpful comments and ideas about how to improve this article.

Bastian Herre (2023) - “How we choose which topics to work on, and which metrics to provide” Published online at OurWorldInData.org. Retrieved from: 'https://ourworldindata.org/choosing-our-topics-and-metrics' [Online Resource]

@article{owid-choosing-our-topics-and-metrics,
    author = {Bastian Herre},
    title = {How we choose which topics to work on, and which metrics to provide},
    journal = {Our World in Data},
    year = {2023},
    note = {https://ourworldindata.org/choosing-our-topics-and-metrics}
}

Reuse this work freely

All visualizations, data, and code produced by Our World in Data are completely open access under the Creative Commons BY license. You have the permission to use, distribute, and reproduce these in any medium, provided the source and authors are credited.

The data produced by third parties and made available by Our World in Data is subject to the license terms from the original third-party authors. We will always indicate the original source of the data in our documentation, so you should always check the license of any such third-party data before use and redistribution.

All of our charts can be embedded in any site.