Add research workflow guide
This commit is contained in:
1 parent
244249f572
commit
264fd48b06
1 file changed
+81
-2
@@ -1,3 +1,82 @@
|
|||||||
# evidence-based-management
|
# Evidence-Based Management: Using Research to Make Better Organisational Decisions
|
||||||
|
|
||||||
Using research evidence to make better organisational decisions, with a source-linked workflow using Yila https://yila.ai
|
Managers make decisions every day about hiring, team design, incentives, training, restructuring and strategy. Many of these decisions rely on habit, imitation of other organisations, consultants' recommendations or popular business books. Evidence-based management proposes a different approach: making decisions through the conscientious, explicit and judicious use of the best available evidence from multiple sources. The idea borrows from evidence-based medicine but adapts it to the realities of organisations, where controlled trials are rare and context matters greatly. This guide explains the principles of evidence-based management, the four sources of evidence it draws on, how to appraise management research, common pitfalls and how a source-linked research assistant such as [Yila](https://yila.ai) can help managers and researchers find and assess evidence while keeping every claim tied to its source.
|
||||||
|
|
||||||
|
## Why evidence-based management matters
|
||||||
|
|
||||||
|
Management fads come and go. Practices such as forced ranking of employees, open-plan offices, certain team-building programmes and some forms of performance-related pay have been widely adopted with limited evidence and sometimes with harmful effects. At the same time, research has produced robust findings on topics such as goal setting, structured interviews, feedback and psychological safety that are underused in practice.
|
||||||
|
|
||||||
|
The gap between research and practice in management is large. Practitioners rarely read academic journals, academic research is not always designed to answer practical questions, and popular summaries often oversimplify. Evidence-based management aims to close that gap by building habits of asking critical questions and seeking good evidence before acting.
|
||||||
|
|
||||||
|
## Four sources of evidence
|
||||||
|
|
||||||
|
The Center for Evidence-Based Management describes four sources of evidence that should inform decisions.
|
||||||
|
|
||||||
|
### Scientific evidence
|
||||||
|
|
||||||
|
Findings from published research, including experiments, longitudinal studies, meta-analyses and systematic reviews. Scientific evidence is most trustworthy when it comes from well-designed studies, is replicated across settings and is synthesised systematically.
|
||||||
|
|
||||||
|
### Organisational evidence
|
||||||
|
|
||||||
|
Data from within the organisation: performance metrics, turnover rates, customer satisfaction scores, financial data, engagement surveys. Organisational data reveal the actual situation and can be used to test assumptions.
|
||||||
|
|
||||||
|
### Experiential evidence
|
||||||
|
|
||||||
|
The professional expertise and judgement of managers and practitioners, accumulated through experience. It is valuable, particularly in recognising patterns, but is subject to biases such as overconfidence and selective memory.
|
||||||
|
|
||||||
|
### Stakeholder evidence
|
||||||
|
|
||||||
|
The values and concerns of people affected by the decision: employees, customers, suppliers, communities. Stakeholder perspectives help assess acceptability and unintended consequences.
|
||||||
|
|
||||||
|
Good decisions draw on all four, weighing their relevance and trustworthiness.
|
||||||
|
|
||||||
|
## The evidence-based process
|
||||||
|
|
||||||
|
A common framework involves six steps.
|
||||||
|
|
||||||
|
1. **Ask.** Translate a practical issue into an answerable question. Instead of "should we introduce flexible working?", ask "what is the effect of flexible working arrangements on productivity and retention in organisations like ours?"
|
||||||
|
2. **Acquire.** Search systematically for evidence from the four sources.
|
||||||
|
3. **Appraise.** Judge the trustworthiness and relevance of the evidence.
|
||||||
|
4. **Aggregate.** Combine evidence, weighing each source.
|
||||||
|
5. **Apply.** Incorporate evidence into the decision.
|
||||||
|
6. **Assess.** Evaluate the outcome of the decision and learn from it.
|
||||||
|
|
||||||
|
## Appraising management research
|
||||||
|
|
||||||
|
Management research uses varied methods, and quality varies greatly.
|
||||||
|
|
||||||
|
- **Design.** Randomised experiments, including field experiments in organisations, provide strong evidence of causation but are relatively rare. Longitudinal studies with controls for confounding are stronger than cross-sectional surveys. Many management studies are cross-sectional and cannot establish causation.
|
||||||
|
- **Measurement.** Self-reported survey measures collected at the same time from the same respondents can inflate relationships, a problem known as common method variance.
|
||||||
|
- **Sample and context.** Studies with students or a single organisation may not generalise. Consider whether the setting resembles yours.
|
||||||
|
- **Effect size.** Statistically significant effects can be practically trivial. Look for effect sizes and consider whether they justify the cost of change.
|
||||||
|
- **Replication.** Management research has faced replication concerns similar to psychology. Prefer findings supported by meta-analyses and multiple independent studies.
|
||||||
|
- **Conflicts of interest.** Research funded by vendors or consultancies promoting a product may be biased.
|
||||||
|
|
||||||
|
## Using systematic reviews
|
||||||
|
|
||||||
|
Systematic reviews and meta-analyses provide the most efficient route to scientific evidence. For many common management questions, such as the effectiveness of different selection methods, goal setting, feedback or training, meta-analyses exist. Rapid evidence assessments, which use systematic methods within shorter timelines, are increasingly used to inform organisational decisions. When no review exists, a focused search of high-quality studies can still be informative.
|
||||||
|
|
||||||
|
## Common pitfalls
|
||||||
|
|
||||||
|
- **Benchmarking without evidence.** Copying what successful companies do assumes their practices caused their success, which is often unproven.
|
||||||
|
- **Survivorship bias.** Studying only successful organisations ignores those that used the same practices and failed.
|
||||||
|
- **Overreliance on anecdotes.** Vivid stories are persuasive but unrepresentative.
|
||||||
|
- **Misusing organisational data.** Metrics may be incomplete, poorly defined or manipulated. Correlations within organisational data are subject to the same confounding as research data.
|
||||||
|
- **Ignoring context.** Practices that work in one industry, culture or size of organisation may not transfer.
|
||||||
|
- **Overlooking stakeholder concerns.** A decision supported by research may fail if employees perceive it as unfair.
|
||||||
|
|
||||||
|
## Building evidence-based habits
|
||||||
|
|
||||||
|
Organisations can encourage evidence-based practice by asking for evidence when proposals are made, piloting changes before full rollout with proper comparison groups, collecting data to evaluate outcomes and building relationships with researchers. Small experiments, such as trialling a new process in some teams and comparing results with others, can provide organisational evidence quickly and cheaply.
|
||||||
|
|
||||||
|
Managers do not need to become researchers. They need to ask good questions: what is the evidence, how trustworthy is it, does it apply here, and what do the people affected think?
|
||||||
|
|
||||||
|
## Using Yila to find and appraise evidence
|
||||||
|
|
||||||
|
Management research is spread across psychology, economics, sociology and business journals, as well as reports from think tanks and consultancies. Finding relevant studies and judging their quality takes time. [Yila](https://yila.ai) is a research assistant that answers questions with citations linked to the underlying sources. A manager or researcher can ask what meta-analyses have found about a practice, for example structured interviews or flexible working, and then open each cited source to check design, sample and effect sizes.
|
||||||
|
|
||||||
|
Because each claim remains attached to its citation, it becomes easier to separate robust findings from claims repeated in popular articles without strong support. The assistant speeds up the acquisition and initial appraisal of scientific evidence; organisational data, professional judgement and stakeholder input remain essential parts of the decision.
|
||||||
|
|
||||||
|
## Summary
|
||||||
|
|
||||||
|
Evidence-based management means making decisions by combining the best available scientific, organisational, experiential and stakeholder evidence. It involves asking clear questions, acquiring and appraising evidence, weighing it thoughtfully, applying it and evaluating outcomes. Management research varies in quality, so pay attention to design, measurement, context, effect sizes and replication. Avoid benchmarking without evidence and overreliance on anecdotes. With critical habits and tools that keep every claim tied to its source, managers and researchers can improve the quality of organisational decisions.
|
||||||
Reference in new issue
Block a user