Leading With Data· a Bicycle Guide
Guide highlights

Marketing decisions are grounded in an up-to-date, accurate knowledge base. Research spend is matched to the value and risk of decisions, avoiding waste.

  • Define the marketing problem and specify exactly what information is required.
  • Audit internal and secondary sources before commissioning primary research.
  • Choose the right structure and mix of research techniques for the purpose, market and budget.

Book profile

Marketing Research (Chris West (auth.))

One book, placed in its field — what this book gets right, where it goes further than the rest, and what the rest of the field adds.

Edited by Mike West

Choose a reading path or an exercise

Suggested sections

Choose a starting point below. Each link opens a section of this guide.

Do this now — Problem Definition Quality

  1. Write the decision the research must inform as a single sentence, then list the specific information needs that decision requires.
  2. Separate the symptom from its candidate causes and rank those causes before choosing any method.
  3. State scope, deadline and the value of the expected reward in the brief so that the design can be sized against them.
  4. Have the decision maker sign off on the written brief before you commission or begin work.

Then continue in Problem Definition Quality.

Edition 1·Updated 2026-10-03·26 min read

Sources

About this book

An overview of the book, with source information for further reading.

A practical, applications-focused guide that teaches marketing managers how to define information needs, choose research methods, commission and control research projects, and turn market data into decision-ready knowledge.

More on this book

Written for the junior, middle and senior marketing managers who commission or occasionally conduct research rather than for research technicians, this book demystifies the entire market research process from defining the marketing problem to reporting findings. Drawing on the author's 35 years of industrial and business-to-business research experience, it embraces a broad definition of market research that spans formal sample surveys, business intelligence, competitive intelligence, secondary research, and the emerging internet-based techniques of the late 1990s. It shows how research converts data into information and information into a marketing knowledge base that drives better, lower-risk decisions, while remaining candid about costs, time, ethics and the pragmatic trade-offs real businesses must make. Readers learn how to write a research brief, select and control an agency, sample effectively, design questionnaires, analyse and forecast, and integrate results into planning — arriving at accurate, timely, actionable answers rather than 'travelling hopefully.'

Movement I

Orient

In this part

What this book claims, and who wrote it.

  • — The book's one-line promise
  • — The author and where the book stands

A practical, applications-focused guide that teaches marketing managers how to define information needs, choose research methods, commission and control research projects, and turn market data into decision-ready knowledge.

The need-to-know

All research begins with a clearly defined problem; without a problem there is no need for research. Data becomes information through digestion into patterns, and information becomes knowledge through interpretation that supports decisions. The structure of research activity is determined by research purpose, approach, type of market and type of survey.

About this guide

The guide describes these challenges, steps and possible outcomes.

Who it is for

A junior, middle or senior marketing manager who needs reliable market information to make better, lower-risk marketing decisions and wants to commission or conduct research competently.

Challenges

  • In practice · They must obtain accurate, timely market information to support marketing decisions but face confusing choices among techniques, sources, agencies, budgets and time constraints.
  • For the reader · They feel uncertain, intimidated by research jargon and statistics, and anxious about wasting money on research that may not yield a usable answer.

Steps to consider

  1. 1Define the marketing problem and specify exactly what information is required.
  2. 2Audit internal and secondary sources before commissioning primary research.
  3. 3Choose the right structure and mix of research techniques for the purpose, market and budget.
  4. 4Design sound sampling and questionnaires (or select suitable techniques).
  5. 5Write a clear brief, identify and select suitable research resources, and negotiate.
  6. 6Control the project through briefing, progress reviews and quality checks.
  7. 7Analyse, interpret, report and integrate findings into marketing planning — ethically throughout.

Risks

Major decisions taken on incomplete, outdated or biased information. Money wasted on research that fails to answer the real question.

Intended result

Marketing decisions are grounded in an up-to-date, accurate knowledge base. Research spend is matched to the value and risk of decisions, avoiding waste.

Set the record straight

What this book sets straight

The common beliefs this book pushes back on.

The myth

Market research means sample surveys with clipboards, interviewers and statistics.

The reality

Market research encompasses any ethical activity that provides needed market information, including business intelligence, secondary research and informal methods — surveys are only one approach.

The myth

Only the best, most scientifically rigorous and accurate data is worth obtaining.

The reality

Arriving beats travelling hopefully; clients want timely, accurate-enough answers, and a few well-placed calls can be as valuable as an extensive survey when matched to the decision's value.

The myth

Research is so expensive it is the preserve of large corporations.

The reality

Databases, the internet and cheaper techniques now let even small-budget firms build a workable picture of their market, and not researching now courts disaster.

The myth

Companies that use research make above-average profits because research causes the performance.

The reality

No causal relationship is proven; research use is at least a consequence of a management style that produces above-average profits.

The myth

A satisfied customer is a loyal customer.

The reality

Customers defect even when highly satisfied; loyalty is strong only when there are physical barriers to change or satisfaction exceeds that of rivals.

Movement II

Map

The book's main ideas and how they connect.

In this part

Marketing Research (Chris West (auth.))'s own model — and how it sits inside its field.

  • — 13 constructs the book works with
  • — Where it agrees with the field, exceeds it, or fills a gap
The Conditions3· the context you inherit
Budget AvailabilityTime AvailabilityMarket Dynamism
What You Design4· the levers you pull
Research Design AppropriatenessProblem Definition QualitySampling QualityQuestionnaire and Instrument Quality
What It Produces2· the states it creates
Data Quality and AccuracyInformation and Knowledge Base Quality
What You Do2· the behaviours that follow
Respondent Cooperation and Response RateReporting and Presentation Effectiveness

The constructs

Problem Definition Quality

The degree to which the marketing problem and the specific information needs are clearly, precisely and completely specified before research commences, including scope, timing and expected rewards.

Research Design Appropriateness

The extent to which the chosen research mix — purpose, approach, market type, survey type, sampling and technique — is well matched to the information needs, market conditions and constraints of the project.

Sampling Quality

The degree to which the sample is representative and correctly structured relative to the universe, with adequate size and minimal bias, exclusion and non-response so that results can be validly inferred to the market.

Questionnaire and Instrument Quality

The clarity, unambiguity, logical flow, appropriate wording and freedom from bias of the data collection instrument, enabling consistent and accurate responses across respondents.

Budget Availability

The financial resources available for the research programme relative to the value placed on the data, which constrains the scale, techniques and accuracy achievable.

Time Availability

The amount of time available to complete the research programme, which constrains technique choice and drives use of readily available or rapid data collection methods.

Market Dynamism

The rate and diversity of change in the market environment, including technical development, competitive pressure and rising customer expectations, which increases the need for and value of current market knowledge.

Respondent Cooperation and Response Rate

The willingness and ability of targeted respondents to participate and provide complete, accurate answers, affected by research fatigue, sensitivity of topics, voicemail, company policy and ethical assurances.

Data Quality and Accuracy

The accuracy, completeness, consistency and freedom from bias of the collected data, controlled through editing, verification, coding and appropriate methodology.

Information and Knowledge Base Quality

The extent to which data has been digested into patterns (information) and interpreted into actionable understanding (knowledge) that reveals how the market works, threats, opportunities and likely consequences of actions.

Reporting and Presentation Effectiveness

The clarity, comprehensiveness, accuracy and assimilability with which findings are communicated to and accepted by decision makers, including written reports and oral presentations.

Marketing Decision Qualitythe outcome

The degree to which marketing decisions are well-informed, correctly targeted and de-risked as a result of the knowledge derived from research.

Business and Market Performance

Business outcomes such as market share, profitability, successful new product launches and reduced risk of losses associated with a research-informed marketing style.

How they connect (14)
  • Problem Definition Quality → influences → Research Design Appropriateness
  • Research Design Appropriateness → predicts → Data Quality and Accuracy
  • Sampling Quality → predicts → Data Quality and Accuracy
  • Questionnaire and Instrument Quality → predicts → Data Quality and Accuracy
  • Questionnaire and Instrument Quality → influences → Respondent Cooperation and Response Rate
  • Respondent Cooperation and Response Rate → mediates → Data Quality and Accuracy
  • Data Quality and Accuracy → predicts → Information and Knowledge Base Quality
  • Information and Knowledge Base Quality → predicts → Marketing Decision Quality
  • Reporting and Presentation Effectiveness → influences → Marketing Decision Quality
  • Information and Knowledge Base Quality → influences → Reporting and Presentation Effectiveness
  • Marketing Decision Quality → correlates → Business and Market Performance
  • Budget Availability → moderates → Research Design Appropriateness
  • Time Availability → moderates → Research Design Appropriateness
  • Market Dynamism → moderates → Information and Knowledge Base Quality

Where this book diverges from the corpus

  • fills gap The book's up-front specification of the marketing problem, information needs, scope, timing and expected rewards has no direct counterpart; the field's nearest construct, KPI and objective setting, concerns performance tracking rather than research scoping.
  • fills gap The book's fit of purpose, approach, market type, survey type, sampling and technique to needs and constraints covers primary-research design, which the field's analytics-focused rigor construct addresses only on the modeling side.
  • exceeds The book treats sample representativeness, size, bias, exclusion and non-response as an explicit inference-validity construct, while the field only touches representativeness inside broader data-foundation quality.
  • fills gap Research budget as a constraint on scale, technique and accuracy is not a construct in the field's reconciled model.
  • fills gap Time as a constraint driving technique choice and rapid or readily available data is not covered by the field's constructs.
  • fills gap The book's focus on willingness to participate, research fatigue, sensitive topics and non-response is a survey-fieldwork concern; the field's Conversion and Response Rate is about marketing offers, not research participation.

Movement III

Master

Explore the book's ideas, examples and practical tools.

In this part

How the author makes the case — section by section, with the book's own tools.

  • — 13 sections, in the book's order
  • — The book's frameworks, checklists, and worked cases
Time Availability
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section looks at how deadlines shape which techniques are feasible and when speed justifies readily available or rapid methods. It shows how to decide what to sacrifice when time is short.

Time Availability

The amount of time available to complete the research programme, which constrains technique choice and drives use of readily available or rapid data collection methods.

Why it matters. Time pressure that goes unmanaged pushes teams into whichever data is quickest to hand, which may not answer the question at all.

Myth

If the deadline is tight, any quick data is better than waiting for the right data.

Reality

Speed is only valuable when the faster source still addresses the information need. Rapid methods suit a focused question; used on a poorly matched one, they deliver a prompt but unusable answer.

The least you need to know
  • Under time pressure, prioritise information needs rather than shrinking every stage equally.
  • Fast data is useful only where it covers the right population and the right question.
  • Plan analysis time explicitly, since it is the stage first sacrificed.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Time-Constrained Research Plan Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Market Dynamism
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section explains how the pace and diversity of market change raise the value of current knowledge and shorten its useful life. It helps you decide how often to refresh what you know.

Market Dynamism

The rate and diversity of change in the market environment, including technical development, competitive pressure and rising customer expectations, which increases the need for and value of current market knowledge.

Why it matters. In a fast-moving market, knowledge that was accurate last year can silently mislead today's decisions.

Myth

Once a thorough market study is done, its findings stay reliable until the next scheduled review.

Reality

Technical change, competitor moves and rising customer expectations erode the shelf life of findings at different rates. The more dynamic the market, the more research must run as a continuing process rather than as periodic one-offs.

Tools for this
The least you need to know
  • The faster the market changes, the shorter the useful life of any finding.
  • Match refresh frequency to the rate of change in each topic area.
  • Tracking beats one-off studies where customer expectations and competition shift quickly.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Market Dynamism Knowledge-Currency Audit” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 4 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Respondent Cooperation and Response Rate
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section covers what determines whether targeted people take part and answer fully and honestly, from research fatigue and voicemail to topic sensitivity and company policy. It offers ways to raise participation without compromising ethics.

Respondent Cooperation and Response Rate

The willingness and ability of targeted respondents to participate and provide complete, accurate answers, affected by research fatigue, sensitivity of topics, voicemail, company policy and ethical assurances.

Why it matters. Low or selective participation means the people who answer differ from those who do not, and the data you have is quietly biased.

Myth

Response rate is a fieldwork statistic, and as long as you reach the target number of completes the data is sound.

Reality

The number of completes says nothing about who declined. If refusals concentrate among busy executives or sensitive-topic respondents, you reach your quota and still miss the people who matter most.

Tools for this
The least you need to know
  • Who refuses matters more than how many refuse.
  • Trust, brevity and relevance raise cooperation more reliably than incentives alone.
  • Track non-response by segment so you can see and correct skew.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Response-Rate Risk and Countermeasure Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 4 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Data Quality and Accuracy
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section shows how to control the accuracy, completeness, consistency and freedom from bias of collected data through editing, verification and coding. It also traces how design, sampling, instruments and respondent cooperation each feed into the result.

Data Quality and Accuracy

The accuracy, completeness, consistency and freedom from bias of the collected data, controlled through editing, verification, coding and appropriate methodology.

Why it matters. Analysis can only be as sound as the data under it, so undetected errors flow straight into the findings and the decisions.

Myth

Data quality is a clean-up task handled by editing after fieldwork finishes.

Reality

Editing removes visible errors but cannot restore a biased sample, a leading question or a design that measured the wrong thing. Quality is mostly built in upstream and only verified at the end.

Tools for this
The least you need to know
  • Data quality is determined mainly by design, sampling, instrument and cooperation, with editing as the last safeguard.
  • Verify during fieldwork, when problems can still be corrected.
  • Benchmark the dataset against known figures before trusting it.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Data Item Verification Log” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 4 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Information and Knowledge Base Quality
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section explains how raw data becomes patterns (information) and then actionable understanding (knowledge) of how the market works, where the threats and opportunities lie, and what actions are likely to cause. It also covers how to keep that understanding current.

Information and Knowledge Base Quality

The extent to which data has been digested into patterns (information) and interpreted into actionable understanding (knowledge) that reveals how the market works, threats, opportunities and likely consequences of actions.

Why it matters. Without interpretation, even excellent data stays a pile of numbers, and decision makers fall back on instinct.

Myth

Accurate data automatically produces insight, so more tables and more data points mean more knowledge.

Reality

Insight comes from interpretation: connecting patterns to causes and to the likely consequences of actions. Large volumes of data without that step produce confusion, and the knowledge needs revisiting as the market moves.

Tools for this
The least you need to know
  • Information is a pattern; knowledge is an understanding of cause and consequence.
  • Accumulate and date findings so that each study builds on the last.
  • Every result should end in a stated implication for action.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Knowledge Base Item Audit Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 3 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Reporting and Presentation Effectiveness
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section covers how to present findings so that decision makers can grasp, trust and act on them, in both written reports and oral presentations. It focuses on the gap between being correct and being accepted.

Reporting and Presentation Effectiveness

The clarity, comprehensiveness, accuracy and assimilability with which findings are communicated to and accepted by decision makers, including written reports and oral presentations.

Why it matters. Sound findings that are poorly communicated are ignored or misread, and the research money is wasted at the final step.

Myth

A comprehensive report that includes all the data is the most professional way to communicate findings.

Reality

Decision makers assimilate what is prioritised and clear, not what is complete. Burying the answer in exhaustive detail invites the reader to skip it, so completeness belongs in an appendix while the body carries the conclusions.

Tools for this
The least you need to know
  • Lead with the answer and the recommendation, and put the detailed data in the appendix.
  • Acceptance depends on credibility and clarity as much as on accuracy.
  • State limitations up front to protect trust.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Report Readiness Check (comprehensiveness, accuracy, assimilation)” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 5 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Marketing Decision Quality
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section explains how well-informed, correctly targeted and de-risked decisions come from research knowledge, and how to judge whether research has improved them. It ties the earlier constructs to business outcomes.

Marketing Decision Quality

The degree to which marketing decisions are well-informed, correctly targeted and de-risked as a result of the knowledge derived from research.

Why it matters. Decision quality is the point at which research either pays for itself through reduced risk and better targeting or proves to have been an expense.

Myth

Research is meant to produce the right answer, so a decision that goes wrong shows that the research failed.

Reality

Research reduces risk; it does not remove uncertainty. A good decision is one that used the available knowledge well and was properly de-risked, and a poor outcome can still follow, while a lucky outcome can follow a poor decision.

Tools for this
  • Marketing Decision QualityFramework — How this mechanism is run, step by step, as the literature describes it.
  • Marketing Decision Quality — decision rulesChecklist — 5 checkpoints
  • Marketing Decision QualityCase study — The preface describes the benchmark: the company with the better mousetrap is now much more likely to have analysed customer requirements, tested the concept, estimated potential demand, researched customer satisfaction with existing products and obtained intelligence on competitors before launch.
The least you need to know
  • Good research lowers the risk of a decision without guaranteeing its outcome.
  • Assess decisions on the quality of the evidence used as well as on the result.
  • Set success measures before launch so that research can be shown to add value.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Decision-to-Evidence Brief” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 3 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Business and Market Performance
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section shows how to tie marketing research to the outcomes the business actually tracks: share, profit, launch success and avoided losses. It gives you a way to judge whether research is earning its budget.

Business and Market Performance

Business outcomes such as market share, profitability, successful new product launches and reduced risk of losses associated with a research-informed marketing style.

Why it matters. If you cannot link research to performance, it gets cut as overhead in a downturn, or it gets credited for wins it never influenced and so never improves.

Myth

Strong market and profit results prove that your research was good, and weak results prove that it was bad.

Reality

Performance is shaped by pricing, competitors, execution and luck as well as research, so results alone cannot grade the research. The link runs through decision quality: research earns its credit when it improves specific decisions, and the gain often appears as losses avoided, such as a cancelled doomed launch, which no results table records.

Tools for this
The least you need to know
  • Judge research by the quality of the decisions it improves, then test whether better decisions move share, profit and launch success.
  • Set the performance metric and the baseline before the study begins, or you cannot claim any effect afterwards.
  • Count avoided losses, such as cancelled weak concepts, as performance, because they are often where research pays back most.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Research-to-Outcome Brief” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 4 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Problem Definition Quality
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section shows how to turn a vague managerial worry into a research brief that specifies the problem, the information needed, the scope, the timing and the expected payoff. Everything downstream inherits whatever precision you set here.

Problem Definition Quality

The degree to which the marketing problem and the specific information needs are clearly, precisely and completely specified before research commences, including scope, timing and expected rewards.

Why it matters. A fuzzy problem statement produces a technically flawless study that answers the wrong question, and you pay for it in full.

Myth

The problem is obvious to everyone involved, so you can start fieldwork and refine the question as the data comes in.

Reality

The stated symptom, such as falling sales, is rarely the decision problem. Fieldwork cannot repair a brief that never separated the symptom from its causes, and every redesign after launch costs time and budget you have already committed.

Tools for this
The least you need to know
  • A research brief is complete only when it names the decision, the information needs, the scope, the timing and the expected reward.
  • Spend disproportionate effort on definition, because it is the cheapest point at which to correct an error.
  • Get the decision maker's written agreement on the problem before design starts.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Problem Definition Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 7 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Research Design Appropriateness
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section covers how to assemble the research mix of purpose, approach, market type, survey type, sampling and technique into a design that fits the problem and its constraints. It also explains why the same problem can warrant different designs on different budgets and deadlines.

Research Design Appropriateness

The extent to which the chosen research mix — purpose, approach, market type, survey type, sampling and technique — is well matched to the information needs, market conditions and constraints of the project.

Why it matters. A mismatched design yields data that is precise about the wrong thing, or too thin to support the decision it was commissioned for.

Myth

A bigger, more sophisticated design, such as a large quantitative survey, is always the safer choice.

Reality

Appropriateness is fit, not scale. An exploratory problem needs qualitative depth, a consumer market and an industrial market call for different survey types, and an expensive design that outruns the problem wastes the budget that a sharper one would have used well.

Tools for this
The least you need to know
  • Choose each element of the research mix because of a specific information need, not out of habit.
  • The right design differs by market type, so a consumer template should not be reused on an industrial problem.
  • When constraints bite, trim scope before you compromise the core technique.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Research Design Fit Check” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 5 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Sampling Quality
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section explains how to build a sample that represents the universe in structure and size, and how to limit bias, exclusion and non-response. It gives you checks to run before and after fieldwork.

Sampling Quality

The degree to which the sample is representative and correctly structured relative to the universe, with adequate size and minimal bias, exclusion and non-response so that results can be validly inferred to the market.

Why it matters. If the sample does not mirror the market, every percentage in the report is wrong, however polished the questionnaire and analysis.

Myth

A large sample is a good sample, so adding respondents fixes accuracy concerns.

Reality

Size reduces random error only. A large sample drawn from a flawed frame, or one skewed by who declines to answer, repeats the same bias with false confidence.

Tools for this
The least you need to know
  • Representativeness comes from the frame and the response pattern, not from the headline sample size.
  • Size the sample to the smallest sub-group you must report on.
  • Compare achieved sample structure with the known universe before you analyse anything.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Sampling Quality Audit Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 4 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Questionnaire and Instrument Quality
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section sets out how to write instruments that every respondent reads the same way and that stay free of bias, in sensible order. It also shows how instrument design affects whether people finish answering.

Questionnaire and Instrument Quality

The clarity, unambiguity, logical flow, appropriate wording and freedom from bias of the data collection instrument, enabling consistent and accurate responses across respondents.

Why it matters. Ambiguous or leading questions distort answers at the source, and a tedious instrument drives people away before they complete it.

Myth

Questionnaire design is a matter of common sense, so a draft written by the project team is ready for the field.

Reality

Writers read their own questions with full knowledge of intent, so they cannot see the ambiguity, double-barrelled phrasing or order effects that respondents trip over. Only testing on people outside the team exposes these flaws.

Tools for this
The least you need to know
  • Every question should earn its place by mapping to an information need.
  • A pilot with real target respondents catches problems that internal review cannot.
  • Wording, order and length affect both answer accuracy and completion.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Questionnaire Quality Review Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 3 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Budget Availability
strong · 1 source
  • Marketing Research (Chris West (auth.))
In this section

This section explains how the funds available set the boundaries of scale, technique and accuracy, and how to weigh that against the value of the decision. It helps you make trade-offs deliberately.

Budget Availability

The financial resources available for the research programme relative to the value placed on the data, which constrains the scale, techniques and accuracy achievable.

Why it matters. Budget treated as a fixed number rather than a judgement about value leads to underfunded studies that cannot support the decisions resting on them.

Myth

Research budget is a fixed cost to be minimised, and a cheaper study is a more efficient one.

Reality

Efficiency is measured against the value at stake in the decision. A cheap study with sampling too thin to discriminate between options is more expensive than none, because it licenses a confident wrong move.

Tools for this
The least you need to know
  • Justify the budget against the value of the decision, not against last year's spend.
  • A reduced budget calls for a narrower scope, not a diluted version of the full design.
  • Exhaust cheap existing data before you buy primary data.
Master this◆ Paid

The deep drill-down: 8 operational steps, a worked example from the source, 5 decision rules, 5 failure modes, and the “Budget-to-Value Research Scoping Sheet” tool. Included when you buy this guide.

The rest of this section

the full written section · 4 how-to steps · 2 pitfalls to watch for · 5 tools for this section. Included when you buy this guide.

Grounded in: Marketing Research (Chris West (auth.))

Movement III · The run-it-now depth

The Playbook

Practical tools and examples from this guide.

Frameworks

Frameworkfree

Budget Availability

How this mechanism is run, step by step, as the literature describes it.

  1. 1Start by pricing the decision, not the survey. Write down what the data will be used for and what rides on it. The passages show the range: a 'nice to know' item at one end, and at the other TV advertising revenue, executive performance bonuses, and roughly £350 million of London bus revenue apportioned by passenger survey. The higher the stakes, the more accuracy the budget has to buy.
  2. 2Test the 'we already know our market and the cost can't be justified' objection. The passages name it as the usual reason firms spend nothing. Write down what you believe about the market, then list which beliefs would change a decision if they proved wrong. Spend only on those.
  3. 3Set a budget tier before choosing techniques. With a minimal budget, build a 'rough and ready portrait' from the internet, intranets and databases. With a mid-range budget, add cheap internal and informal sources. Reserve large-scale surveys and advanced techniques for decisions where the data's value is high.
  4. 4Mine free internal sources first. Collect salespeople's reports (acknowledged as a major, rarely pooled information store), contacts from trade shows, and conversations with colleagues. Pool and compare them, because the passages say the picture sharpens when data from all salespeople is rationalised. Treat the result as biased but cheap.
  5. 5Check for work already paid for. Look in the existing marketing information system and secondary sources (written records, data disks, CD-ROMs, internal files, syndicated feeds) so the same task isn't repeated in separate parts of the organisation.
  6. 6Re-test technique costs against current prices. Computer-aided interviewing (CATI, CAPI, CASI) once had set-up costs so high that it paid only on large-scale surveys. It can now be used even when interview numbers are low, so an old 'too expensive' verdict may no longer hold.
  7. 7Stage the spend on systems. If you build a knowledge or information system, run a manual version first and prove it works and is accepted before investing in hardware and software. A part-time, update-on-demand approach can be the more cost-efficient option when the data does not need constant consultation.
  8. 8Fix the accuracy–cost trade-off in writing. State the accuracy level needed, the scale and techniques the budget supports, and what you are knowingly giving up. Use this to compare agency proposals and to explain cost variations.
Framework◆ Paid

Business and Market Performance

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Data Quality and Accuracy

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Marketing Decision Quality

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Information and Knowledge Base Quality

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Market Dynamism

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Problem Definition Quality

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Questionnaire and Instrument Quality

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Reporting and Presentation Effectiveness

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Research Design Appropriateness

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Respondent Cooperation and Response Rate

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Sampling Quality

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Framework◆ Paid

Time Availability

How this mechanism is run, step by step, as the literature describes it.

◆ The full 8-step framework — included with this guide purchase

Checklists

Checklistfree

Budget Availability — decision rules

  • If the data will drive revenue, bonuses or other financial transactions, then budget for high accuracy and sampling that all parties will accept; do not use a rough portrait.
  • If the decision is low-stakes or the budget is minimal, then use the internet, databases, intranets and internal sources to build a rough picture, and say explicitly that it is rough.
  • If the stated reason for not researching is 'cost can't be justified', then ask what a wrong belief would cost in the decision before accepting it.
  • If you last priced a technique (such as computer-aided interviewing) when set-up costs forced large samples, then re-price it, because it now works at low interview numbers.
  • If you are tempted to buy a knowledge-management system, then run a manual version first and invest in hardware and software only after it is proven and accepted.
Checklist◆ Paid

Business and Market Performance — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Data Quality and Accuracy — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Marketing Decision Quality — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Information and Knowledge Base Quality — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Market Dynamism — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Problem Definition Quality — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Questionnaire and Instrument Quality — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Reporting and Presentation Effectiveness — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Research Design Appropriateness — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Respondent Cooperation and Response Rate — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Sampling Quality — decision rules

◆ All 5 checkpoints — included with this guide purchase

Checklist◆ Paid

Time Availability — decision rules

◆ All 5 checkpoints — included with this guide purchase

Case studies — including what didn't work

Case studyfree

Budget Availability

Context

The passages give a stakes-versus-budget contrast. A UK survey found that 60 per cent of companies with sales under £2.5 million had no research budget, against 15 per cent for companies with sales above £20 million. Meanwhile some £350 million of London bus revenue, not collected on the buses, is apportioned between operators on the basis of a passenger survey. The passage's own conclusion is that 'with stakes this high, the research must be accurate and acceptable to all the parties concerned.' Applied to budgeting: the bus survey's value justifies a large, accurate programme. A small firm with no research budget can still compile a rough and ready portrait through the internet, databases, salespeople's reports and trade-show contacts. The mistake is to apply the small-firm approach to a decision with bus-survey stakes, or the reverse. Match spend to the value placed on the data, and accept the lower accuracy at the lower tier.

Case study◆ Paid

Business and Market Performance

Context

Take the one quantitative finding in the source and use it to decide where you stand. The survey found that 60 per cent of companies with sales under £2.5 million had no research budget, falling to 15 per cent for companies with sales above £20 million. Fast moving consumer goods suppliers were twice as likely to use research as other types of company. Companies that used research were more likely to make above-average profits and less likely to incur losses, but no causality was shown. Suppose you run a small non-FMCG supplier with no research budget, and you justify that by saying you already know your market. The source says this is the usual reason firms skip research, and that the cost 'cannot be justified' is the standard objection. The correct move is not to buy a large survey. Start with one live decision, such as a new product launch. Pull the routine data you already hold (sales by product and customer category, margins, competitor prices and share movements), run a pre-test of the proposal, and plan a post-test. Judge success against the outcome you named at the start, such as share in one segment or avoided launch loss. You are building the research habit the source associates with better profit performance, without claiming it guarantees that performance.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Data Quality and Accuracy

Context

The source describes a forklift truck purchase. The plant manager, warehouse manager and financial director are visible in the decision, but the truck operators may not be acknowledged, even though they exert a strong 'behind-the-scenes' influence. Management cares about load-carrying capability, speed, fuel economy and purchase price, while operators may care more about comfort and safety. A survey that interviews only the three visible managers produces clean, consistent answers that are systematically incomplete: the benefits operators seek never appear. The fix is a coverage check. List all roles in the buying unit, then add operator interviews or flag the gap in the report. The same source warns that customers may claim a competitor offered lower prices to gain leverage in negotiation. Any such price statement from a salesperson's call report is therefore logged as a claim, then checked against a second route, such as another respondent or published information, before it feeds a pricing decision.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Marketing Decision Quality

Context

The preface describes the benchmark: the company with the better mousetrap is now much more likely to have analysed customer requirements, tested the concept, estimated potential demand, researched customer satisfaction with existing products and obtained intelligence on competitors before launch. Apply it to a product launch decision. Decision: launch, modify or hold. Step one is internal records and secondary sources for the rough market portrait and the information gap. Step two is research on customer requirements and concept testing, which de-risks targeting. Step three is potential demand estimation, which sizes the prize. Step four is a competitor information profile (Box 4.6). A salesperson reports that a rival is undercutting on price. Treat that as an unverified claim and check it against a second source before it shapes your price. Each of the five stages removes a specific uncertainty, so by launch the decision is informed, targeted and de-risked rather than a bet. The source's contrast: smaller firms once assumed competitors were equally ignorant, and doing so now 'would be courting disaster'.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Information and Knowledge Base Quality

Context

A sales rep reports that a key customer says a competitor has offered lower prices and better payment terms. Taken at face value, this is a single data point, and it comes from a source the book flags twice. Customers know what happens to what they tell salespeople, and they sometimes plant inaccurate information to exert price pressure. Pricing is where this is most pronounced. The rep also has a natural bias towards defending the company's product. So you log it as a customer claim made during a negotiation, not as competitor information. You then look for corroboration from other sources: other customers, trade-show contacts, published information, and the competitor profile you already hold. If two or more independent sources show the same pattern, you have information, meaning a pattern across observations. You then interpret it against company knowledge to reach an actionable statement about what a price move would likely cause. If nothing corroborates it, it stays a flagged claim and does not drive a price cut.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Market Dynamism

Context

The Nielsen history in the source shows measurement tools changing as the market's information needs changed. Art Nielsen began with economic and engineering analyses for manufacturers of industrial products. He then launched the Nielsen Drug Index and the Nielsen Food Index. These were retail audits that let manufacturers track their sales and market shares. In 1936 he started a radio audience measurement service using 'audiometers', which recorded the stations a sample of radio sets was tuned to. Radio research then led on to television ratings. The reading for a practitioner is that each new market or medium needed a new way of knowing it. A knowledge base built for one environment would not have covered the next. Apply the same test to yourself. If you enter a new channel or medium, ask whether your current measurement instruments can see it. If they cannot, the gap goes at the top of your audit.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Problem Definition Quality

Context

The preface describes the company with 'the better mousetrap': before launch it analysed customer requirements, tested the concept, estimated potential demand, researched customer satisfaction with existing products and gathered intelligence on competitors. A poorly defined brief would say 'research the market for our new mousetrap'. A well-defined one starts from the decision, which is whether and how to launch. It then lists those five needs as separate questions. Before commissioning a survey, the team audits what it already knows from internal records, salespeople's reports and published sources, and marks the remaining information gaps. It then attaches the deadline (the launch date), the budget, the countries or regions covered and the accuracy required for the demand estimate. Needs that would not change the launch decision, such as nice-to-have attitude data, are labelled ancillary and cut or deferred. The result is a specification where each question has an owner, a source and a purpose, and the findings are 'right, can be shown to be right, and are on time'.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Questionnaire and Instrument Quality

Context

The passages supply a word-substitution test you can run on a draft consumer-purchase questionnaire. A draft asks: 'Which sort do you like, and where do you get it?' Each word fails. 'Sort' is colloquial where 'brand' is meant. 'Like' is vague where 'prefer' is meant. 'Where' does not say whether you want a town or a store, so it becomes 'in which shop'. 'Get' could mean buy, receive or borrow, so it becomes 'purchase'. The rewrite is: 'Which brand do you prefer, and in which shop do you purchase it?' Next, check the draft for words that vary by respondent, such as 'dinner', which one respondent reads as the midday meal and another as the evening meal. Specify the meal or time of day instead. Then send the draft to the managers who will use the results. They will not redesign it, but they can flag a missing option, a term their customers do not use, or a question respondents could not answer. Only after that review does the full-scale launch go ahead.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Reporting and Presentation Effectiveness

Context

Take a multinational that commissions a European study using a common budget-saving design: the top four countries (France, Germany, Italy and the UK) surveyed in full, plus a sample of small countries such as the Netherlands, Switzerland or Sweden, with results extrapolated to the remaining markets. The comprehensiveness check puts the original objective, 'size and attractiveness of every European market', against the findings. The four large markets and the sampled small markets are covered directly. The remaining markets are covered only by extrapolation, so each one is a gap that must be stated, with its basis. The report says which countries were measured and which were extrapolated, and it does not present the extrapolated figures as survey results. Before writing, the researcher checks accuracy by confirming that the sampled countries are representative of the market types that remain. The headline answer goes first and the detailed tabulations sit behind it. The main contractor reviews the findings with the local sub-contractors before delivery and then handles client liaison. The same logic applies to speed: television audience clients need the previous night's viewing figures on their desks each morning, so an online format replaces printed reports. The format is chosen by how the client uses the data.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Research Design Appropriateness

Context

Customer satisfaction research shows design appropriateness in practice. A supplier of venture capital wants to know why customers choose it. A design that only asks customers to rank service aspects by importance is mismatched to the question. Surveys repeatedly show that users rate 'a deal on favourable terms to themselves' as the most important aspect, yet they still use suppliers whose terms they regard as adverse. The better-matched design has the three elements of a customer satisfaction survey: a list of the attributes customers use to judge suppliers, ratings of each supplier's performance on every attribute, and a rating of overall satisfaction. Importance weightings are added, and explanations for poor ratings, loyalty and willingness to recommend can be asked as well. Regression of attribute performance on overall satisfaction then yields derived importance. Setting stated importance against derived importance exposes the gap between what customers say matters and what influences their behaviour. Awareness questions can be added, because a supplier with low awareness outside its customer base is unlikely to gain share however satisfied its customers are.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Respondent Cooperation and Response Rate

Context

The passages give the telecommunications and IT sectors as examples of respondent fatigue: they have been over-researched, so refusals climb. Suppose you must interview buyers in such a sector by telephone. Your first problem is that voicemail filters make it easy for them to refuse the call. Your second is that the people who do answer ask whether they want to be bothered and whether they are the right person. You respond by opening with a statement of the survey's purpose, who is eligible, and the value of their input to the client's marketing programme. You put screening questions up front so anyone genuinely unable to answer is politely dropped, and you start the interview with easy, interesting questions. You place personal or difficult items at the end and avoid any request for mental arithmetic. Because refusals in this sector also threaten sample accuracy, you record the response rate and note where refusals cluster rather than reporting the achieved sample as if it were representative.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Sampling Quality

Context

The source's retail research comparison shows sampling quality being checked against an external reference. A retail audit draws on a sample of retail outlets. A consumer panel draws on a sample of customers. Both are described as achieving high accuracy by covering large samples of respondents or a high proportion of outlets. The source also says what passes through retail outlets should agree with purchases made by customers. That agreement is a validity test: if the two samples disagree, one of them is mis-structured or has gaps. Electronic point-of-sale collection is moving audits toward censuses, which removes sampling error, but not all retailers cooperate. So even a near-census carries exclusion, and the missing retailers must be identified and described. A practitioner would run both sources, reconcile the totals, name the non-cooperating outlet types, and say in the report which part of the market the figures cover. The passages give no figures for this case, so none are invented here.

◆ What happened, and the outcome — included with this guide purchase

Case study◆ Paid

Time Availability

Context

The passages give no dated project, so this is a constructed illustration built only from the source's mechanics. A marketing manager must answer 'How much of it can I expect to sell?' (one of the source's key marketing questions) before a planning meeting. She writes the decision date into the problem definition alongside the territories and the expected reward. She first pulls the published reports and multi-client studies available on the market and queries databases over the internet. Next she collects the salespeople's reports and compares them to see where they agree. This gives her a rough market portrait quickly and cheaply. The gap is customer attitudes, which the published sources do not cover. A telephone survey run through a CATI system fits the window: names are distributed automatically, interrupted interviews are re-presented, quotas close when filled, and the data is ready for instant analysis. She flags the salespeople's input as biased and the secondary data as unverified, and reports both caveats with the numbers.

◆ What happened, and the outcome — included with this guide purchase

Templates

Templatefree

Budget-to-Value Research Scoping Sheet

Template◆ Paid

Research-to-Outcome Brief

◆ The fillable template — included with this guide purchase

Template◆ Paid

Data Item Verification Log

◆ The fillable template — included with this guide purchase

Template◆ Paid

Decision-to-Evidence Brief

◆ The fillable template — included with this guide purchase

Template◆ Paid

Knowledge Base Item Audit Sheet

◆ The fillable template — included with this guide purchase

Template◆ Paid

Market Dynamism Knowledge-Currency Audit

◆ The fillable template — included with this guide purchase

Template◆ Paid

Problem Definition Sheet

◆ The fillable template — included with this guide purchase

Template◆ Paid

Questionnaire Quality Review Sheet

◆ The fillable template — included with this guide purchase

Template◆ Paid

Report Readiness Check (comprehensiveness, accuracy, assimilation)

◆ The fillable template — included with this guide purchase

Template◆ Paid

Research Design Fit Check

◆ The fillable template — included with this guide purchase

Template◆ Paid

Response-Rate Risk and Countermeasure Sheet

◆ The fillable template — included with this guide purchase

Template◆ Paid

Sampling Quality Audit Sheet

◆ The fillable template — included with this guide purchase

Template◆ Paid

Time-Constrained Research Plan Sheet

◆ The fillable template — included with this guide purchase

Items marked Paid are included when you buy this guide.

Movement IV

Reflect

Consider the book's evidence, limitations and how it compares with other sources.

In this part

How good is it — where the book stands against the field, what it leaves open, and when to trust it.

  • — Its positioning, its critique, its blind spots
  • — When to apply it — and when not
  • — The evidence behind the advice

Book profile · in the corpus

This book’s model, against the corpus

8 of 13 constructs align with the field · 5 the book adds · 2 where it diverges · the field spans 36 constructs across 38 books

shared with the corpusthis book's own emphasisthe corpus adds (other sources)where it diverges

Shared with the corpus — corroborated by other sources

Sampling QualityQuestionnaire and Instrument QualityMarket DynamismData Quality and AccuracyInformation and Knowledge Base QualityReporting and Presentation EffectivenessMarketing Decision QualityBusiness and Market Performance

This book's own emphasis — where it's the authority

Problem Definition QualityResearch Design AppropriatenessBudget AvailabilityTime AvailabilityRespondent Cooperation and Response Rate

Where it diverges — the book and the field pull apart

Sampling QualityReporting and Presentation Effectiveness

The corpus adds — from 37 other sources this book doesn't cover

The full field guide folds in ideas this book doesn’t reach — drawn from 37 further sources and cited in the full model.

This book’s place in the corpus

1 of 38
sources in this corpus
13
constructs contributed
8
corroborated by others
5
unique to this book

Why the corpus guide, not just this book

The book stands on the traditional market-research tradition and is the authority on the front end of research: problem definition, design, sampling, questionnaires, and budget, time and respondent constraints. The reconciled field-guide still adds analytics capability, experimentation, personalization, ROI and CLV measurement, privacy risk and organizational enablers, which the book does not address.

This guide stands on the shoulders of this book and 37 other sources — every claim cited, the disagreements named.

Read the reconciled Marketing Analytics guide →

Read it closely

The book, examined

Not a summary — a close analytical reading: how the book is built, what it leaves open, and where it falls short.

How it’s built — the argument in order

  1. 01
    Opening framing: the purpose of research and the manager's role — Argues that all research starts from a defined marketing problem. It separates data, information and knowledge, and addresses managers who commission research rather than technicians. The scope is broad: surveys, business intelligence, competitive intelligence and secondary research.
  2. 02
    Defining information needs and the structure of research activity (early chapters, incl. Ch. 4 on the data a market survey can provide) — Links research purpose, approach, type of market and type of survey. Lists the market parameters a strategy needs: customer characteristics, ownership, use, purchases, source and procedure of purchase, awareness, attitudes and recall of communications. Sets the budget by the value of the data, not just its cost.
  3. 03
    Choosing the research approach (Ch. 5) — Distinguishes qualitative from quantitative work and descriptive surveys from modelling exercises. Says problems can sometimes be solved by qualitative work alone, or a survey can start without a prior qualitative stage. Positions business and competitive intelligence as valid alternatives when surveys are impractical, too slow or too costly. Defines surveys as descriptive, with sample size set by market structure, detail and accuracy.
  4. 04
    Secondary and desk sources (Ch. 6) — Covers internal and external existing information, including online databases and the internet. The internet is expected to displace much physical library searching and is developed further in Ch. 12.
  5. 05
    Sampling (Ch. 7) — Argues a census is rarely practical, so a sample can be accurate enough for decisions. Error is quantifiable and falls as sample size grows, so there are low-, medium- and high-cost answers differing in confidence rather than in kind of data. Shows stratification and weighting with a worked consumer example. Notes that industrial markets need a census or complex stratification, and that manufacturers' knowledge of their markets and the definition of the universe are shaky.
  6. 06
    Conventional primary research techniques (Ch. 10) — Surveys the standard fieldwork methods, including mystery shopping and its ethical objections. Ends on the growing problem of response and refusal rates, with causes: respondent fatigue, cynicism, data protection publicity, and voicemail filtering in industrial research.
  7. 07
    Internet-based techniques (Ch. 12) — Treats the emerging late-1990s online tools as both a secondary source and a primary research channel.
  8. 08
    Commissioning and controlling projects (briefs, agencies, questionnaires, analysis and forecasting) — Practical management: writing a brief, selecting and controlling an agency, designing instruments, analysing data and forecasting. This part is inferred from the book's description, and the excerpts do not show it.
  9. 09
    International research (Ch. 14) — Extends the process across borders: planning an international programme, categorising culture, using contractors and sub-contractors.
  10. 10
    Reporting, integration and ethics — Argues that reporting is integral to research value and that results must be built into the knowledge base and planning. Treats respondent protection, confidentiality, objectivity and no selling under the guise of research as the foundation of a sustainable research business.

What it leaves unsolved

How can falling response and refusal rates be reversed, or at least corrected for, without compromising sample accuracy?

The text names the causes (fatigue, cynicism after political polling, data protection publicity, voicemail screening) and says they raise costs and threaten accuracy. In the passage it offers no solution, and the trend is described as growing.

How can industrial universes be defined and stratified when manufacturers know little about their own market structure and secondary sources are inadequate?

The author says that guidance from manufacturers must be treated with caution, that secondary sources may be inadequate, and that industrial markets are rarely quantified. A way of getting around this is not set out.

How can mystery shopping be made ethically sound while remaining useful?

The remedies offered are to tell staff, compensate them, or make a purchase. The author admits they overcome the objections only 'at least in part'. He also concedes that what users find most useful is not what the research business is comfortable providing, and he leaves that tension open.

How reliable is the manager's judgment on how much accuracy is 'sufficient' for a decision?

Sampling is justified because results are 'not completely accurate, but sufficiently accurate'. Yet the book says there are low-, medium- and high-cost answers, and it does not give a rule for matching confidence level to the stakes of a decision.

How far will the internet displace library and physical searching, and what will that do to research quality?

The text predicts the internet will 'displace a high proportion' of physical searches but defers the issue to a later chapter. It treats it as a rapidly changing area with uncertain consequences for source reliability.

When is a qualitative stage needed before a quantitative survey?

The author says it is 'not inevitable' and that some market structures are well enough understood to skip it. Criteria for deciding are not provided in the excerpt.

Where it falls short — a fair critique

incomplete

The book states that data becomes information and knowledge, which drives lower-risk decisions and better performance. It offers no evidence or mechanism showing that research quality improves decision quality or business results, and no way of valuing research ('value of the data') beyond asserting it should set the budget.

incomplete

Accuracy is framed almost entirely as sampling error that shrinks as samples grow. The excerpt does not discuss non-sampling error (non-response bias, question wording, interviewer effects), though it concedes elsewhere that falling response rates 'compromise the accuracy of the sample'. A large, low-response sample is not more accurate.

illogical

The claim that low-, medium- and high-cost answers differ 'not in the data but in the level of confidence' glosses over differences in method, such as depth, validity and bias. It also sits uneasily with the passage's own point that sample structure and prior market knowledge, not just size, determine accuracy.

incomplete

Surveys are defined as 'by definition descriptive', and the listed contents are descriptive measures. This underplays the survey's role in testing hypotheses, explaining behaviour or supporting causal and experimental designs, leaving the descriptive/modelling split too neat.

illogical

Telling shop staff that a mystery shopping exercise is under way is offered as a way to meet the ethical objection. That alerts the people being observed and undermines the technique's purpose of measuring true procedure, so the fix works against the method's own validity.

uninformed

The sampling treatment depends on late-1990s conditions: EPOS data and the post-war statistical era. It treats the internet as a library substitute and an 'emerging' tool, and sees voicemail as the main barrier to contact. It could not anticipate big-data, online-panel or social-media methods, so much of the practical guidance is dated.

incomplete

The worked weighting example (Box 7.5) shows how weighting changes totals but not how the weights are obtained. Its sample size of 300 per cell is not justified against the needed precision, nor is the cost trade-off discussed. In industrial markets the book admits the universe is hard to define but gives little method for building one.

misinformed

By suggesting sampling accuracy is independent of the number of customers in the universe, the book risks overstating the point. That holds for large universes, but in the small industrial markets it also describes, the finite-population effect and the need for a census make universe size very relevant. The book does recognise the census case, but the blanket takeaway is potentially misleading.

Before you apply it

Using it well

Where the method fits, who it’s for, and the honest case for and against — so you apply it where it works.

Is this book for you?

For you if

  • You are a junior, middle or senior marketing manager who commissions or occasionally conducts research
  • You must write briefs, select and control agencies, and judge the quality of results
  • You need to choose pragmatically among surveys, business intelligence, secondary and informal methods under budget and time limits
  • You want to turn scattered data into a usable marketing knowledge base for planning

Skip it if

  • You are a research technician or statistician seeking detailed methodology or advanced analytics
  • You need guidance on current digital, online or big-data research tools
  • You want academic theory rather than practical, applications-focused guidance

Need first

  • A clearly stated marketing problem and the decision the research will inform
  • A realistic view of budget, time and the value of the decision
  • Basic familiarity with your market's structure, or willingness to acknowledge you lack it
  • Awareness of internal data sources you already hold

When it applies — and when it doesn’t

Use it
  • Commissioning a survey, agency or in-house, when you can state a clear marketing problem and the decision it will inform — the book's core premise is that research begins with a defined problem and the information needed to decide it
  • Choosing between a qualitative and a quantitative research supplier — agencies sell these as distinct services, so matching the brief to the right type avoids wasted spend
  • Deciding sample size and structure for a consumer survey with a limited budget — sampling error can be varied by sample size, so a low-, medium- or high-cost answer can be matched to the decision's value and budget
  • Time or money rules out a full sample survey — the book treats business intelligence, competitive intelligence and secondary research as valid alternatives, though they lack survey discipline
Adapt it
  • Industrial or B2B market with very few buyers — a census may be practical or even essential, and simple sampling does not work; stratification is hard and manufacturers' own market knowledge is often rudimentary
  • Using mystery shopping to audit service or gather competitor intelligence — it is widely used and useful but ethically contested over deception, covert taping and respondents' lost time; mitigate by informing staff, compensating or making a purchase
  • Planning primary research in over-researched sectors or among hard-to-reach business respondents — respondent fatigue, cynicism, data protection concerns and voicemail screening raise refusal rates, which raises cost and compromises sample accuracy
  • Relying on the client's own description of market structure to design an industrial sample — the book warns such guidance must be treated with caution and secondary sources may also be inadequate
  • Expecting exact figures from a sample survey — samples are sufficiently accurate for decisions but never completely accurate; the differences between approaches lie in the confidence you can place in the results
Not here
  • Treating the book's internet and online database guidance as current practice — it reflects the late-1990s, when the internet was only expected to displace library searches; tools, privacy law and response behaviour have since changed
  • Selling products or prospecting under the guise of research — the book names this as an ethical breach that undermines the sustainability of research
  • Training as a research technician or running advanced statistical analysis — the book targets managers who commission research, not technical practitioners

The honest case

Strongest case for

  • Starting from a defined problem prevents spending on research that does not inform any decision
  • Sample accuracy depends on sample size and structure, not universe size, so reliable answers are affordable and can be matched to the decision's value
  • Seeing research as a pipeline from data to information to knowledge makes research cumulative rather than one-off
  • Pairing surveys with business and competitive intelligence offers valid options when surveys are impractical
  • Treating reporting and ethics as integral protects research value and respondent cooperation, which is declining
  • It draws on 35 years of B2B experience and is candid about cost, time and trade-offs

Strongest objection

  • It is dated: the late-1990s internet view and the techniques of that period no longer reflect current data availability, privacy law or respondent behaviour
  • Its definition of research is so broad (informal, intelligence, secondary) that rigour and quality standards can blur
  • Research quality is hard to isolate from decision quality and business performance, so the claimed link to better decisions is asserted rather than demonstrated
  • A manager-oriented overview may leave managers unable to judge sampling, questionnaire or bias problems without technical expertise
  • Falling response rates and refusals undermine the representativeness that its sampling logic assumes
Source notes

The model's constructs are drawn from the source element(s); load-bearing constructs are corroborated across the shelf, emerging ones are flagged.

Ideas covered by the source notes

  • Problem Definition Quality
  • Research Design Appropriateness
  • Sampling Quality
  • Questionnaire and Instrument Quality
  • Budget Availability
  • Time Availability

Movement V

Measure

Use available assessments to reflect on what you have learned.

In this part

A way to gauge yourself against the book's model, and the instruments it gives you.

  • — A self-check built from the book
  • — Instruments and what you'd measure next

Learning curriculum

After this book, you can…

The book's learning objectives, classified by Bloom's taxonomy and ordered so each builds on the ones before it.

01Foundational — know & understand
  1. explain
    After this book you can explain how data becomes information and then knowledge, and why a marketing knowledge base lowers decision risk.
    Check: Short written explanation using a worked example that traces raw data through patterns (information) to an interpreted, decision-supporting insight (knowledge).
  2. distinguish
    After this book you can distinguish qualitative research, survey research, business intelligence and competitive intelligence, and say when each (or informal methods) is appropriate.
    Check: Classification exercise: match scenarios to research approaches and justify the choice, including when a full sample survey is unnecessary or impractical.
02Working — apply
  1. write
    After this book you can define a marketing problem and write a precise information-needs statement and research brief before commissioning any research.
    Check: Given a business scenario, draft a research brief stating the problem, the specific information needs, the decisions it will support and the users to be consulted; assess against a completeness checklist.
  2. identify
    After this book you can identify and audit internal and external (secondary, online, database and internet) sources so that you do not pay again for data that already exists.
    Check: For a stated information need, produce a source audit listing internal records and secondary sources, showing which gaps remain for primary research.
  3. design
    After this book you can design a sample (census, stratified, weighted) for consumer and industrial markets, and explain how size, structure and market knowledge govern accuracy.
    Check: Given a market structure, define the universe, build strata, choose a sample size and compute weighted totals as in the customer-base example; explain the sample-error trade-off.
  4. plan
    After this book you can plan fieldwork controls, such as editing, verification and coding, and measures to protect response rates, so that collected data is accurate and complete.
    Check: Produce a data-quality control plan covering respondent fatigue, sensitivity, verification, editing and coding for a survey.
03Advanced — analyze & judge
  1. analyse
    After this book you can analyse research results and critically assess the reliability of findings, including informally gathered information, before accepting them.
    Check: Given a results set and informal intelligence, identify sampling, bias or accuracy weaknesses and state the confidence level of each conclusion.
04Mastery — synthesize & create
  1. select
    After this book you can select a research mix (purpose, approach, market type, survey type, sampling, technique) that fits the information need, budget, time, accuracy and geographic scope.
    Check: Case study: recommend and justify a research design given constraints, and explain the trade-offs of cheaper or faster alternatives.
  2. construct
    After this book you can construct and critique a questionnaire for clarity, logical flow, unbiased wording and consistent responses.
    Check: Draft a questionnaire for a given brief and critique a flawed one, identifying ambiguous, leading or poorly sequenced questions.
  3. produce
    After this book you can produce and present a clear, accurate report in the language of the user, and consult stakeholders so they accept the findings.
    Check: Write and present a findings report with an executive summary and recommendations; evaluate it against clarity, accuracy and assimilability criteria.
  4. integrate
    After this book you can integrate research findings into marketing planning and forecasting, and judge their effect on decision quality and business performance.
    Check: Build a plan section that links research findings to decisions and forecasts, with measures of the expected effect on risk, share and profitability.
  5. apply
    After this book you can apply ethical standards in research: respondent anonymity, client confidentiality, objectivity, and no selling under the guise of research.
    Check: Ethics case analysis: identify violations in scenarios and recommend compliant practice to keep the research process credible.
  6. evaluate
    After this book you can commission, brief, select and control an external research agency, and evaluate a proposal and the project's progress.
    Check: Role-play or case: compare agency proposals against the brief, set milestones and controls, and check qualitative versus quantitative fit.
  7. justify
    After this book you can justify a research budget by the value of the decision it informs, not just by cost.
    Check: Prepare a value-versus-cost case for a research proposal, comparing low-, medium- and high-confidence options against the risk of a wrong decision.

How to measure it

Turning each idea into a measure

For each construct: how to operationalize it, the observable signals to look for, and how well it holds up.

Problem Definition Quality

Assessed by reviewing briefing documents and information specifications for defined content, coverage, timing, scale and expected rewards, and consultation with information users.

Observable signals
  • detailed brief
  • stated key marketing questions
  • defined territories
  • budget-consistent information list
Scale

Perceptual expert rating of brief completeness; no standardized scale prescribed by the book.

Holds up?

Face-valid as the book treats it as the essential first step of research. · Consistency improves when one person coordinates definition with all users.

Research Design Appropriateness

Expert evaluation of purpose, approach, market type, survey type, sampling and technique choices against objectives, sources, response rates, accuracy and scope.

Observable signals
  • method matched to objectives
  • appropriate survey type
  • justified technique selection
Scale

Mixed archival and perceptual assessment; no Likert scale specified.

Holds up?

Grounded in the book's factors determining the structure of research activity and the research mix. · Judgement-based; reliability depends on assessor expertise.

Sampling Quality

Measured through statistical error and confidence levels, response rates, and comparison of achieved sample structure with known universe parameters.

Observable signals
  • margin of error
  • level of confidence
  • quota fill
  • coverage of key segments
Scale

Archival statistical metrics such as margin of error and confidence percentages.

Holds up?

Directly tied to inferential validity of survey results. · High where sampling frames and procedures are documented.

Questionnaire and Instrument Quality

Judged via piloting, expert review of wording, phrasing, order effects, recall demands and analysis of ambiguity and 'don't know' rates.

Observable signals
  • low ambiguity
  • logical flow
  • low non-response to items
  • successful pilot
Scale

Perceptual review supplemented by item-level non-response data.

Holds up?

Book links instrument quality directly to response accuracy and consistency. · Piloting improves reliability of the instrument across respondents.

Budget Availability

Monetary budget allocated to a project or research period.

Observable signals
  • allocated funds
  • cost ceilings in brief
Scale

Ratio-scaled monetary amounts.

Holds up?

Directly measurable and treated as the starting point for research decisions. · High reliability as an archival financial figure.

Time Availability

Elapsed time or deadline windows specified for the research project.

Observable signals
  • stated deadlines
  • project timetable
Scale

Ratio-scaled time units.

Holds up?

Face-valid constraint influencing technique choice. · High as an archival scheduling figure.

Market Dynamism

Assessed via indicators of change such as new product frequency, competitive entry, technical development and demand volatility.

Observable signals
  • frequent new launches
  • new competitors
  • rapid demand changes
Scale

Mixed archival indicators and perceptual assessment; no standard scale.

Holds up?

Grounded in the book's description of the modern marketing environment. · Moderate; depends on quality of change indicators used.

Respondent Cooperation and Response Rate

Measured via response, refusal and completion rates in a survey.

Observable signals
  • response rate
  • refusal rate
  • early termination rate
Scale

Behavioral rates expressed as percentages.

Holds up?

Directly observable behavioral outcome. · High where response is systematically recorded.

Data Quality and Accuracy

Assessed through editing, verification, coding controls, statistical checks, internal consistency and cross-checks with independent data.

Observable signals
  • passed verification
  • consistent tabulations
  • cross-checks agree
  • low 'don't know' rates
Scale

Archival control metrics and consistency checks.

Holds up?

Central mediator in the book's data-to-knowledge logic. · Improved by systematic control procedures.

Information and Knowledge Base Quality

Assessed by comprehensiveness, currency and interpretive depth of the marketing knowledge base against decision needs.

Observable signals
  • reconciled data
  • identified threats and opportunities
  • up-to-date knowledge base
Scale

Perceptual assessment of knowledge base quality.

Holds up?

Grounded in the book's data/information/knowledge distinction. · Moderate; depends on interpretive consistency.

Reporting and Presentation Effectiveness

Judged by comprehensiveness against objectives, accuracy checks and ease of assimilation by users, plus presentation quality.

Observable signals
  • clear report format
  • consistent tables
  • effective oral presentation
  • user acceptance
Scale

Perceptual evaluation by users.

Holds up?

Book emphasizes reporting as integral to research value. · Moderate; depends on evaluator and presenter skill.

Marketing Decision Quality

Inferred from decision outcomes, appropriateness of targeting and reduction in business risk.

Observable signals
  • decisions supported by evidence
  • fewer wrong decisions
Scale

Mixed; hard to isolate as research is one of many inputs.

Holds up?

Book acknowledges impact may be impossible to isolate. · Low to moderate; attribution challenges.

Business and Market Performance

Measured via financial and market share archival data.

Observable signals
  • above-average profits
  • lower loss incidence
  • successful launches
Scale

Archival financial and market metrics.

Holds up?

Association with research use noted but causation explicitly not proven. · High for financial data, but causal link to research is weak.

Self-assessment

Where would you like to improve?

This is a structured self-diagnostic built from the model — a mirror for reflection, not a validated psychometric scale. For validated measurement, see the instruments below.

1 = Strongly Disagree · 7 = Strongly Agree

Capabilitythe practices and skills you deploy
  • Before any research begins, I write down the marketing problem and the specific information we need in clear and precise terms.
  • The research approach, sampling method and survey technique we choose are often a poor fit for the information we actually need.
  • The samples we use closely represent the target market and are large enough to limit bias, exclusion and non-response problems.
  • Our questionnaires use clear, neutral wording and a logical flow so that respondents understand and answer questions consistently.
  • The people we approach for research are generally willing to take part and give complete, honest answers.
Alignmentthe outcomes you steer toward
  • Our marketing decisions are clearly better informed and lower in risk because of what we learn from research.
  • Research-informed marketing decisions in my organisation have led to measurable gains such as market share, profitability or successful product launches.
Motivationthe states you cultivate in others
  • We check, edit and verify the data we collect so that it is accurate, complete and consistent before we use it.
  • We turn our research data into patterns and interpretations that explain how our market works and what we should do next.
Supportthe conditions you shape
  • The budget we have for research is sufficient to use the techniques and accuracy levels our decisions require.
  • We are usually so short of time for research that we settle for quick or readily available data rather than the method we would prefer.
  • My market is changing quickly through technology, competitor activity and rising customer expectations, which makes up-to-date research essential.
0 of 12 answered

Proposed measures — starter instruments where no validated one was found

Problem Definition Quality Index (PDQI)

proposed · not validated

Rated for your team or hiring process — not a personal self-check.

  1. Every research project has a written problem statement that distinguishes the underlying marketing problem from its observable symptoms before fieldwork is commissioned.
  2. The information needs are documented as specific, answerable research questions or hypotheses, each linked to a decision the findings will inform.
  3. The research brief is reviewed and signed off by both the decision-maker and the research team before design and budget are finalized.

Scale: 1–7 (Strongly Disagree → Strongly Agree), rated by an evaluator or the team. Average the items; treat ≤3 as a gap to close in the process.

Research Design Appropriateness Index (RDAI)

proposed · not validated

Rated for your team or hiring process — not a personal self-check.

  1. The research proposal documents an explicit rationale for each design choice (purpose, approach, market type, survey type, sampling and technique) tied to the stated information needs.
  2. Alternative designs are compared against budget, timeline and data-quality constraints, and the reasons for rejecting them are recorded.
  3. A pre-fieldwork review or pilot test confirms that the chosen instrument and technique can generate the data needed to answer each research question.

Scale: 1–7 (Strongly Disagree → Strongly Agree), rated by an evaluator or the team. Average the items; treat ≤3 as a gap to close in the process.

Sampling Quality Index (SQI)

proposed · not validated

Rated for your team or hiring process — not a personal self-check.

  1. The target universe and sampling frame are explicitly defined in writing, and the gaps between them are documented before sampling begins.
  2. The sample size is justified with a stated calculation (e.g., precision, confidence level, subgroup requirements), and quotas or strata mirror the known structure of the universe.
  3. Response rates, non-response patterns and sample composition are compared with the universe, with bias-correction steps (e.g., weighting, replacement rules) applied and reported.

Scale: 1–7 (Strongly Disagree → Strongly Agree), rated by an evaluator or the team. Average the items; treat ≤3 as a gap to close in the process.

Sources

  • Marketing Research (Chris West (auth.)) · A practical, applications-focused guide that teaches marketing managers how to define information needs, choose research methods, commission and control research projects, and turn market data into decision-ready knowledge.

The cheat sheet

Everything, on one page

One key takeaway from each section, with links to read more.

Publication details

Consult the sources listed in this guide for further reading. Edition 1 · Updated 2026-10-03.

Explore related books and profiles in the library.

Take it with you

The main guide above is free to read. This purchase includes 48 additional tools and examples — 12 frameworks, 12 checklists, 12 case studies and 12 templates — plus the full sections and the ebook itself: an epub and a PDF covering all 13 sections. Every format, yours to keep — permanently, including every future update. When this guide is deepened, you get the new edition at no cost.

One payment. The main guide stays free to read.

Get one letter a month: the new guides worth your time, and where the books disagree.

One letter a month from Leading With Data, plus a short welcome. Your address is used for this letter only. Unsubscribe any time.