How to Evaluate a Product Sample: A Brand Owner's Guide to Sample Rounds and Approval
Of all the decisions in a product launch, sample approval is the one made most casually. A courier delivers a small jar, the founder opens it at a desk, rubs a little on the back of one hand, and replies “looks good” or “a bit too thick” the same afternoon. That reply then becomes the reference against which every production batch for the next several years is judged.
Quick answer: Evaluating a product sample means judging it against the original brief under realistic conditions — after the formula has settled, in the intended pack, side by side with a benchmark, by more than one person — and then turning observations into specific, measurable feedback. Approval should be a documented decision covering a named formula version, a written specification and a retained reference sample, because that approved sample becomes the standard every production batch is measured against.
Key takeaways
- A sample is not a preview of the product. Once approved, it is the contractual reference for what “correct” means.
- Many emulsions and gels keep changing for a day or more after they are made; judging a sample on arrival tends to judge the wrong product.
- Vague feedback (“make it lighter”) produces extra sample rounds. Specific, comparative feedback shortens development.
- A single evaluator is a weak test. Even a small, structured panel gives a far more reliable answer.
- Approval should be written down: formula version, specification ranges, pack, and a signed reference sample.
Who this is for: brand owners and first-time founders working with an OEM or ODM manufacturer on a skincare, personal care, cosmetic or supplement product, who are about to receive — or have just received — development samples and need to decide what to say back.
Why does sample approval matter more than most founders assume?
Sample approval matters because it converts a subjective impression into the working standard for the whole product life. In most manufacturing relationships, a production batch is accepted if it matches the approved sample and the agreed specification. If the approval was loose, every later disagreement about colour, scent or texture becomes an argument about what the founder “meant” months earlier.
The sample also sits at the hinge point of development. Before approval, changes are cheap — a formulator adjusts a thickener or a fragrance level at the bench. After approval, the formula moves into stability testing, packaging compatibility and scale-up, and a change sends it back through all three. That is why the quality of the brief matters so much upstream, as covered in how to write a product development brief, and why the quality of sample feedback matters just as much here.
What kinds of samples will a brand owner see during development?
A brand owner typically sees several different kinds of sample, and each answers a different question. Treating them as interchangeable is a common source of confusion.
| Sample type | How it is made | What it is good for judging | What it cannot tell you |
|---|---|---|---|
| Ready-formula sample | Taken from an existing, already-developed formula | Whether an off-the-shelf base suits the concept | How it will behave once customised |
| Bench (lab) sample | Small batch made by hand in the laboratory | Texture, scent, colour and concept fit | Long-term stability or factory behaviour |
| Pilot / scale-up batch | Intermediate batch on production-type equipment | Whether the formula survives real mixing and pumping | Full-volume variation across many batches |
| Pre-production (first-off) sample | Early units from the first production run, in final packs | Fill, closure, coding and finished presentation | Consumer response in the market |
The bench sample is where most founders form their opinion, yet it is the least representative of what customers will eventually receive. The gap between a hand-made batch and a factory batch is the subject of why a formula that works in the lab can fail in the factory; the practical point here is that approval of a bench sample should be treated as approval of a target, confirmed later at pilot or first-off stage.
How should a sample be evaluated so the result is reliable?
A sample is evaluated reliably when the conditions are controlled and the comparison is explicit. Five habits make most of the difference.
Let it settle first. Many creams and gels continue to build or lose viscosity for a day or more after manufacture, and fragrance can shift as it blends into the base. Unless the manufacturer advises otherwise, it is reasonable to wait at least 24 to 48 hours after the stated make date before forming a view on texture or scent, and to note the make date on the evaluation record.
Judge it in the intended pack where possible. The same lotion reads as thin from a pump and rich from a jar. A serum that looks elegant in a clear lab vial may be hard to dispense from the chosen dropper. If the final pack is not yet available, the evaluation should at least note that the sample was judged in a substitute container.
Compare side by side, not against memory. If the brief named a benchmark product, evaluate the sample and the benchmark together, blind if possible, with their labels covered. Memory of how a competitor product felt is a poor instrument.
Use more than one evaluator. A single founder is one skin type, one nose and one set of expectations. Even five or six people from the intended customer group, using the same short scoresheet, will surface disagreements a single evaluator never sees.
Test in realistic conditions. A product sold in a tropical climate should be tried in heat and humidity, not only in an air-conditioned office. Tackiness, oiliness and fragrance intensity can all read very differently at 32 °C.
What exactly should be checked on a sample?
A useful evaluation covers appearance, sensory performance, functional performance and a small set of measurable properties. Professional sensory science has formal methods for this: ASTM International’s E1490 guide to sensory descriptive analysis of skin creams and lotions, for example, sets out how trained assessors describe and score attributes across application and after-feel. A brand owner does not need a trained panel to borrow the discipline: fixed attributes, a fixed scale and the same procedure every round.
| Dimension | What to check | Common trap |
|---|---|---|
| Appearance | Colour, clarity or opacity, gloss, any separation or specks | Judging colour under warm office lighting only |
| Odour | Fragrance character, intensity, base odour showing through | Smelling several samples in a row until the nose is fatigued |
| Pick-up and spread | Firmness in the pack, ease of spreading, drag | Testing on a fingertip rather than the intended area |
| After-feel | Absorption time, residue, tackiness, oiliness after 5–10 minutes | Deciding within the first 30 seconds |
| Functional use | Dispensing from the pack, lather, dissolution, dosing | Evaluating a supplement powder dry, never actually mixed |
| Measured properties | pH, viscosity, specific gravity, as reported by the laboratory | Approving the feel without recording the numbers behind it |
The last row is the one most often skipped, and it is the one that matters most later. A texture described as “right” cannot be checked on a production batch; a viscosity range can. Laboratory measurements attached to the approved sample are what let a factory’s quality team confirm, batch after batch, that the product still matches — and they sit alongside the stability and compatibility work of the kind described in the product testing stage that follows approval.
How should feedback be written so the next round is better?
Feedback works when it is specific, comparative and ranked by priority. The formulator needs to know what to change, in which direction, by roughly how much, and which requests matter most if they conflict.
| Vague feedback | Usable feedback |
|---|---|
| “Make it lighter.” | “Spreads well, but leaves a greasy after-feel at 5 minutes. Target is closer to benchmark B, which feels dry-touch within 3 minutes.” |
| “The smell is not right.” | “Fragrance direction is correct; intensity is too strong for a facial product. Reduce noticeably. The base odour is not coming through, which is good.” |
| “Can it be more premium?” | “Priority 1: richer pick-up from the jar. Priority 2: slightly more gloss. Colour and scent are approved as they are.” |
Two further habits help. First, state explicitly what is approved as well as what needs changing, so that attributes already agreed are not disturbed in the next round. Second, avoid asking for many large changes at once; when five attributes move together, it becomes hard to tell which adjustment caused which effect. Most contract manufacturers run development as a structured loop — brief, bench sample, feedback, revision — and the way a manufacturer’s product development and sampling process is organised largely determines how quickly that loop closes.
When is a structured sensory test worth running?
A structured test is worth running when the decision is expensive to get wrong, or when two options are close. Two formal methods are useful to know about.
The first is a difference test. In the triangle test described in ISO 4120, each assessor receives three coded samples, two identical and one different, and must identify the odd one. Because a guess succeeds one time in three, a result well above that rate indicates a perceptible difference. The method is especially practical for questions such as whether a pilot batch, a cheaper raw material or a new supplier can be told apart from the approved sample — which links directly to change control.
The second is a preference or liking test. ISO 11136 gives general guidance on hedonic testing with consumers in a controlled setting, measuring how much people like products rather than whether they can tell them apart. For a founder choosing between two final candidates, a modest version of this — blind, coded, rated on a fixed scale by people who resemble the target customer — is far more informative than a round of opinions from friends. It complements the wider demand-side work described in how to validate a product idea before manufacturing.
Neither method proves that a product works. Sensory liking is not efficacy; claims about results need separate evidence, as covered in how brands prove a product works.
What should be settled at the moment of approval?
Approval should settle exactly what has been approved, in writing, so that production can be judged against it. A practical approval record contains:
- Formula identity. The formula code and version number of the approved sample, not just its product name.
- Specification ranges. Appearance, colour, odour description, pH, viscosity and any other agreed measurements, each with an acceptable range.
- Pack. The container, closure and dispensing format the approval applies to.
- Reference sample. A retained, labelled, signed and dated physical sample held by both parties, stored under agreed conditions.
- Conditions. Any approval that depends on stability, compatibility or pilot-batch results passing.
- Date and names. Who approved, on behalf of whom, and when.
One caution about the physical reference: a retained sample ages too. A cream kept for eighteen months may no longer look or smell like it did on approval day, which is why the written specification ranges, not the ageing jar alone, should carry the weight in any later comparison.
Clarity at this point also affects ownership questions later, such as who holds the rights to a formula developed through several paid sample rounds — discussed in who owns your formula.
Limitations of this article
This article gives general guidance for consumer skincare, personal care, cosmetic and supplement products. It does not cover sterile products, registered medicines, medical devices, or food products subject to their own sensory and safety rules. The timings mentioned, such as allowing a sample to settle for 24 to 48 hours, are common working practice rather than fixed standards, and a formulator’s product-specific advice should take precedence. The ISO and ASTM methods referred to are summarised only in outline; organisations running formal sensory programmes should work from the full published standards.
Frequently asked questions
How many sample rounds should I expect before approval?
It depends on how clear the brief is and how far the concept sits from an existing formula. Ready-formula products may need only one sample, while custom development commonly takes several rounds. The single biggest factor a brand owner controls is feedback quality: specific, prioritised comments close the gap faster than general impressions. It is worth agreeing upfront how many rounds the development fee covers.
Why does my production batch feel different from the sample I approved?
Often because the approved sample was a hand-made bench batch, and factory equipment mixes, heats and pumps the product differently. Differences can also come from a changed raw-material lot or simple ageing of the reference sample. Compare the batch against the written specification ranges first; if it sits within them, the difference may be perceptual rather than a defect.
How long should I test a sample before giving feedback?
Long enough to see how it behaves after it settles and during realistic use. As a working rule, wait a day or two after the make date before judging texture and scent, and for leave-on products use the sample for several days rather than once. Record the date of each observation so the formulator can separate immediate impressions from changes over time.
Who should be involved in evaluating samples?
Ideally a small group that resembles the intended customer, plus at least one person focused on practical use such as dispensing, packing or dosing. Friends and family are acceptable if they use a fixed scoresheet and assess blind. What matters is that every evaluator judges the same attributes, in the same way, against the same benchmark.
Can I give samples to potential customers before launch?
Market testing with samples can be useful, but it raises regulatory questions beyond product development. Under the National Pharmaceutical Regulatory Agency’s Guidelines for Control of Cosmetic Products in Malaysia, cosmetic products must be notified before being placed on the market. Brand owners should confirm how the rules in their market apply to any trial programme before distributing units.
What should I keep once a sample is approved?
Keep the approval record, the formula code and version, the specification ranges, the laboratory results for pH and viscosity, and a signed, dated reference sample stored as agreed with the manufacturer. Together these form the evidence that allows any later batch, supplier change or complaint to be checked against what was actually approved.
Sources
- ASTM International, ASTM E1490-19: Standard Guide for Two Sensory Descriptive Analysis Approaches for Skin Creams and Lotions
- International Organization for Standardization, ISO 4120:2021 Sensory analysis — Methodology — Triangle test
- International Organization for Standardization, ISO 11136:2014 Sensory analysis — Methodology — General guidance for conducting hedonic tests with consumers in a controlled area
- National Pharmaceutical Regulatory Agency, Malaysia, Guidelines for Control of Cosmetic Products in Malaysia
Related reading on this blog: product stability testing and shelf life and private label versus custom formulation.
Creaton Poh is the pen name of Poh Tze Kheng, founder of ORIZI Group — one of Malaysia's most comprehensive one-stop OEM, ODM, private label and contract manufacturing groups, spanning skincare, cosmetics, personal care, perfume and fragrance, supplements, functional food and nutrition, pet care, home care and medical devices. Across six specialised companies and three manufacturing divisions, the Group brings together 20+ years of industry experience, 5,000+ formulations, and internationally recognised quality, manufacturing and regulatory standards. These articles are written to educate, not to promote.
Written by Creaton Poh
Industry Researcher • Author • Vlogger • Manufacturing Strategist
Turning ideas into products. Turning experience into knowledge.
Connect with Poh Tze Kheng on LinkedIn.
Comments
Post a Comment