CISSP Certification Guide / Chapter 22
Assessment and Testing Strategy
The strategy layer of Domain 6: the vocabulary that separates assessment, testing, and audit, the five decisions that shape any verification program, the test types and what each proves, the seven phases of penetration testing, rules of engagement, red, blue, and purple teams, the cadence that PCI DSS v4.0 and ISO/IEC 27001:2022 impose, and the metrics and report-reading habits of a manager who buys tests instead of performing them.
The test is a purchase, not a ritual
Every security test is a way of buying information. The currency is money, access, and time, and the product is a statement about what is true: this control works, this weakness is exploitable, this environment meets the requirement it promised to meet. The whole of Domain 6 is the discipline of making that purchase well, and the exam treats it that way. A security manager does not scan because scanning is the fashion, and does not hire a penetration tester because the phrase sounds thorough. The manager decides what the organization needs to know, what that knowledge is worth, who can produce it without bias, and what the organization will do differently once it arrives.
Keep that purchase frame in front of you and the domain stops being a list of tools. It becomes three questions that any verification program exists to answer. First, what is my exposure: which weaknesses exist in what I run, and how bad are they? Second, do my controls work: does the firewall actually block, does the detection actually fire, does the patch actually land? Third, do I meet the requirements I accepted: contract terms, regulatory rules, internal policy, the control baselines I promised an auditor? Almost every assessment, test, and audit in the domain is an attempt at one of those three, and the strategy question is always which one you need most right now.
The failure modes are instructive. An organization with no vulnerability management that commissions a red team exercise has bought a luxury when it needed plumbing: it will learn exactly how deeply a sophisticated adversary can move, and it will have no pipeline to fix what the exercise finds. An organization with a mature remediation program that answers every question with quarterly scans is blind to its own detection, and no scan ever told anyone whether an attacker already inside would be caught. Getting the question right is the manager’s job, and it is worth more than any tool on the bench. This chapter builds the decision machinery: the vocabulary that separates the activities, the five decisions that define any program, the test types and what each proves, the penetration test’s phases, the rules of engagement that make testing legal, the teams that run it, the cadence that regulators and standards impose, and the report-reading habits that turn findings into decisions. The next chapter takes the same material and goes down into the tools and the evidence they produce.
One vocabulary, three different questions
The first exam move is knowing which word fits which activity, because the questions test the boundaries with lawyer-like care. The umbrella term is the security assessment, the family of activities that examines a system, application, or organization to characterize its security posture and identify weaknesses. NIST Special Publication 800-115, the “Technical Guide to Information Security Testing and Assessment,” treats testing and assessment as one continuous family: the assessment is the investigation, the testing is the technical activity inside it, and the two words are used together in the title because you rarely do one without the other. When a scenario says “assessment,” the exam usually means the whole investigation: scoping, testing, analysis, and the report. When it says “testing,” it means the concrete technical actions, the scans, the probes, the attempted exploits. When it says “audit,” it means something narrower and sharper: the examination of evidence against a defined set of criteria, to determine conformance. An audit answers “do we comply with what we are bound to comply with.” A test answers “what is actually weak here.” The words are not interchangeable, and the exam expects you to keep them apart.
Two more distinctions live in the same register. Verification asks whether a control does what it was designed to do; validation asks whether the control serves the objective that justified it. The classic engineering framing is that verification asks whether you built the thing right, and validation asks whether you built the right thing. Both matter, and the security version of the distinction is subtle enough to be a favorite discriminator. A firewall rule can be verified to block a specific port, and yet the program it belongs to can be invalid, because the actual risk was outbound data exfiltration over HTTPS and no rule in the book touches it. The rule works and the program fails. The exam will hand you a scenario where a control passes its own verification and ask whether the broader security objective is met, and the answer is a validation answer, not a verification answer.
The third distinction is organizational rather than logical. An internal assessment is run by the organization’s own people, who know the environment but carry its assumptions. An external assessment is run by an outside firm, which brings independence and fresh eyes but has to learn the environment. Neither is inherently better; the choice is one of the five decisions below, and the exam mostly uses it to test whether you understand what independence buys and what it costs. A regulation that demands an independent tester, or an auditor who must not review their own work, is a regulation buying freedom from self-interest, and the reason for the requirement is the answer to the question.
Five decisions that shape every program
Any testing program, from a two-day scan to a year-long assessment calendar, is defined by five decisions. Work the five and the right test type, cadence, and team fall out almost mechanically. The exam scenarios reward exactly this style of reasoning, because a well-phrased scenario hands you two or three of the five and asks you to supply the consequence.
Decision one is the question. What do we need to know? The honest options are limited: whether a weakness exists, whether a weakness is exploitable, whether a control behaves as designed, whether a process conforms to a requirement, whether an adversary would be detected, and whether people follow the rules they were taught. The question determines the test type, and choosing a test type before the question is the classic amateur error.
Decision two is the target. What is in scope: network devices, servers, endpoints, applications, the physical plant, the people, the processes? Scope is a budget decision and a risk decision at once. Testing everything is usually unaffordable, testing a sample must be justified as representative, and excluding a system because it is inconvenient is how the exam’s favorite incident begins. The scope boundary also has to be explicit to the people doing the work, because the difference between an authorized test and an unauthorized intrusion is precisely the document that says where the test may and may not go.
Decision three is the cadence. How often, and what triggers a new round? The practical answer is a layered one: continuous scanning where automation allows, scheduled deep testing on a quarterly or annual rhythm, and event-triggered testing whenever the environment changes in a way that invalidates the previous results. The third layer is the one organizations forget, and it is the one the exam tests most, because the exam’s scenarios are full of significant changes: a new perimeter, a new application, a merged network, a new cloud tenancy, a newly acquired company.
Decision four is the knowledge. How much does the tester get told before the test? Black-box testing starts from the outside with no internal information and simulates the unprivileged attacker. White-box testing hands the tester source code, architecture diagrams, credentials, and configuration, and maximizes coverage at the cost of realism. Gray-box testing sits between: partial knowledge, often a low-privilege account, which mirrors the reality that most attackers already hold some access. The exam expects you to match the knowledge level to the question: external attacker questions want black-box reasoning, thorough coverage questions want white-box, and insider-threat questions usually want gray.
Decision five is the performer and the authority. Who runs the test, and what written authorization makes it legitimate? Internal team or external firm, red team or blue team, auditor or tester, and underneath all of it the signature on the authorization letter and the rules of engagement that define the boundary. Authority is the least glamorous of the five and the most consequential, because every test is, absent the authority, an attack.
The test types and what each one proves
With the five decisions in hand, the test types become options rather than a vocabulary list. Each type answers one question well and several questions poorly, and the manager’s craft is refusing to use a wrench as a hammer.
A vulnerability assessment identifies weaknesses. It combines automated scanning with manual verification and produces a prioritized list of findings: this service is exposed, this software is out of date, this configuration is weak. NIST SP 800-115 treats vulnerability scanning as the discovery layer of testing, the activity that maps the attack surface before anyone attempts anything. The defining property of a vulnerability assessment is that it does not attempt to exploit what it finds. It answers the exposure question and leaves the exploitability question open, which is a feature, not a defect: assessments are cheap, repeatable, and safe to run continuously, which is why they are the backbone of the vulnerability management program described below.
The vulnerability management layer is the process that surrounds the scans, and it deserves attention because the exam treats it as the default answer for immature programs. NIST Special Publication 800-40 Revision 4, “Guide to Enterprise Patch Management Planning,” makes the point that patch management is planning, not firefighting: the organization decides how it will learn about vulnerabilities, how it will prioritize them, how it will test patches before deployment, and how it will verify after. The raw material of that planning is the public vulnerability infrastructure. The CVE program, managed by MITRE under the sponsorship of CISA, assigns each publicly known vulnerability an identifier through CVE Numbering Authorities, the CNAs that register findings on behalf of vendors and researchers. The National Vulnerability Database, the NVD maintained by NIST, enriches those identifiers with descriptions, affected products, and severity scores. The scores themselves come from CVSS, the Common Vulnerability Scoring System published by FIRST, whose version 3.1 specification is the current basis. CVSS v3.1 produces a base score from exploitability metrics, attack vector, attack complexity, privileges required, user interaction, and impact metrics, confidentiality, integrity, and availability, and maps the number to a severity band: None at 0.0, Low from 0.1 to 3.9, Medium from 4.0 to 6.9, High from 7.0 to 8.9, and Critical from 9.0 to 10.0. The point of the whole chain, CVE to NVD to CVSS to scanner to patch ticket, is that an organization cannot fix what it cannot name and rank, and a vulnerability management program is the machine that turns public knowledge into local action.
A penetration test goes one level deeper and proves exploitability. Where the assessment asks whether a weakness exists, the penetration test asks whether it can be turned into access, and what the attacker could do from there. It combines automated scanning with manual technique, custom tooling, chained weaknesses, and the judgment of a human tester. Its product is the demonstrated consequence: not “this service runs an old library,” but “this old library let us read the database, and from the database we reached the domain controller.” That demonstration is what converts a security finding into a business decision, because executives discount abstract weaknesses and act on demonstrated loss. The penetration test is also where the exam’s language about phases and rules of engagement lives, covered in its own section below.
A red team exercise answers a different question entirely, and the exam distinguishes it from penetration testing with care. The penetration test proves that a weakness can be exploited; the red team proves whether the organization would detect and stop a realistic adversary before material damage. Red teams operate against objectives rather than against findings: get the payment data, reach the CFO’s mailbox, disrupt the backup system, and they choose their path the way a real attacker would, which usually means evading the defenses, not attacking them head-on. MITRE ATT&CK, the knowledge base of adversary tactics and techniques, is the standard vocabulary for designing and describing that behavior, and it appears in the exam as the mapping tool that turns “what would an attacker do” into a testable technique list. The strategic point is that the red team measures the defense-in-depth system, detection, response, containment, as a whole, which no scan and no finding-based penetration test can do.
The blue team is the side being measured: the defenders, their tools, their procedures, their decisions. A blue team exercise turns the red team’s activity into a detection drill, where the blue team’s job is to notice, investigate, contain, and learn. The purple team is not a separate kind of team so much as a working mode in which red and blue share objectives and exchange information during the exercise: the red team explains what it is doing and why, the blue team validates whether its detections actually fire, and both leave with the playbooks improved. The exam’s purple team questions are almost always about that shared-goals property, and the wrong answers are usually “a third team that both sides report to” or “a team that only reads reports.”
Application security testing deserves a mention here because the strategy question arrives before the tools. Static application security testing, SAST, analyzes source code or bytecode without running it, which means it can find weaknesses early, in the developer’s machine, at the cost of false positives and an inability to see runtime behavior. Dynamic application security testing, DAST, probes a running application as an outside caller would, which sees the deployed truth but only what the tool can reach. Interactive application security testing, IAST, instruments the running application to combine both views, and runtime application self-protection, RASP, sits inside the application and blocks attacks in flight. The strategy point, which the exam expects you to hold, is placement: the earlier in the delivery pipeline the test runs, the cheaper the fix, which is why SAST belongs at the commit and DAST belongs at the deploy gate, and why the full treatment of application weaknesses belongs to the software development domain and its chapter on secure coding.
Two more types round out the domain and are easy to overlook. Social engineering testing probes the human layer, most often with simulated phishing, and its governance requirements are severe: clear scope, informed consent boundaries, incident handling for anyone who actually falls for the lure, and a training outcome rather than a punishment outcome. Physical security testing checks the physical layer, badge operations, door controls, tailgating, visitor processes, and it is the answer to questions that describe an attacker walking in rather than dialing in. And configuration review compares systems against a defined baseline, a vendor hardening guide or an internal standard, which is how an organization proves that its chosen posture is actually the posture it runs.
The audit closes the list, and it belongs here because the exam uses it as the contrast term. An audit collects evidence against criteria: does this process match the documented procedure, does this control match the selected baseline, does this environment match the regulatory requirement. ISO/IEC 27001:2022 requires the organization to conduct internal audits at planned intervals under clause 9.2, and its clause 9.2.2 adds the independence rule that auditors must be objective and impartial and must not audit their own work. An audit does not discover unknown weaknesses the way a scan does. It verifies conformance, which is a different and equally necessary product, and confusing the two is a reliable way to fail an exam question that describes a regulator finding a gap between what was documented and what was done.
Penetration testing: the seven phases
The penetration test is the test type with the most exam-specific vocabulary, and the vocabulary comes from two standards that agree in shape. NIST SP 800-115 describes a four-phase methodology: planning, discovery, attack, and reporting. The community standard, the Penetration Testing Execution Standard, known as PTES and maintained by a group of practitioners at pentest-standard.org, expands the same shape into seven phases, and the seven-phase version is the one the exam’s questions most often expect. Learn the seven in order, because the ordering itself is tested.
Phase one is pre-engagement interactions. The tester and the client agree on the objectives, the scope, the boundaries, the timing, the reporting format, and the legal authorization, all of it written down. Nothing is tested in this phase, and its product is the rules of engagement and the signed authorization, which means it is also the phase where a test can be made legal or left merely hopeful.
Phase two is intelligence gathering. The tester collects information about the target without attacking it: public records, corporate websites, job postings, certificate transparency logs, social media, domain registration data, and for the active portion, network probing that reveals which systems exist and what they expose. The distinction the exam respects is between passive gathering, which leaves no trace and uses only publicly available sources, and active gathering, which touches the target’s systems and can be detected.
Phase three is threat modeling. The tester takes the intelligence and decides what is worth attacking and how: which assets matter most, which paths reach them, which techniques fit the observed surface. This is the same discipline the risk chapter’s threat modeling taught, applied to the test itself rather than to the whole organization.
Phase four is vulnerability analysis. The tester scans and enumerates, maps services and versions to known weaknesses, and develops the list of candidate findings. This is where the vulnerability assessment’s output feeds the penetration test, and it is why the two are often run back to back: the scan names the suspects, the pen test interrogates them.
Phase five is exploitation. The tester attempts to turn a candidate weakness into actual access, using public exploits where they exist and custom technique where they do not. The phase ends either in demonstrated access or in a documented near-miss, and both outcomes are findings.
Phase six is post-exploitation. The tester determines what the achieved access is worth: what can be read, what can be moved, what else can be reached. Lateral movement, privilege escalation, persistence, and data exfiltration all live here, and this phase is where a penetration test starts to answer the red team question, because the depth of the demonstrated impact is what the business will actually feel.
Phase seven is reporting. The tester writes the findings with evidence, severity, reproduction steps, and remediation guidance, and the client receives it. Reporting looks like an afterthought and is in fact the only deliverable the client paid for, since the test itself leaves nothing behind but knowledge. A penetration test whose report gathers dust is a purchase that returned nothing.
Rules of engagement: the document that makes testing legal
The difference between a penetration test and a crime is a piece of paper, and the exam is entirely serious about this. Under US law, the Computer Fraud and Abuse Act, 18 U.S.C. Section 1030, criminalizes accessing a computer without authorization or in excess of authorization, and the equivalent statutes in other jurisdictions draw the same line. Every technical test in this chapter involves accessing computers that the tester does not own. What makes that access authorized is the written agreement between the party that owns or operates the systems and the party doing the testing, and that agreement is the rules of engagement, with the authorization letter as its heart. A tester who starts before the signature, or a manager who lets testing begin on a verbal okay, has converted a security project into a legal exposure of its own.
The rules of engagement document has a stable anatomy, and the exam will test you on its parts. Scope defines what is in and what is out, stated concretely: network ranges, hostnames, applications, accounts, facilities, with exclusions explicit, and shared or third-party systems carved out. An exclusion list is not a courtesy, it is a boundary: the shared platform, the vendor’s system, the customer’s environment, the production database that must not be touched with anything destructive. Timing defines when the testing may run, business hours or maintenance windows, and any constraints on disruptive techniques, because a test that brings down production is a failed test regardless of findings. Communication defines who talks to whom: the tester’s contact, the client’s contact, the escalation path, and the rule that a critical finding discovered mid-test is reported immediately rather than saved for the final report, because waiting can convert a finding into an incident. Evidence handling defines what gets captured, screenshots, logs, captures, and how it is stored, labeled, and ultimately destroyed or handed over, since the evidence of an authorized test is sensitive by definition. Stop conditions define what halts the test on the spot: imminent risk to a critical service, exposure of regulated personal data, discovery of an active real-world attack, any condition where continuing is worse than stopping. And the legal layer defines the parties, the authorization scope, the confidentiality terms, and the agreed reporting.
Two special cases deserve their own mention because the exam likes them. First, cloud environments: AWS, Microsoft Azure, and Google Cloud each publish rules of engagement for penetration testing of customer environments, and all three allow testing on many customer-owned services without advance approval while carving out shared infrastructure and provider-managed platforms. The customer’s authorization letter authorizes the customer’s environment; it does not authorize the provider’s. The tester verifies the provider’s current policy, including any notification requirement, before the engagement, because the platform’s boundary is governed by the provider’s terms. Second, the authorization must be granted by someone who actually holds the authority, and for a scope that includes third-party systems, the third party’s own permission is required in turn. The exam’s authorization questions are usually about exactly this: who may sign, and what happens when the scope crosses an ownership boundary that the signer does not control.
Teams: who buys, who runs, who verifies
The security manager’s role in testing is commissioner, not performer. The manager defines the question, funds the work, governs the scope, and reads the report; the testing itself belongs to people whose craft it is. This division is not a matter of rank, it is the only arrangement that produces trustworthy answers. The tester who also set the objectives can shade the objectives, and the auditor who built the system being audited will be generous with it, which is why ISO/IEC 27001:2022 clause 9.2.2 requires auditors not to audit their own work, and why regulated industries require testers who are independent of the systems under test. The manager buys independence the same way the organization buys insurance, against the day when the honest answer is uncomfortable.
Internal versus external teams is a real trade with stable reasoning. An internal team knows the environment, its history, its shortcuts, and its political realities, is available on demand, and builds institutional capability that every engagement deepens. The cost is familiarity: the team shares the organization’s assumptions, misses the things everyone has stopped seeing, and lacks the breadth of experience that comes from working across many environments. An external firm brings independence, fresh eyes, and a catalog of engagements that no single internal team accumulates, and it is the answer whenever the question is “what are we not seeing” or a regulation demands independence. The internal team is the answer whenever the question is “how do we build a durable testing capability that pays for itself daily.” Mature organizations run both: internal testing on the continuous rhythm, external testing for the annual deep look, and the two cross-pollinate.
The team vocabulary is worth fixing precisely because the exam leans on it. The red team is the adversarial side, conducting objective-based testing against the live environment. The blue team is the defensive side, operating detection and response during the exercise. The purple team is the working mode where they share goals and information in real time, and its product is improved defense, not a score. The exam’s purple team discriminator is that the mode exists to improve both sides together, which is the opposite of the adversarial gamesmanship people assume. Staffing the functions can be internal, external, or mixed, and the exam generally does not care who pays the salaries, only what each function is for.
Cadence: how often, and what triggers a test
A test is a snapshot, and a snapshot’s value decays as the environment changes. The cadence question is therefore the question of how to keep the picture fresh at a price the organization can pay, and the standard answer is a layered rhythm: continuous where automation allows, scheduled where depth requires humans, and event-triggered whenever the environment changes enough to invalidate the old picture.
The continuous layer is vulnerability scanning and monitoring integrated into operations. NIST SP 800-137, “Information Security Continuous Monitoring (ISCM) for Federal Information Systems and Organizations,” made the case that security status should be monitored continuously and the data fed into risk decisions, rather than re-established on an annual cycle, and the exam expects you to know that continuous monitoring is the mature answer to “how often should we look.” Scans run on a schedule, but the schedule is short enough to function as continuous: weekly or daily for internet-facing systems, and always after a change. The point is not the scan itself, it is that the pipeline from finding to fix runs constantly, which is the vulnerability management program from the earlier section.
The scheduled layer is the deep testing that humans must do. The default planning unit is the annual cycle: an annual penetration test, an annual internal audit, an annual management review, and the exam and the standards both orbit that unit. ISO/IEC 27001:2022 requires internal audits at planned intervals under clause 9.2 and monitoring, measurement, analysis, and evaluation under clause 9.1, without fixing a frequency, which is itself an exam point: the standard mandates the activity and lets the organization own the cadence, and a question that treats “the standard requires audits annually” as a fact is wrong, because the standard deliberately does not say that.
The event-triggered layer is where the exam’s scenarios live, because significant change is the enemy of stale results. A new internet-facing application, a new perimeter device, a network merger, a new cloud tenancy, an acquisition, a major release, each one invalidates the previous assessment of the affected scope, and the correct response is to re-test the affected scope, not to wait for the annual cycle. The exam rewards recognizing the trigger: the scenario describes the change and the correct answer is the re-test, the re-scan, or the re-audit of the changed surface.
The regulatory exemplar of a fixed cadence is PCI DSS, and it is worth learning precisely because it is the exam’s concrete instance of regulator-set frequency. PCI DSS v4.0, published in March 2022 to replace version 3.2.1, sets out in Requirement 11 that systems and networks are tested regularly. The requirement family mandates quarterly internal vulnerability scans and quarterly external scans, the external ones performed by an Approved Scanning Vendor, the ASV program that PCI SSC runs to qualify the scanning firms, plus internal and external penetration testing at least annually and after any significant change, and testing of segmentation controls where the cardholder data environment is isolated from the rest of the network. The exact sub-numbers may drift between editions, and the exam knows this, so what it actually tests is the shape: quarterly scans, annual pen tests, retest on significant change, and the ASV for the external scans.
Put the three layers together and the rhythm looks like this. The vulnerability program scans continuously and remediates on a rolling basis. The quarterly layer re-verifies the scan baseline and catches drift. The annual layer runs the deep tests, the penetration test, the audit, the management review. The event layer snaps into action on every significant change, because the old snapshot no longer describes the new environment. A question that asks how often to test is really asking which layer of this rhythm applies to the situation described, and the situation will always hand you the answer: the regulator, the change, or the maturity of the program.
Metrics and the report: what the manager reads
The report is where the purchase pays out, and reading it is a skill the exam treats as part of the domain. A professional test report has a stable anatomy. The executive summary states the findings in business terms: how many findings, at what severity, what the material risks are, what should happen next. The body carries the findings themselves, each with a description, the evidence that establishes it, reproduction steps, an impact assessment, and remediation guidance. The appendix holds the raw evidence, screenshots, logs, packet captures, and the details that let the technical teams reproduce and verify. A report that cannot be reproduced is not a finding, it is a rumor, and the manager’s first discipline is demanding evidence for every line.
The manager reads the report at two altitudes. At the technical altitude, the findings go to the teams that will fix them, prioritized by severity and by business impact, and the manager’s job is to make sure each finding has an owner, a due date, and a verification step. At the business altitude, the findings are translated into risk language for the people who hold the budget and the accountability, because “an unauthenticated remote code execution in the internet-facing portal” must become “an attacker who can compromise our customer portal without credentials, which is why we are funding the replacement.” The exam rewards knowing which register belongs to which audience, and the wrong answer is usually the report that gets handed whole to the wrong reader.
Metrics are the management instrument, and the ones that matter are the ones that measure the process, not the tools. Open critical and high findings by quarter tells you whether the backlog is shrinking. Mean time to remediate, the average days from finding to fix, tells you whether the pipeline is fast. Scan coverage tells you whether the tools actually reach the assets. False positive rate tells you how much of the scanner output is noise, and it matters because a scanner that cries wolf trains everyone to ignore it. Findings confirmed by the penetration test, the overlap between what the scanner names and what a human proved, tells you how much of the automated output is real. The exam’s metrics questions are almost always about choosing the metric that measures the desired outcome, and the desired outcome is a shrinking, fast, verified backlog, not activity. Volume of activity, hours of scanning, pages of report, those are vanity numbers.
Two habits complete the manager’s discipline. First, verify remediation by re-scan and retest, not by patch ticket, because a ticket says someone said the fix was done and a re-scan says the fix is done. The re-scan is the control test, and the exam will describe a patch that was deployed and never verified and ask what was missing, the verification. Second, prioritize by business impact, not by severity score alone. A critical-severity finding on an isolated lab system that no business process depends on is less urgent than a medium-severity finding on the crown-jewel data store, and the manager who sorts purely by CVSS number is sorting by someone else’s abstraction. CVSS scores the technical severity of the weakness; the organization scores the value of what the weakness threatens, and the manager’s arithmetic combines both.
The decision framework in action
The five decisions and the test types come together in scenarios, and walking three of them shows how the framework produces answers. Take the pre-production web application. The question is whether the application can be released, which is a control-effectiveness and exploitability question about a specific target. The scope is the application and its integration points, the cadence is event-triggered, once, before launch, and the knowledge level is mixed: white-box testing on the code through SAST, gray-box testing on the running system through DAST and manual review, because the development team can hand over credentials and diagrams without losing realism where it matters. The performer is the external firm that audited the codebase, chosen for independence, authorized by the project sponsor with rules of engagement that explicitly exclude the production data the application will connect to. The result is a release gate: findings triaged, the blockers fixed and re-verified by a targeted re-test, and the release proceeding with the residual risks accepted by the business owner.
Take the cardholder data environment. The question is regulatory conformance plus actual weakness, and the answer is the PCI DSS rhythm: quarterly internal and external scans, the external ones through an Approved Scanning Vendor, annual internal and external penetration tests, and segmentation testing because the CDE is isolated from the rest of the network. The cadence layer that does the most work is the event layer, because every significant change to the CDE, a new service, a new connection, a new payment integration, triggers a re-scan and a re-evaluation of the segmentation. The manager’s report-reading job is quarterly: track the open findings, verify the remediations by re-scan, and keep the evidence file that the auditor will ask for. The audit itself, conducted by an internal audit function that did not build the CDE, provides the conformance evidence that the scans cannot.
Take the organization that has never tested anything. The question is exposure, the most basic one, and the framework says start with the vulnerability assessment and the remediation pipeline, because the value of every other test depends on a working fix loop. The scope is the internet-facing estate first, the cadence is continuous scanning with a weekly or monthly remediation review, the knowledge level is irrelevant until the scanner exists, and the performer is whoever can stand up the program, internal if the skill exists, external if not. The red team is not canceled, it is deferred: once the backlog is shrinking and the detections are instrumented, the organization can spend on the question that remains, whether it would catch an adversary inside. Each test type appears in the order the framework says it should, which is the whole point. The question decides the test, the test decides the team, and the report decides the next question.
Practice questions
-
A firewall rule is confirmed to block traffic on the exact port it was configured to block, but the organization’s real risk is outbound data exfiltration over HTTPS, which the rule does not affect. Which statement about this situation is correct?
A. The control is verified but the security program is not validated. B. The control is validated but not verified. C. Verification and validation are synonyms, so no distinction applies. D. The control fails verification, so the program cannot be validated.
-
Which activity is best described as an audit rather than a test?
A. Scanning the network to discover which services are exposed. B. Attempting to exploit a weakness found in an application. C. Collecting evidence to determine whether the change-management process matches the documented procedure. D. Simulating phishing emails to measure employee response.
-
An organization has never run technical security testing and has no inventory of its exposures. The budget funds exactly one new program for the coming quarter. Which should the security manager establish first?
A. A red team exercise against the production environment. B. A vulnerability management program with scanning and prioritized remediation. C. An annual internal audit. D. A social engineering testing program.
-
A penetration tester begins a new engagement and is asked what comes first. According to the Penetration Testing Execution Standard, which phase precedes all others?
A. Intelligence gathering. B. Pre-engagement interactions. C. Vulnerability analysis. D. Post-exploitation.
-
Which statement best describes the primary purpose of a rules of engagement document?
A. To estimate the cost of the test for the budget proposal. B. To define the authorized scope, boundaries, timing, communication, and evidence handling so the test is legal and governed. C. To list the specific CVEs the tester is expected to exploit. D. To replace the need for written authorization from the system owner.
-
A tester is given the application’s source code, architecture diagrams, and valid credentials before beginning the test. What kind of test is this?
A. Black box. B. Gray box. C. White box. D. Red team.
-
A company’s leadership wants to know whether the security operations team would detect and stop a realistic adversary before material damage. Which engagement best answers that question?
A. A quarterly vulnerability scan. B. A red team exercise run against the live environment using realistic adversary techniques. C. A source code review of the main application. D. An internal audit of the information security management system.
-
A red team and a blue team run an exercise together, with the red team explaining its methods as it goes and the blue team validating its detections in real time, so that both sides improve their playbooks. What is this mode called?
A. Purple teaming. B. Gray-box testing. C. Continuous monitoring. D. A white-box audit.
-
A merchant’s cardholder data environment is subject to PCI DSS. Which cadence does PCI DSS v4.0 Requirement 11 require?
A. External vulnerability scans annually and internal scans once. B. Internal and external vulnerability scans quarterly, and internal and external penetration testing at least annually and after significant change. C. Penetration testing quarterly and vulnerability scanning only after major releases. D. A single annual assessment of the entire organization.
-
An internal auditor is assigned to audit an information security program that the same auditor helped design and operate the previous year. Under ISO/IEC 27001:2022, why is this a problem?
A. The standard limits organizations to one internal audit per year. B. Auditors must be objective and impartial and must not audit their own work, and this assignment destroys that independence. C. The standard requires all audits to be performed by an external certification body. D. It is not a problem, because familiarity with the program makes the audit more accurate.
-
A scanner reports a finding with a CVSS v3.1 base score of 9.4. What does this score mean?
A. The finding is rated Critical on the CVSS v3.1 severity scale. B. The finding is a confirmed false positive until a penetration test proves otherwise. C. The finding affects confidentiality but not integrity or availability. D. The finding has already been exploited in the wild.
-
A security manager receives a penetration test report with forty findings. What should the manager do first?
A. Forward the entire report to the executive team unchanged. B. Verify that the findings carry reproducible evidence, validate their business impact, and assign owners and due dates for remediation. C. Schedule a full re-scan and ignore the report until the new results arrive. D. Treat every finding as the definitive truth about the environment.
-
A team deploys a patch to close a critical vulnerability and marks the work order complete. What is missing from this workflow?
A. Approval from the vulnerability scanner vendor. B. Verification of the remediation by re-scan or retest of the affected system. C. A new CVSS score for the patched system. D. Nothing; marking the work order complete closes the loop.
-
A penetration test is proposed against systems hosted on a major cloud provider. What must the tester verify before the engagement begins?
A. The cloud provider’s penetration-testing rules of engagement and whether the target services fall within the permitted scope. B. That the provider’s staff will execute the test on the customer’s behalf. C. That no customer authorization is needed for cloud-hosted systems. D. Nothing, because cloud environments are exempt from authorization requirements.
-
A company plans a social engineering test that sends realistic phishing emails to employees. Which governance element is most important to include in the plan?
A. Publishing the names of everyone who clicked in a company-wide message. B. Clear rules of engagement covering scope, consent, reporting of anyone who engages the lure, and the use of results for training rather than punishment. C. Restricting the test to executive staff only. D. Running the test without informing the incident response team.
-
Which metric best indicates whether an organization’s vulnerability management process is improving?
A. The number of vulnerability scanners deployed. B. The trend of open critical and high findings across quarters and the mean time to remediate. C. The number of CVEs MITRE publishes each month. D. The number of pages in the latest assessment report.
-
A security manager is told the organization needs a penetration test before an upcoming product launch. Which statement describes the manager’s proper role?
A. Perform the test personally to save the budget. B. Define the objectives and scope, commission the test from an appropriate team, and ensure written authorization and rules of engagement are in place. C. Approve the launch without testing to protect the schedule. D. Delegate the authorization decision to the penetration tester.
Answers and rationales
-
A. Verification asks whether the control does what it was designed to do, and the rule passes that test. Validation asks whether the control serves the objective that justified it, and the program fails that test because the actual risk, outbound data exfiltration over HTTPS, is untouched. The control works and the program is still wrong, which is the verification/validation distinction in its purest form.
-
C. An audit collects evidence against defined criteria to determine conformance, and comparing the change-management process to the documented procedure is exactly that. Scanning for exposed services is assessment, attempting to exploit a weakness is penetration testing, and phishing simulation is social engineering testing.
-
B. The value of every other test depends on a working fix loop, so the exposure question comes first: scanning plus a prioritized remediation pipeline. A red team measures detection and response, which is premature when the organization cannot yet fix what a scan finds; an audit verifies conformance, not weakness; and social engineering tests a layer that depends on the rest of the program.
-
B. The PTES phases run pre-engagement interactions, intelligence gathering, threat modeling, vulnerability analysis, exploitation, post-exploitation, and reporting. Pre-engagement, where scope, rules of engagement, and authorization are agreed, precedes all testing activity, and a test that skips it is not authorized.
-
B. The rules of engagement define the authorized scope, the exclusions, the timing, the communication and escalation path, the evidence handling, and the stop conditions, and they make the test legal by setting the boundary of authorization. They do not price the test, they do not dictate specific CVEs, and they rest on the written authorization rather than replacing it.
-
C. A white-box test gives the tester full knowledge of the target: source code, architecture, and credentials, maximizing coverage at the cost of external realism. A black-box test starts with no internal information, a gray-box test with partial knowledge, and a red team operates against objectives using realistic adversary behavior.
-
B. The red team measures the whole detection and response system by operating against objectives with realistic techniques, which is precisely the question leadership is asking. Scans find weaknesses, source code review finds code weaknesses, and an audit verifies conformance; none of them measure whether an intruder would be caught.
-
A. Purple teaming is the working mode where red and blue share goals and exchange information during the exercise so both improve, which is exactly what the scenario describes. Gray-box testing and white-box audit are knowledge-level labels, not team modes, and continuous monitoring is a cadence.
-
B. PCI DSS v4.0 Requirement 11 requires quarterly internal and external vulnerability scans, the external scans through an Approved Scanning Vendor, plus internal and external penetration testing at least annually and after significant change. The other options misplace the frequencies: scans are quarterly, not annual, pen tests are not quarterly, and the requirement is not a single annual assessment.
-
B. ISO/IEC 27001:2022 clause 9.2.2 requires auditors to be objective and impartial and not to audit their own work, and the assignment violates that independence. The standard does not limit audit frequency, it does not require external auditors, and familiarity is exactly the problem, not the benefit.
-
A. CVSS v3.1 maps base scores to severity bands, with Critical covering 9.0 through 10.0, so 9.4 is Critical. The score does not indicate exploitability in the wild, it does not describe which impact metrics were touched, and it says nothing about whether the finding is a false positive, which is a verification question, not a scoring question.
-
B. The manager’s first discipline is demanding evidence and business context: verify the findings are reproducible, assess their impact on what the organization values, and route each one to an owner with a due date and a verification step. Handing a raw technical report to executives ignores the audience ladder, ignoring the report wastes the purchase, and treating findings as infallible truth skips the validation every report deserves.
-
B. The remediation is not complete until it is verified by re-scan or retest, because a work order says someone claims the fix was deployed and a re-scan says the fix is present. Verification is the control test, and skipping it is the classic gap this scenario describes.
-
A. Cloud providers publish their own rules of engagement for penetration testing of customer environments, and the tester must confirm the current policy, the permitted services, and any required notification before starting. The provider’s terms govern the platform boundary, customer authorization is still required, and cloud environments are absolutely not exempt.
-
B. Social engineering testing is governance-heavy because it touches people: the plan needs clear scope, consent boundaries, incident handling for anyone who engages the lure, and a training outcome rather than a punishment outcome. Public shaming destroys the program, restricting it to executives tests the wrong population, and hiding it from the response team turns a test into an incident.
-
B. The trend of open critical and high findings and the mean time to remediate measure the outcome, a shrinking, fast, verified backlog. Scanner count measures tooling, CVE publication measures the external world, and report length measures paperwork; none of them measure whether the process is improving.
-
B. The security manager commissions and governs testing: define the question and scope, select an appropriate team, and ensure the written authorization and rules of engagement exist before anything runs. Performing the test personally abandons the governance role and the independence it buys, skipping the test to protect a schedule is the wrong answer to a release question, and the tester cannot authorize their own test.
Assessment and testing strategy on one page
When the detail blurs, hold the shape. Assessment is the family, testing is the technical activity inside it, and audit is conformance evidence against criteria. Verification asks whether the control was built right, validation asks whether the right thing was built, and the exam will make you tell the difference. Five decisions define every program: the question, the scope, the cadence, the knowledge level, and the performer with the authority. The question picks the test type: the vulnerability assessment names weaknesses, the penetration test proves exploitability, the red team measures detection and response, the purple team improves both sides together, the audit proves conformance, and the vulnerability management program, fed by CVE, NVD, and CVSS v3.1, is the continuous layer that turns findings into fixes.
The penetration test runs in the PTES order: pre-engagement, intelligence gathering, threat modeling, vulnerability analysis, exploitation, post-exploitation, reporting. The rules of engagement, anchored by the signed authorization, are what make the test legal, and their scope, timing, communication, evidence handling, and stop conditions are exam material. The manager commissions rather than performs, buys independence where the answer must be honest, and reads the report at two altitudes: technical detail for the fixers, risk language for the decision-makers. Cadence is three layers: continuous scanning, quarterly and annual deep tests, and event-triggered re-testing whenever significant change invalidates the old picture, with PCI DSS v4.0 Requirement 11 as the concrete regulator-set rhythm and ISO/IEC 27001:2022’s planned-interval audits as the standard that deliberately leaves frequency to the organization.
Chapter 23 goes from the strategy to the bench: the scanners, the testing frameworks, the fuzzing and analysis tools, and the evidence they produce. Before you go, hold the one habit that ties the domain together: every test is a purchase of information, the question decides what to buy, and the report decides what the organization does next. A test that is bought without a question and read without a decision is a ritual, and the exam, like the profession, is scoring you on the difference.
Continue reading
Full table of contents