guide: empowered organizations

 
 

overview

I unlock the full potential of teams and organizations through evidence-based, values-driven leadership.

high-performing organizations

High-performing organizations are made up of a combination of empowered and accountable teams. Empowered teams are trusted to establish their own strategies and roadmaps and are held accountable for the results rather than the output of their effort.

empowered organizations

High-performing organizations consist of teams of capable leaders focused on outcomes rather than output.

  • Hire capable people, point them in the right direction, and get out of the way

  • Treat every person as a leader, regardless of title or position

  • Focus on outcomes rather than output

accountable organizations

High-performing organizations consist of stable teams of highly skilled people guided by an empowered team system.

  • Clear and measurable purpose and objectives

  • Continuous discovery

  • Continuous agile delivery

in this guide

This guide is geared toward product teams just getting started with an empowered organization model; however, the guidelines are applicable beyond product and design teams. This guide is organized similar to how I approach any new organizational transformation:

  1. Skills assessment and career ladders for product and design

  2. Establishing continuous discovery and delivery cycles

  3. Establishing measurable objectives using the objectives and key results (OKRs) framework

This guide is informed by the work of Marty Cagan and the Silicon Valley Product Group (empowered team model and discovery vs delivery cycles), Teresa Torres (continuous discovery), John Doerr (objectives and key results), Kerry Rodden et al. from Google (HEART metrics framework), Peter Merholz (design skills and career ladder), and others. I encourage everyone to read their books, blogs, and other published materials.

Skills and knowledge

product management

Based on the product skills assessment developed by Marty Cagan and SVPG, I developed an assessment tool that aligns to a six-level career ladder for individual contributor product managers. Marty outlines three categories of skill types: product, process, and people.

Product Skills

Skill Description Associate Product Manager Product Manager Sr Product Manager Lead Product Manager Principal Product Manager Staff Product Manager
Average 4.2 5.6 6.6 7.6 8 8
User/Customer knowledge Is the product manager a company acknowledged expert on her target users/customers? 5 6 7 8 8 8
Data knowledge Is the product manager skilled with the various data tools and considered by her product team and her stakeholders as an acknowledged expert in how the product is actually used by users? 4 6 7 8 8 8
Industry & Domain knowledge Is the product manager knowledgeable about the industry and domain? Does she understand the competitive landscape and the relevant industry trends? 4 6 7 8 8 8
Business & company knowledge Does the product manager understand the various dimensions of your company’s business – marketing, sales, finance (both revenue and costs), services, legal, privacy, etc.? And do the stakeholders believe that the product manager understands their concerns and constraints? 4 5 6 7 8 8
Product operational knowledge Is the product manager considered an acknowledged expert on how her product actually works? Would she be able to effectively demo to a prospective customer, train a new customer on how to successfully use, and handle live customer support inquiries? 4 5 6 7 8 8

Process Skills

Skill Description Associate Product Manager Product Manager Sr Product Manager Lead Product Manager Principal Product Manager Staff Product Manager
Average 3 5 6.25 7.25 8 8.5
Product discovery techniques Does the product manager have a strong understanding of the product risks and how to address each of them? Does she understand how to tackle risks up front, before engineers are asked to build? Does she know how to solve problems collaboratively? Does she focus on outcome? Does she understand and utilize both qualitative and quantitative techniques? 3 5 6 7 8 9
Product optimization techniques Once a product or new capability is live and in production, does the product manager know how to utilize optimization techniques to rapidly improve and refine her product? 3 5 7 8 8 9
Product delivery techniques While the product manager’s primary responsibility is discovery, she still has an important supporting role to play in delivery. Does she understand her responsibilities to the engineers and to product marketing? 3 5 6 7 8 8
Product development techniques Does the product manager have a solid understanding of the broader product development process including discovery and delivery, as well as the product manager’s administrative responsibilities as the team’s product owner? 3 5 6 7 8 8

People Skills

Skill Description Associate Product Manager Product Manager Sr Product Manager Lead Product Manager Principal Product Manager Staff Product Manager
Average 4 5.25 7 7.5 8 8.25
Team collaboration skills How effectively does the product manager work with her developers and product designer? Is it a collaborative relationship? Is there mutual respect? Is the product manager involving the developers and designer early enough and providing them direct access to customers? Is the product manager fully leveraging her team’s skills and minds? 4 5 7 8 8 8
Stakeholder collaboration skills How good is the product manager at managing her stakeholders across the company? Do they feel like they have a true partner in product that is genuinely committed to their business success? Has she established mutual respect and mutual trust with each stakeholder, including the senior leadership of the company? 4 6 8 8 8 9
Evangelism skills Is the product manager able to effectively share the product’s vision and strategy, and motivate and inspire her product team, as well as the various stakeholders and others in the company that must contribute to the product in one way or another? 4 5 6 7 8 8
Leadership skills While the product manager does not actually manage anyone, she does need to influence and inspire people, so leadership skills are important. Is she an effective communicator and motivator? Do her team and her stakeholders look to her for leadership especially in stressful situations? 4 5 7 7 8 8

Design & Research Skills

Based on my own experience and the book Org Design for Design Orgs by Peter Merholtz, I use this design and research skills guide.

Skill Description
Interaction Design How it works. How people interact with it.
Visual Design How it looks. How it feels.
Prototyping How it behaves. Creating meaningful prototypes for the stage of design, from paper to fully functional.
Information Architecture How it is structured. How information is presented.
User Research / Data Analysis / Consumer Insights Deliver consumer insight via interviews, usability, surveys, behavioral data, and A/B testing.
Writing What it says. Clearly articulated in terms the customer understands.
Animation / Motion Design How it moves.
Service Design How the experiences fit together.
Front-end Development Building it.
Video and Photo Production Capture, edit, and use of photography and video material
Concept Art / Direction Illustration, branding, and directing the marketing creative process
Facilitation Helping a cross-functional team to capture, evaluate, and merge disparate ideas to create a better overall product.

Leadership Skills

These leadership behaviors are based on the extensive research and writing of Barry Posner and Jim Kouzes. They identified the top five leadership behaviors most correlated to the engagement of employees within high-performing organizations.

Leadership Behaviors Description (Taken from Leadership Challenge)
Model the way Clarify values, set the example
Inspire a shared vision Envision the future, enlist others, evangelize the vision
Challenge the process Search for opportunities, experiment and take risks
Enable others to act Foster collaboration, strengthen others
Encourage the heart Recognize contributions, celebrate values and victories

assessments

Skill Levels

Each skill is ranked 1-5, with two steps for each rank to provide flexibility, for a total of ten steps.

Very few people reach level five; most top out at level four. While there are many extraordinary chefs, there are only 106 three-star Michelin star chefs in the world.

  1. Starting: New to the field, some training (GA, boot camps), but little practical experience

  2. Practiced: Some practical experience, undergraduate or masters degree

  3. Capable: Works with little guidance, knows when to ask for help, starting to mentor others

  4. Expert: Seen as an expert by peers, mentors others, adds new ideas to the field

  5. Mastery: Considered an expert by the discipline (i.e.: Don Norman, Peter Drucker), added new ideas to the field, inspiring, inventive

Product Management Assessment Template

I created this template to serve as a guide to building out assessments for each person on the team. Black dots are the current level, gray indicates a target. As noted above, the skills are scored 1-10 to add some nuance to the five-level system. Strengths are the top five strengths from the CliftonStrengths StrengthsFinder assessment by Gallup. The Skills Map is generated with a spreadsheet using a spider chart. The handy tool visualizes where someone is, what skills they’re working toward, and provides some context about the person’s motivation, teamwork style, and strengths. I also create a comprehensive skills map for the org to identify gaps that need systemic training beyond what coaching can provide.

Assessment template for product managers.

Assessment template for product managers

Career Ladders: Product management, design, and research

These career ladders are starting points to set up your own. The product manager ladder is modified from a high-performing company I worked with to establish their design and research (discovery) discipline that has since completed a successful public offering (IPO). The design career ladders are designed by Peter Merholz and Kristin Skinner, edited very slightly for clarity (full writeup here.)

Career Ladder: Product Manager (Individual Contributor)

Level Title Summary Vision & Strategy Design & Customer Structured Thinking Comms & Motivation Implementation
2 Associate PM and PM 1 Do planned work independently, aligning sub-team priorities with overall product strategy. - With help from their manager, creates sub-team product strategies and OKRs
- Aligns sub-team priorities with overall product and company strategy
- Takes competitive best practices into consideration where appropriate.
- Develops an understanding of how to work with designers; uses user-focused rationale for product definition that impacts design - With help from their manager, identifies key success metrics and measurement vehicles for the initiatives they are driving.
- Uses metrics to measure success for their features
- With help from their manager, clearly communicates the strategy and importance to the company of the initiatives they are driving to achieve team alignment
- Consults with stakeholders and managers, as needed, to clarify questions and points of confusion with a given product initiatives
- Drives well-framed and unambiguous product initiatives independently.
- With help from their manager, reactively understands and escalates issues that block team execution. Steps up to help with resolutions as needed.
- Sets and communicates clear expectations for their projects, both internally in the team and stakeholders in the company
- Keeps up team momentum by escalating issues to manager / approver for quick resolution
3 PM 2 and Senior PM Do work. Decompose work for others. - Independently creates team-level product strategies and OKRs
- Aligns team priorities with overall product and company strategy
- Stays updated on industry trends and developments in their area of ownership
- Can give actionable feedback to designers and run their own customer studies.
- Has developed intuition on customers’ needs for their product areas
- Consistently ships features that are regarded as well-designed in the company
- Can break down a strategy into coherent pieces for a team to execute against.
- Clearly identifies hypotheses and the right success metrics for their initiatives
- Uses metrics to evaluate success/failure of team OKRs
- Aligns with data scientists on analytics strategy for their product area
- Can motivate a team to think beyond the roadmap and bring ideas not otherwise thought of
- Can create alignment within the team
- Consults with others proactively to clarify anticipated questions and points of confusion across the product team / multiple product initiatives
- Drives loosely-framed and somewhat ambiguous product initiatives independently.
- Clears obstacles to execution for a team. Does whatever it takes to help the team ship.
- Creates cross-functional alignment needed to execute on projects
- Sets and communicates clear expectations for their team roadmap, both internally in the team and stakeholders in the company
4 Senior PM Identify problem and solutions - Responsible for leading product strategies and OKRs for multiple teams, spanning several quarters
- Mostly aligns with though sometimes challenges/influences changes in product and company strategy
- Understands the broader competitive landscape for their areas of responsibility
- Aligns with design manager on design strategy for their teams
- Have developed intuition on customers needs for their own product areas as well as adjacent product areas
- Breaks down unframed and highly ambiguous problems into clear product initiatives independently
- Aligns with data scientists on analytics strategy for multiple product areas
- Can create alignment among other product teams
- Can mentor and guide fellow PMs to understand and achieve their product goals and become better PMs
- Brings together the right people to frame and answer difficult or ambiguous questions and make clarifying recommendations that impact product initiatives across multiple teams
- Can independently drive projects that require significant xfnl alignment
- Anticipates and avoids obstacles to execution, for both their team as well as for cross-functional partners
- Can run multiple roadmaps and multiple sprints
- Sets and communicates clear expectations for their projects, both internally in the team and stakeholders in the company
- Can execute multi-phased product rollouts and tests
- Clears obstacles to execution by creating organizational buy-in from product leadership and other cross-functional leaders
5 Staff PM Anticipate and avoid problems - Responsible for influencing and driving changes in company-wide strategy in a specific domain
- Drives new product definition and framing that reflects real-time strategic changes
- Understands competitors’ strengths and incorporates into product strategy where appropriate.
- Aligns with design managers / director on a design strategy
- Can lead multiple customer studies
- Has deep intuition on customers’ needs as a whole
- Champions the voice of the customer across multiple teams
- Can run weekly metric review meetings for his or her area
- Identifies the critical problems that must be solved to execute on company vision.
- Breaks down company vision into coherent quarter by quarter execution plan for their domain.
- Can create alignment to drive strategy for large company-level initiatives
- Is the internal and external “spokesperson” for his or her domain; coaches PMs on how to do the same for their projects
- Brings together the right people to formulate clarifying recommendations that impact product initiatives and strategy in a specific domain
- Consistently produces a lot of high quality work that moves metrics positively
- Clears obstacles to execution by creating organizational buy-in from executive staff
6 Principal PM Set and execute product vision. - Responsible for pulling together a coherent product strategy in critical path product initiatives that impact multiple product domains
- Takes into account market trends and anticipates competitive developments
- Working with the design leaders, sets the vision for design in critical path initiatives that impact multiple product domains. - Breaks down company vision for a critical path product area into coherent quarter by quarter product execution plan that impacts multiple product domains - Creates alignment across multiple PMs and cross-functional teams, and ultimately across the entire company for a critical path product area
- Collaboratively formulates recommendations that impact critical path product initiatives and strategy across multiple product domains
- Responsible for product outcomes for critical path product initiatives that span multiple domains
- Executes effectively and achieves outstanding results in critical path product areas

Career Ladder: Product Manager (manager)

Level Title Summary Vision & Strategy Design & Customer Structured Thinking Comms & Motivation Implementation
5 Manager Identify problem and solutions; can manage 1-2 PMs - Responsible for leading product strategies and OKRs for multiple teams, spanning several quarters. This will often happen through guiding and influencing individual PMs on the team. - Sets the vision for design across multiple teams with design manager.
- Champions the voice of the customer across multiple teams
- Coaches PMs how work effectively with their design and research partners and set strategies
- Can run multiple roadmaps and multiple sprints
- Sets the analytics strategy across their teams
- Can execute multi-phased product rollouts and tests
- Coaches PMs on how to create the best testing plans and how to use metrics to guide strategy
- Can create alignment among other product teams
- Can mentor, guide and manage IC PMs to understand and achieve their career goals
- Guides PMs to resolve conflicts and motivate their product teams
- Guides PMs to gain xfnl alignment
- Works with their PMs to consistently produce a lot of high quality work that moves metrics positively
- Works hands-on with their PMs to coach them on how to execute effectively
6 Director Anticipate and avoid problems; can manage a group of PMs and PM managers. - Responsible for influencing company-wide strategy in a specific domain
- Responsible for hiring strategy for their domain
- Sets the vision for design for an entire domain (e.g. Growth) with design managers and / or director - Runs weekly metric review meetings for his or her domain
- Has expert level command, and demands the same from his or her team, of the metrics
- Can create alignment to drive strategy for large company-level initiatives
- Can manage a team of PMs
- Is the internal and external “spokesperson” for his or her domain; coaches PMs on how to do the same for their projects
- Responsible for fostering highly motivated teams by connecting talent with opportunity
- Effectively guides PMs to independently drive projects that require significant xfnl alignment
- Effectively translates product vision into actionable strategy for teams to execute on
- Responsible for enabling teams to reach highly effective execution
7 VP Set and execute product vision; manages all PMs. - Responsible for pulling together a coherent product strategy across all product initiatives - Sets the vision for design working with the design director - Breaks down company vision into coherent quarter by quarter product execution plan - Creates alignment across the entire company
- Creates excitement for product initiatives across the entire company
- Responsible for overall product outcomes
- Helps align team structures and incentives to execute flawlessly

Career Ladder: product design and research (Individual Contributor)

Contributor Driver Leader
Associate Designer / Intern Designer Senior Lead Staff or Associate Creative Director Principal or Creative Director
Theme A supporting-level player who is honing their craft and working to understand organizational context An established performer with capable communication skills who proactively builds relationships A high-level performer with capable relationships and the ability to lead projects A leading performer who prefers to manage projects over managing people. Indispensable individual contributor. Indispensable individual contributor.
Keywords Professionalism, craft, focused effort Communication, craft Expertise, process, explain rationale, cross-functional Depth, expertise, innovation, persuasion, strategic, confidence; programs not projects Breadth, mentorship, evangelism, thought leadership, visionary, storytelling Breadth, mentorship, evangelism, thought leadership, visionary, storytelling
Achievements (what person has done to arrive at this level) Right out of school, quality portfolio, but little to no shipped work Contributed to a couple of shipped projects Contributed to multiple shipped products Leads the delivery of shipped products; Delivered successful work at the scope of ‘product areas’ Leads teams in framing and solving hard problems; has driven innovative efforts that uncovered new value with new kinds of experiences; presents company as an industry leader in design Driven company-wide innovation efforts; led successful company-wide design efforts (e.g., rebranding); presents company as an industry leader in design
Delivery
  Core Skills (see overview) Practiced in 1, Starting in 2-3 others Capable in 2, practiced in 2 others Expert in 1, capable in 2, practiced in 2 others Expert in 2, capable in 2, practiced in 1-2 others
  Process/Practice/Planning capable and practiced engagement in standard design processes capable and practiced engagement in standard design processes Develops the process/approach for tackling a design problem, using known methods; anticipates problems Develops and uses facilitation skills to engage cross-functional teams;
Explores new patterns and practices, enhancing methodological toolkit; shifts from project planning to program planning
Completed shift to 'program,' working across multiple workstreams; develops new practices that drive increased value and appreciation of design both internally and externally. Program-focused; working across multiple workstreams; develops new practices that drive increased value and appreciation of design both internally and externally.
  Problem Solving Learning best practices for common design problems; solutions are solid, though not novel Confident in applying best practices to common design problems; solutions are solid, not novel Begins going beyond best practices, and starts uncovering novel, unexpected, but still workable solutions Develops problem-framing approaches, establishing new starting points that lead to new kinds of solutions, which affects strategic thinking, not just execution Uses design methods not as a tool to solve execution problems, but to identify new opportunities for value creation Uses design methods not as a tool to solve execution problems, but to identify new opportunities for value creation
Scope Solve specific function-level problems (e.g., "add to shopping cart") Given specific product capabilities that need to be solved (e.g., Checkout process) Leads the solution of a product area; connects that to broader product vision (e.g, product page and purchase experience) Leading the solution of undefined problem spaces (e.g. “How can we reconsider how people look for and purchase items?") Entire user experiences (e.g., "What is the end-to-end consumer/shopper experience?”) or leading special/innovation projects The Big Picture of an entire company's offerings, and how they integrate and coordinate
Communication
  Presentation Developing skill for communicating rationale to team members Confidently communicates decision-making rationale to team members Communicates rationale to partners Storytelling and persuasion techniques build trust with partners and establish long-term relationships; comfortable communicating at all levels of the organization; demonstrates confidence and charisma Uses storytelling and persuasion to connect strategy and vision with day-to-day practicality Communicates compelling vision that makes new strategies concrete
  Cross-functional Meetings Attending the meeting Contributing to the meeting Active planner of the meeting Driving the meeting
Leadership Doesn't take requirements as a given; makes sure there's a human perspective brought to bear Emerging recognition that it's not all about design, but how design contributes to a broader goal; recognizes business goals and technical constraints Clarifies success metrics and ties efforts toward delivering business value Uses understanding of impact and success metrics to focus their team's efforts; Emerging understanding of broader organizational context and goals; Connects team's efforts with savvy grasp of ecosystem and organizational context; Developing an ability to articulate a vision Actions reflect holistic, integrated understanding of organizational context; appreciates LOB-level strategy; Develops and articulates compelling vision for the team; Working with partners and stakeholders, begins making real change in how the company approaches its business Actions reflect holistic, integrated understanding of organizational context; appreciates line-of-business-level strategy; Develops and articulates compelling vision for the team; Working with partners and stakeholders, begins making real change in how the company approaches its business
Relationship with Team Part of a team that they’ve been assigned to Part of a team they’ve been assigned to Part of a team they’ve been assigned to, in a leadership role; collaborating with cross-functional peers Leading a team that's been provided; defining the problem with cross-functional peers; mentoring contributor-level practitioners Creating the team needed; defining the problem with cross-functional leads; Influence at all levels of the organization; mentoring contributors and leaders; Creating the cross-functional team needed; defining the problem with cross-functional leads; Influence at all levels of the organization; mentoring contributors and leaders;
Recruiting / Hiring Attends campus recruiting sessions; able to communicate mission, values, and work of the design team
Refers people in their professional network for jobs Active in screening and interviewing candidates; trained on best practices of hiring interviews; builds new networks of professional colleagues Developing judgment for evaluation of talent; provides feedback for shape of their overall team Attracts top-tier talent; demonstrates thought leadership and promotes company publicly as a leader in design Attracts top-tier talent; demonstrates thought leadership and promotes company publicly as a leader in design

Career Ladder: product design and research (Manager)

Manager Sr Manager/Associate Director Director Sr Director VP/CXO
Themes An organized leader and performer who pushes convention and drives change Effective leader focused on building teams and process for high impact results Dynamic leader, focused on strategic vision, growing talent and execution Storyteller. Team Builder. Driver of cross-functional strategy. Articulate a compelling vision; help run the company
Keywords Persuasion, strategic, compassion, nurturing Delegation, expertise, innovation, confidence, growth; programs not projects Mentorship, new value creation, organization-wide leadership, planning, operations Vision, storytelling, scaling, organization design Recruiting and hiring; establishing culture; accountability; vision, evangelism
Achievements Leads the delivery of shipped products; Delivered successful work at the scope of product areas Has successfully managed 4-5 people; Demonstrated success managing others; able to drive multiple, related product areas Significant management experience (teams up to 10 people); recruited and hired teams Lead teams in framing and solving hard problems; has driven innovative efforts that uncovered new value with new kinds of experiences; has managed managers Successfully run design organizations (of around 10-15 or fewer); Demonstrated ability to engage executive leadership across the company
Delivery
  Core Skills (see overview) Expert in 1, capable in 2, practiced in 2 others
  Process/Practice/Planning Develops the process/approach for tackling a design problem, using known methods; anticipates problems; develops facilitation skills to engage cross-functional teams Explores new patterns and practices, enhancing methodological toolkit; shifts from project planning to program planning, across multiple workstreams Completed shift to 'program,' working across multiple workstreams; develops new practices that drive increased value and appreciation of design both internally and externally. Articulates a new process framework for tackling design problems; involved in annual planning Establish a philosophy/mindset for how the team approaches its work (e.g., The Double Diamond); guides annual planning
  Problem Solving Begins to realize the power of problem-framing, establishing new starting points that lead to new kinds of solutions Develops problem-framing capabilities, affecting strategic thinking, not just execution Uses design methods not as a tool to solve execution problems, but to identify new opportunities for value creation Realizes how shaping their organization drives new kinds of problem-solving. Reframes company-wide "problems" to suggest new approaches for solving them.
  Scope Leading the solution of undefined problem spaces (e.g. “How do people complete a transaction?”) Frees resources to drive change by systematically cutting low return activities Entire user experiences (e.g., "What is the end-to-end shopper experience?”); Active in company-wide leadership iniitiatives Entire user experiences (e.g., "What is the end-to-end shopper experience?”); Active in company-wide leadership initiatives; Drives new company initiatives The Big Picture of an entire company's offerings, and how they integrate and coordinate
Communication
  Presentation Communicates design rationale, and uses storytelling techniques, with partners and stakeholders Storytelling and persuasion techniques build trust with partners and establish long-term relationships; comfortable communicating at all levels of the organization; demonstrates confidence and charisma Uses storytelling and persuasion to connect strategy and vision with day-to-day practicality Uses storytelling and persuasion to connect strategy and vision with day-to-day practicality Communicates compelling vision that makes new strategies concrete
  Cross-functional Meetings Driving the meeting Driving the meeting Driving the meeting when communicating up; stakeholder for when a lead/manager on your team is driving the meeting Stakeholder for whom the meeting exists Stakeholder for whom the meeting exists
Leadership Uses understanding of impact and success metrics to focus and reprioritize their and their team's efforts; Emerging understanding of broader organizational context and goals Connects team's efforts with savvy grasp of ecosystem and organizational context; Developing an ability to articulate a vision Strong delegation practices, recognizing that they cannot do the work directly and must be leveraged; Actions reflect holistic, integrated understanding of organizational context; appreciates line-of-business-level strategy; Develops and articulates compelling vision for the team Working with partners and stakeholders, begins making real change in how the company approaches its business; Articulates vision for the team that excites and inspires leaders and partners Establishes cultural practices that drive the team's behavior
Relationship with team Leading a team that's been provided; collaborating with cross-functional peers; Active in recruiting and hiring Creating the team you need; defining the problem with cross-functional leads Creating the team needed; defining the problem with cross-functional leads Establishing the organizational structure, defining roles, opening headcount Establishing the organizational structure, defining roles, opening headcount
People Management Develops basic understanding of people management practices, particularly around professional development; emerging ability to delegate work to others Creates opportunities for reports to grow and flourish; comfortable handling 7-8 direct reports Begins to manage managers; coaches them toward capable people management practices; drives broader organizational efforts around culture, work, and values Helps understand, create, and model team culture and values Manages directors; shifts from 'management coaching' to 'executive coaching'; Helps directors understand how to leverage themselves
Recruiting / Hiring Developing judgment for evaluation of talent; provides feedback for shape of their overall team Identifies need for new people; shapes requisition; works with recruiter to find talent Active in annual and ad hoc headcount planning for the organization; works to secure necessary budget Attracts top-tier talent Establishes recruiting and hiring practices for the team

Operations

Give me six hours to chop down a tree and I will spend the first four sharpening the axe.
— Abraham Lincoln

Continuous Discovery

Discovery is more than usability, A/B tests, or research interviews. Discovery efforts are conducted across every organization, including corporate strategy, product research, market analysis, supply chain analysis, and technology feasibility. Discovery can be subdivided into three categories: foundational, generative, and evaluative. For more on discovery methods I recommend 101 Design Methods by Vijay Kumar and Inspired by Marty Cagan.

Marty Cagan outlines four risks discovery efforts are intended to minimize: value to the customer, viability for the business, usability for the user, and feasibility technologically. I abstract that one level higher to include corporate strategy, from strategic viability and potential value with a market to organizational feasibility to determine if a company has the skills necessary to successfully accomplish a mission.

Foundational

Foundational discovery is aimed at understanding the customer needs, market landscape, technological possibilities, and corporate strategies best aligned with the organization’s mission. Foundational discovery includes market and strategic analysis such as segmentation studies, Value, Rarity, Imitability, and Organization (VRIO) analysis, value chain analysis, or value-cost (V-C) analysis, and advanced technology proofs of concept. Foundational discovery leads to target markets, strategies, business models, product ideas, and new technology breakthroughs. For more on this level of foundational research, read my series on assessing a business. In his book 101 Design Methods, Vijay Kumar describes seven modes of the innovation process. Modes 1-3, sense intent, know context, and know people, are dedicated to foundational research tools.

Generative

Generative discovery involves efforts to understand what to build, or how to create services that align with the organization’s mission. Generative discovery includes participatory design activities, observational research such as ethnographies, proofs of technical concept, and design sprints, popularized by Jake Knapp. In 101 Design Methods modes 4 and five, frame insights and explore concepts, are mostly generative in nature. Some A/B tests can also be considered generative because they help to understand how people react to more than one possible solution.

Evaluative

Evaluative discovery helps identify risks with final solutions defined through generative discovery. Evaluative discovery includes usability studies, multivariate tests, alpha or beta tests to identify feasibility issues with a potential solution, and painted door experiments to determine if customers will sign up for a product. Evaluative discovery also helps us test business case hypotheses through concept testing, market evaluation, and early adopter evaluations.

Continuous Delivery

Agile and Kanban are examples of continuous delivery frameworks. The point of these frameworks is to deliver products, be they services or features, to customers as quickly and regularly as possible. Delivery is what we do once we’ve exhausted the discovery cycles, and discovery includes a lot of things that many people think of as delivery. Once a product, feature, or service moves beyond a minimal viable product (MVP), which is a discovery technique, and the organization has good reason to believe in continuing to invest in a concept, then we build it in a production-quality way using modern software engineering methodologies.

Objectives and Key Results

The internet is full of books and articles on objectives and key results (OKRs), so I don’t want to belabor the point. What most of the writing I’ve seen fails to do is give a direct framework for writing objectives and identifying key results. My thinking has been inspired by my time at Google, Coursera, and other companies where OKRs were heavily used, the writing of John Doerr, who introduced OKRs to Google and the world after learning them from Andy Grove, Christina Wodtke who writes extensively on OKRs, and the study of pedagogy (instructional design), specifically Bloom’s Taxonomy.

Objectives

As everyone who writes about OKRs will state, an objective is a non-metric statement that describes some future state. Some examples include:

  • Become the leading expert on a topic

  • Be the best marketing tool for small businesses

  • Get customers to value as quickly as possible

The way I try to approach objective statements is twofold: first, use the ‘how might we’ technique from design sprints, and second, use something like Bloom’s Taxonomy to help frame the expected outcome. I also try to frame the objective in language that shows how my target audience will benefit, which is why I like Bloom’s Taxonomy and the concept of learning objectives. In education, a learning objective is something a student accomplishes, and the assessment a professor gives is to determine if their instruction is effective, rather than if the students are good at learning.

I’ll take the first objective from above and rewrite it. How might I become a leading expert on organizational transformation for small software businesses trying to scale?

My objective is behavior change I’m trying to introduce for myself, so this is a personal OKR. If I drop the how might I, the objective becomes:

  • Become a leading expert on organizational transformation for small software businesses trying to scale

This objective is pretty big, so it probably needs to be broken down into smaller parts. This is a key reason why focusing on the objectives before key results or key performance indicators is important. Objectives can be measured in many ways, but prioritizing objectives is the most important step a team makes during planning.

Key Results

Key results are how we measure if we’ve accomplished our objective. I’m trained as a social and computer scientist (Bachelor of Science in Psychology and Master of Science in Human-Computer Interaction), and I believe everything can be measured. If you don’t believe me, watch the Netflix docuseries Babies. The researchers managed to find ways to measure just about everything and measuring user behavior change is generally much easier than trying to find a way to measure if babies can distinguish different voices in their early weeks of life.

To help frame key results, I use a combination of the pirate metrics and HEART frameworks, which I’ve written about before.

  1. Identify a target user

  2. Identify a behavior you want to improve

  3. Articulate what signals indicate the behavior

  4. Identify and measure a metric that measures the signal

  5. Make changes intended to modify the behavior

  6. When something works, invest more into that path until it doesn’t work as well

For my personal objective, become a leading expert on organizational transformation for small software businesses trying to scale, a few decent key results might be:

  • increase my LinkedIn following by 10x

  • increase personal site visits by 10x

  • speak at five conferences this year (indicating I’m being seen as an expert by others)

  • land a book deal by the end of year (indicating publishers view me as an expert enough to publish my work)

Just like in a classroom, key results are the assessment of progress toward the objective. If your learning objective is to demonstrate mastery of basic economic principles, you might assess that through an exam, a homework assignment, a paper, or a presentation that combines important topics through synthesis. For this example, I would next brainstorm ways to increase LinkedIn followers and site visitors, have to look into and apply to speak at conferences, and figure out how to land a publisher. Those are all projects associated with my objective and key results.

Getting Started

The First Time

If the team isn’t already using OKRs and doing discovery and delivery cycles, the first few quarterly planning cycles will be more laborious. Once the teams get the hang of it, they shift to continuous planning, ensuring by the time the quarterly updates come around, they’ve been planning and assessing along the way to limit the overhead of this process. Here is the plan I use for getting the teams set up the first time.

  1. Establish yearly targets for the business and create business OKRs

    1. Answer: What are you trying to accomplish as a business and how will we measure progress?

    2. Outcome: Established key results are metrics one level lower than revenue that lead to positive net income: i.e.: grow customers, retain customers, or increase average revenue per user.

  2. Collaborate with each team to develop a mission - what is the purpose of the team?

    1. Answer: Teams, stable or short-term, know why they exist and what they’re trying to accomplish and what customer they serve. External or internal, every team is providing a service for someone.

    2. Outcome: Every team has a clear sense of purpose for helping their target customer

  3. Team leads work with leadership to determine the core objectives of the team

    1. Answer: How the team will assess the success of their work toward their objectives and mission.

    2. Outcome: Non-metric objective statements oriented toward the success of their target customers that describe a behavior the team is responsible for improving

  4. Team leads collaborate with their teams to determine and establish effective key results (KRs) to assess how they’re doing at achieving their objective.

    1. Answer: How will we measure progress toward our goals?

    2. Outcome: 3-5 metrics that can be measured in meaningful time periods to indicate progress

    3. Note: KRs are measurements: ratios are best, but can be numerical or dates as needed. They ideally measure the behavior change needed to succeed at the goal

  5. Teams generate ideas for achieving their goals

    1. Note: Teams now have 1) a team objective, 2) the desired outcome, 3) their target audience, and 4) the expected outcome for their target audience. Using something like the Lean UX canvas, the team can now generate ideas to attain their objectives through workshops, research, brainstorming, etc.

    2. Answer: Proposals for projects the team will work on to accomplish the objectives as measured by the key results.

    3. Outcome: Prioritized list of discovery and delivery projects