<!-- page 1 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

## **NATIONAL INSTITUTE FOR HEALTH AND CARE EXCELLENCE** 

# **Final appraisal determination** 

# **Nivolumab for treating relapsed or refractory classical Hodgkin lymphoma** 

## **1 Recommendations** 

- 1.1 Nivolumab is recommended, within its marketing authorisation, as an option for treating relapsed or refractory classical Hodgkin lymphoma in adults after autologous stem cell transplant and treatment with 

   - brentuximab vedotin, when the company provides nivolumab with the discount agreed in the patient access scheme. 

## **2 The technology** 

|**Description of the**<br>**technology**|Nivolumab (Opdivo, Bristol-Myers Squibb) is a<br>human monoclonal antibody that blocks an immune<br>checkpoint protein receptor called programmed cell<br>death protein 1 (PD-1) to promote anti-tumour<br>response.|
|---|---|
|**Marketing authorisation**|Nivolumab has a marketing authorisation in the UK<br>for ‘the treatment of adult patients with relapsed or<br>refractory classical Hodgkin lymphoma after<br>autologous stem cell transplant and treatment with<br>brentuximab vedotin’.|
|**Adverse reactions**|The most common adverse reactions with nivolumab<br>in clinical trials were diarrhoea, nausea, fatigue,<br>pyrexia, rash (occurring in at least 10% of people).<br>For full details of adverse reactions and<br>contraindications, see the summary of product<br>characteristics.|
|**Recommended dose and**<br>**schedule**|3 mg/kg given intravenously every 2 weeks.|
|**Price**|The list price is £439 per 40 mg vial or £1,097 per<br>100 mg vial (excluding VAT; ‘British national<br>formulary’ [BNF])<br>The company has agreed a patient access scheme<br>with the Department of Health. This scheme provides<br>a simple discount to the list price of nivolumab with|



National Institute for Health and Care Excellence 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 




<!-- page 2 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

the discount applied at the point of purchase or invoice. The level of the discount is commercial in confidence. The Department of Health considered that this patient access scheme does not constitute an excessive administrative burden on the NHS. 

## **3 Evidence** 

The appraisal committee (section 7) considered evidence submitted by Bristol-Myers Squibb and a review of this submission by the evidence review group. See the committee papers for full details of the evidence. 

## **4 Committee discussion** 

The appraisal committee reviewed the data available on the clinical and cost effectiveness of nivolumab, having considered evidence on the nature of classical Hodgkin lymphoma and the value placed on the benefits of nivolumab by people with the condition, those who represent them, and clinical experts. It also took into account the effective use of NHS resources. 

## _**Current clinical management of Hodgkin lymphoma**_ 

- 4.1 The committee noted that there was currently no NICE technology appraisal guidance on Hodgkin lymphoma. It understood that current practice is first chemotherapy with or without radiotherapy. If this fails to lead to long-term remission, people may have high-dose chemotherapy followed, when possible, by autologous stem cell transplant. Brentuximab vedotin for Hodgkin lymphoma is being appraised by NICE. It is currently available on the Cancer Drugs Fund following at least 2 previous therapies when autologous stem cell transplant or multi-agent chemotherapy is not a treatment option, and for relapsed disease following autologous stem cell transplant in patients who have not previously had brentuximab vedotin. Up to half the people who have had autologous stem cell transplant develop progressive disease with a mean life expectancy of less than 3 years. The committee heard from the clinical 

National Institute for Health and Care Excellence Page 2 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 3 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

experts that people whose disease has relapsed may be offered further, usually single-drug chemotherapy, including brentuximab vedotin, gemcitabine, bendamustine or cisplatin, as salvage therapy. This aims to control the disease, and if possible, elicit a disease response to enable allogeneic stem cell transplant. 

- 4.2 The committee understood that allogeneic stem cell transplant is the treatment of choice after autologous stem cell transplant has failed, provided there is a suitable donor and a good response to systemic therapy. The committee heard that allogeneic stem cell transplant is offered to relatively fit patients whose disease achieves a partial or complete response to salvage therapy following failure of autologous stem cell transplant. The committee heard from the clinical experts that allogeneic stem cell transplant is potentially curative in around 60% of patients who have it. The committee recognised that there is an unmet clinical need for patients whose disease does not achieve a partial or complete response to salvage therapy after autologous stem cell transplant fails. It understood from the clinical experts and patient organisations that nivolumab had the potential to act as salvage therapy to enable allogeneic stem cell transplant after both autologous stem cell transplant and brentuximab vedotin. 

- 4.3 The committee considered the experience of people with relapsed or refractory Hodgkin lymphoma following autologous stem cell transplant. It heard from the patient experts that the side effects of existing chemotherapy treatments affect their quality of life and can dissuade people from allogeneic stem cell transplant (if transplant becomes possible). It heard from the clinical experts that treatment with nivolumab was generally well tolerated because it has more manageable side effects than existing treatments, and that it can significantly improve patients’ quality of life. 

National Institute for Health and Care Excellence 


Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 4 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

4.4 The committee noted that the population in the marketing authorisation could be subdivided into 3 groups, based on the position of brentuximab vedotin in the treatment pathway for Hodgkin lymphoma: 

- Adults with relapsed or refractory classical Hodgkin lymphoma after autologous stem cell transplant and brentuximab vedotin, when brentuximab vedotin is used as salvage therapy to enable an autologous stem cell transplant. 

- Adults with relapsed or refractory classical Hodgkin lymphoma after autologous stem cell transplant and brentuximab vedotin, when brentuximab vedotin is used as salvage therapy to enable an allogeneic stem cell transplant (after autologous stem cell transplant fails). 

- Adults with relapsed or refractory classical Hodgkin lymphoma after autologous stem cell transplant and brentuximab vedotin, when brentuximab vedotin is used both as salvage therapy to enable an autologous stem cell transplant and as salvage therapy to enable an allogeneic stem cell transplant (after autologous stem cell transplant fails). 

The committee noted that brentuximab vedotin’s UK marketing authorisation does not explicitly exclude retreatment, but retreatment was not permitted through the Cancer Drugs Fund. The committee therefore did not consider the final group because brentuximab vedotin retreatment is not currently used in clinical practice in England. The committee concluded that based on current clinical practice, nivolumab would be used in patients who have had autologous stem cell transplant and brentuximab vedotin, when brentuximab vedotin has been used as salvage therapy to either enable an autologous stem cell transplant or to enable an allogeneic stem cell transplant following failure of autologous stem cell transplant. 


National Institute for Health and Care Excellence 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 5 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

## _**Clinical effectiveness**_ 

4.5 The committee noted that the evidence for nivolumab in this population came from 2 non-comparative single-arm trials: CheckMate 205 (cohorts B and C) and CA209-039. The trials included patients who had brentuximab vedotin after autologous stem cell transplant (CheckMate 205 cohort B and CA209-039), patients who had brentuximab vedotin either before or after autologous stem cell transplant, or both (CheckMate 205 cohort C). The committee noted that CheckMate 205 cohort C included 8 people who had brentuximab vedotin retreatment. The primary outcome measure for CheckMate 205 and CA209-039 was objective response rate, defined as the proportion of patients with a best overall response of complete or partial response. Progression-free and overall survival were secondary outcome measures. The objective response rates and progression-free survival reported are as assessed by the independent radiologic review committee (see table 1). The investigator-assessed objective response rates and progression-free survival are also available for both trials, but the company plan to publish the results before the end of 2017 and therefore consider these to be academic in confidence, and so they cannot be reported here. 

**Table 1 Clinical data from CheckMate 205 and CA209-039** 

||**CheckMate 205**<br>**cohort B**|**CheckMate 205**<br>**cohort C**|**CA209-039**|
|---|---|---|---|
|**Number of patients**|80|98|15|
|**Median follow-up**|15.7 months|8.9 months|23.3 months|
|**Objective response rate**<br>**(95% CI)**|67.5% (54)<br>(57.2, 77.8)|73.0% (73)<br>(64.3, 81.7)|60% (9)|
|**Progression-free**<br>**survivala, median (95% CI)**|14.78 months<br>(11.33, NA)|11.17 months<br>(8.51, NA)|12.65 months<br>(5.91, NA)|
|**Overall survival at**<br>**6 monthsb (95% CI)**|96.1% (92.0,<br>100)|94.0% (89.1,<br>98.8)|NA|
|aAssessed by independent radiologic review committee<br>bMedian overall survival was not reached||||
|Abbreviations: CI, confidence interval; NA, not available||||



National Institute for Health and Care Excellence Page 5 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 6 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

The committee was concerned that the single-arm design of the trials, the small number of patients included and short follow-up meant that the results were potentially biased. The committee accepted that the results from the latest data cut-off for both trials (April 2016 for CheckMate 205 and August 2015 for CA209-039) showed that nivolumab was clinically effective based on response rates but agreed that there was a large degree of uncertainty in the clinical evidence. 

## **Indirect treatment comparison of nivolumab with standard of care** 

- 4.6 The committee was aware that there were no data providing direct comparative evidence for the clinical effectiveness of nivolumab compared with current practice (standard of care), because nivolumab for Hodgkin lymphoma had only been studied in single-arm trials. It noted that the company had done an indirect treatment comparison of nivolumab compared with standard of care by comparing the pooled outcomes from the nivolumab trials with standard of care. The outcomes for standard of care came from Cheah et al. (2016), a retrospective real-world study done in the USA. The study aimed to determine progression-free survival and overall survival in patients with Hodgkin lymphoma following disease relapse after brentuximab vedotin therapy; a secondary outcome was the efficacy of subsequent treatments. 

- 4.7 The committee considered whether the population and composition of treatments in the Cheah study reflected clinical practice in the UK. The committee noted that the study population partially matched the population of interest because around 70% of patients had previous autologous stem cell transplant and brentuximab vedotin. The committee noted a lack of detail on the precise combinations of chemotherapies given as standard of care in the study, and the inclusion of platinumbased therapies and ‘other alkylators’. It considered that the study may not reflect UK practice, particularly regarding subsequent rates of allogeneic stem cell transplant. The committee noted that in response to consultation, the company had explored UK standard-of-care data from 

- National Institute for Health and Care Excellence Page 6 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 7 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

the Haematological Malignancy Research Network and surveyed clinicians actively treating relapsed or refractory classical Hodgkin lymphoma in the UK. The committee considered that both the network data and the clinician survey somewhat supported the Cheah study as reflecting UK practice, but it recognised that the data were limited. The committee concluded that the Cheah study was the best available evidence for standard of care and considered it appropriate for its decision-making, but overall the clinical effectiveness of nivolumab compared with standard of care was highly uncertain because the comparator data may not fully represent UK clinical practice. 

4.8 The committee noted that the company’s indirect treatment comparison excluded results from patients who had investigational agents in the Cheah study. It heard from the company that including investigational agents could have confounded the results, because they increased survival benefit above that expected from treatments used in current practice, and that the investigational agents were likely to include PD-1 inhibitors, one of which is nivolumab itself. It also heard from the company that use of investigational agents tended to be restricted to large centres and that they could not therefore be considered current NHS practice. The committee acknowledged that the investigational agents used in the study could have included treatments not available in the UK, but noted that there was little detail about which specific therapies were defined as ‘investigational agents’. It heard from the evidence review group (ERG), who had contacted the authors of the study, that only ‘a couple’ of patients in the study had a PD-1 inhibitor, and so it considered that the overall population should be used for comparator data. The committee considered that selectively excluding potentially the fittest patients from the Cheah dataset could bias the results of the indirect treatment comparison more than including some treatments that may not be used in UK current practice. The committee concluded therefore that the overall 


National Institute for Health and Care Excellence 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 8 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

population of the Cheah study was the most appropriate dataset for standard of care to use in the indirect comparison. 

- 4.9 The committee was aware of the results of the company’s comparison of the pooled nivolumab data with the standard-of-care data from the overall population in the Cheah study for progression-free and overall survival (results are academic in confidence because the company plan to publish them before the end of 2017, and so they cannot be reported here). The committee noted that in the company’s original submission, the results of the indirect treatment comparison were obtained from an unadjusted or ‘naive’ comparison, but that it had also presented the results of a matched-adjusted indirect comparison as a scenario analysis. The committee was aware that a matched-adjusted indirect comparison took account of different distributions of prognostic factors and effect modifiers arising from any differences in baseline characteristics of patients in the trials. It concluded that a matched-adjusted indirect comparison would produce more robust results, but considered that the unadjusted comparison used in the company’s base-case analysis was similar and so was acceptable for its decision-making. Furthermore, the committee acknowledged that the company had used the results of the matchedadjusted comparison in its revised cost-effectiveness analysis submitted in response to consultation (see section 4.11). 

- 4.10 In conclusion, the committee acknowledged that nivolumab was clinicially effective, but noted that the available evidence was highly uncertain because the data were immature and from single-arm studies. The committee noted that the company’s indirect comparison with standard of care had compared pooled outcomes from the nivolumab trials with outcomes from the Cheah et al. study. The committee considered that Cheah et al. may not fully reflect UK current practice, but it acknowledged that the published evidence for comparator treatments used in the UK was limited. When considering the new evidence received from the company in response to consultation, it acknowledged that Cheah et al. was 

- National Institute for Health and Care Excellence Page 8 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 9 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

currently the best available evidence for standard of care and considered it appropriate for decision-making. The committee concluded that there was a large degree of uncertainty in the clinical evidence. 

## _**Cost effectiveness**_ 

- 4.11 The committee discussed the company’s economic model and modelling assumptions, which it received in response to consultation. Overall, it accepted the structure of the model as representing the treatment pathway for relapsed or refractory Hodgkin lymphoma and considered it appropriate for decision-making. The committee recognised that the company had presented a revised base-case analysis incorporating some of the committee’s preferred assumptions, and a number of scenario analyses that explored alternative sources of UK standard-of-care data and rates of subsequent allogeneic stem cell transplant: 

   - A revised base case incorporating the committee’s preferred assumptions relating to the method of indirect treatment comparison, costs and utilities, including costs and outcomes of subsequent allogeneic stem cell transplant (using rates taken from the nivolumab trials and the Cheah study). 

   - A revised base case incorporating the committee’s same preferred assumptions but excluding costs and outcomes of subsequent allogeneic stem cell transplant. 

   - A scenario analysis using the results from the clinician survey as standard-of-care data, and including costs and outcomes of subsequent allogeneic stem cell transplant (using rates taken from the survey). 

   - A scenario analysis using the results from the clinician survey as standard-of-care data (expected overall and progression-free survival) but excluding costs and outcomes of subsequent allogeneic stem cell transplant. 

National Institute for Health and Care Excellence 


Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 10 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

- A scenario analysis as per the revised base case but using rates of allogeneic stem cell transplant taken from the survey. 

The committee noted that in each of the new analyses that used standardof-care data from the Cheah study, the company had presented results from both the overall population and the subpopulation excluding patients who had investigational agents. It recalled that it preferred to use the overall population in its decision-making (see section 4.8) and therefore discounted results obtained from a comparison with the Cheah dataset that excluded patients who had investigational agents. It also noted that for the analyses that included costs and outcomes of subsequent allogeneic stem cell transplant, the company had presented results for 2 different sources of cost data. The committee recalled that it preferred to use the costs of allogeneic stem cell transplant obtained from Radford et al. (2016, see section 4.16) for its decision-making and therefore discounted results that did not use allogeneic stem cell transplant costs from the Radford paper. It considered the scenario analysis that used the results of the clinician survey as standard-of-care data, but concluded that because this evidence was limited and of low quality the Cheah data were a more reasonable representation of UK standard of care and should be used for its decision-making. The committee ultimately concluded that the company’s revised base case (including the costs and outcomes of subsequent allogeneic stem cell transplant) and the scenario analysis that replicated the revised base case but used rates of subsequent allogeneic stem cell transplant from the clinician survey, were the most relevant analyses for its decision-making. 

## **Modelling survival data** 

- 4.12 The committee noted that to model progression-free survival and overall survival, the company used the outcome data from the matched-adjusted indirect treatment comparison of nivolumab compared with the treatments in the Cheah study (see section 4.6). It was concerned that a large 

National Institute for Health and Care Excellence Page 10 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 11 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

proportion of the survival benefit of nivolumab compared with standard of care was based on extrapolation rather than on trial data, because the trial data were very immature. It was aware that the company had extrapolated beyond the trial follow-up for nivolumab by fitting a lognormal curve to progression-free survival data (investigator-assessed) and a Weibull curve to overall survival, and that for standard of care, exponential curves had been fitted to the progression-free and overall survival data from the Cheah study. The committee heard from the ERG that the extrapolation curves used were plausible, but it also considered the plausibility of the Gompertz curve fit to the nivolumab overall survival curve, which represented a more pessimistic assumption about long-term survival. The committee concluded that the Gompertz curve may not be clinically probable, but it was not at all clear that the outcomes would be as favourable as the company’s estimates. It concluded that all the parametric curves fitted to the data had a reasonable fit, but that they needed to be considered alongside survival modelling that included the long-term survival benefit of subsequent allogeneic stem cell transplant (see sections 4.13-4.15). 

## **Subsequent allogeneic stem cell transplant** 

- 4.13 The committee considered those patients who had a partial or complete response to nivolumab and went on to have a potentially curative allogeneic stem cell transplant, and how these patients may have affected overall survival in the model. The committee recalled that allogeneic stem cell transplant was potentially curative (see section 4.2), and that because nivolumab could be used as salvage therapy to enable allogeneic stem cell transplant, the modelling should include the projected long-term survival benefit of transplant. It was aware that the survival modelling used in the company’s original base-case analysis included both patients who had allogeneic stem cell transplant and those who had not, in both treatment arms, but that the company had only modelled the effect of subsequent allogeneic stem cell transplant on long-term survival in a 

National Institute for Health and Care Excellence Page 11 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 12 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

scenario analysis. The committee noted that in this analysis, the company had used non-UK data from the Cheah study to project long-term survival for patients who had subsequent allogeneic stem cell transplant. The committee understood that the survival data for subsequent allogeneic stem cell transplant had been extrapolated independently from the overall survival extrapolation used in the base case. It acknowledged that there would be some double counting because the overall survival extrapolation used in the base case included some patients who had allogeneic stem cell transplant, but agreed that it was an acceptable approach. The committee noted that in its revised cost-effectiveness analyses received in response to consultation, the company had censored overall survival data for patients having nivolumab who went on to have subsequent allogeneic stem cell transplant. It considered that censoring data in only 1 arm of a model introduced a more substantial bias than a small amount of double counting, and was not therefore methodologically appropriate. 

- 4.14 The committee noted that the company had used data from a UK study to model long-term survival after allogeneic stem cell transplant in its revised cost-effectiveness analyses. The committee considered the UK study of 13 patients with classical Hodgkin lymphoma having allogeneic stem cell transplant after 3 previous therapies (Laffety et al. 2017), and noted the small number of patients included in the study. It agreed that any modelling of long-term overall survival beyond the median trial follow-up of approximately 28 months would therefore be subject to significant uncertainty. It noted that the company had fitted a Gompertz parametric curve to the data from the Laffety study to extrapolate long-term overall survival but that this projected an infinite median survival for patients having allogeneic stem cell transplant (all-cause mortality excluded), which the committee considered implausible. It therefore considered that the lognormal and Weibull parametric curves used by the ERG in its new exploratory analysis were more clinically plausible because these curves did not predict infinite median survival. 

National Institute for Health and Care Excellence Page 12 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 13 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

4.15 The committee considered the proportion of patients who were likely to have an allogeneic stem cell transplant in the UK, if their disease had partially or completely responded to treatment after autologous stem cell transplant failed. The committee was aware that in its original scenario analyses, the company had obtained response-specific proportions of patients having subsequent allogeneic stem cell transplant (22.2% of those with complete response, 14.1% with partial response and 5.56% with stable disease) from a study in France (Perrot et al. 2016), and applied them to the response rates seen in the nivolumab and Cheah studies to generate transition probabilities for each treatment arm for use in the model. The committee understood that the ERG had assumed the proportion of patients having subsequent allogeneic stem cell transplant would be equivalent to the proportion who had subsequent allogeneic stem cell transplant in the nivolumab and Cheah studies, which was overall slightly higher than the proportions in the Perrot study. However, it heard from the clinical experts that UK rates of allogeneic stem cell transplant were much higher than those in the USA. The committee considered the results of the company’s clinician survey, which it received in response to consultation. It noted that the response-specific proportions of patients expected to have subsequent allogeneic stem cell transplant, as reported by clinicians working in the UK, were significantly higher than those used in the original analyses by both the company and ERG. However, because these rates were expected rather than actual, and the results of the survey included a wide range of expected transplant rates (which were very different from the actual rates reported in the nivolumab trials and Cheah study), the committee agreed that rates of allogeneic stem cell transplant in the UK remained uncertain. The committee was also aware from supportive evidence provided by the company in response to consultation that caution may be warranted about using allogeneic stem cell transplant following treatment with nivolumab or another PD-1 inhibitor, because of the potential for increased risk of complications from transplant linked to PD-1 inhibitors’ immunomodulatory 

National Institute for Health and Care Excellence Page 13 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 14 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

mechanism of action. The committee also heard that recent NHS referrals for allogeneic stem cell transplant were lower than those reported in the survey. The committee concluded that UK rates of allogeneic stem cell transplant may lie somewhere between the high rates reported in the results of the survey, and the considerably lower rates of actual transplants reported in the nivolumab trials and Cheah study. 

## **Treatment costs** 

- 4.16 The committee recognised that some patients in the nivolumab trials and the Cheah study had subsequent allogeneic stem cell transplant, and that because the survival benefit from allogeneic stem cell transplant was captured in the survival data for both arms of the model, the costs should also be included. It recognised that the company had used 2 different sources to calculate costs of allogeneic stem cell transplant: a weighted average of NHS reference costs and the costs included in the Radford et al. (2016) paper. The committee agreed that the Radford costs were more appropriate for its decision-making because they were consistent with the costs used for allogeneic stem cell transplant in guidelines currently in development. The committee also considered the costs of comparator treatments, and agreed with the ERG that the costs of mini-BEAM (carmustine, etoposide, cytarabine and melphalan) and DexaBEAM (dexamethasone, carmustine, etoposide, cytarabine and melphalan) should be excluded because they are not used in UK clinical practice, and their benefits would not significantly affect the progression-free or overall survival projections. 

## **Utility values** 

- 4.17 The committee was aware that CheckMate 205 (cohort B) collected health-related quality-of-life data for patients having nivolumab using the EQ-5D, which were then converted to utility data. It was also aware that utility data for patients having standard of care were taken from published literature (Swinburn et al. 2015). The committee recognised that 

National Institute for Health and Care Excellence Page 14 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 15 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

response-specific utility values from CheckMate 205 and Swinburn et al. diverged, and that the ERG had instead used the response-specific utility values from CheckMate 205 to estimate utility values for standard of care. The committee agreed that this was a more consistent approach but heard from the clinical experts that pre-progression quality of life was likely to be better with nivolumab than with existing treatments because of nivolumab’s potential to improve quality of life (see section 4.3). The committee recognised that the pre-progression utility values used by the ERG in its base case maintained a difference between the treatment arms and concluded that they were therefore more appropriate for its decisionmaking. 

- 4.18 The committee considered the post-progression utility values and noted the large difference in values between the nivolumab and standard of care treatment arms. It heard from the clinical experts that this large difference was not clinically plausible. The committee preferred the ERG’s assumption that post-progression utility values were the same across all treatments. 

- 4.19 The committee noted the ERG’s identification of an error in the company’s revised analyses received in response to consultation, whereby utility values for patients who discontinued treatment and transitioned to best supportive care reflected the company’s original base case and not the committee’s preferred assumptions about pre- and post-progression utilities (see sections 4.17 and 4.18). The committee was aware that the ERG had corrected this in its new exploratory analysis and agreed that this was appropriate. 

## **Results of cost-effectiveness analyses** 

- 4.20 The committee noted that the company had presented deterministic and probabilistic incremental cost-effectiveness ratios (ICERs) in its revised base-case analysis provided in response to consultation. For nivolumab compared with standard of care, including the confidential discount 

- National Institute for Health and Care Excellence Page 15 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 16 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

agreed for nivolumab, the company’s deterministic base-case ICER was £15,181 per quality-adjusted life year (QALY) gained and the probabilistic ICER was £17,826 per QALY gained. 

- 4.21 The committee was aware that the company’s revised base case included the committee’s preferred assumptions about using the overall population from the Cheah study for the standard-of-care data (see section 4.8), the method of indirect treatment comparison (see section 4.9), costs (see section 4.16) and utilities (see sections 4.17 to 4.18), and incorporated subsequent allogeneic stem cell transplant overall survival data (see section 4.13). However, the committee considered that this revised basecase analysis was flawed because of errors in the utility values for best supportive care (see section 4.19) and inappropriate censoring of nivolumab overall survival data (see section 4.13). The committee noted that when the ERG corrected these errors, the company’s revised basecase ICER increased to £26,664 per QALY gained. The committee also noted that the company’s revised base case had extrapolated long-term survival after allogeneic stem cell transplant using a Gompertz curve, which it had considered implausible (see section 4.14). It was aware that the ERG’s new exploratory analyses using the lognormal and Weibull curves increased the ICER to £30,366 and £31,031 per QALY gained respectively. However, the committee was also aware that these analyses included the high rates of allogeneic stem cell transplant from the clinician survey; because the committee considered that actual rates may be lower (see section 4.15), it concluded that the most plausible ICER was likely to be around £30,000 per QALY gained. But this ICER was associated with a large degree of uncertainty because of the immaturity of the nivolumab trial data, the lack of comparator data fully relevant to UK practice, and uncertain outcomes and rates of subsequent allogeneic stem cell transplant in the UK. 


National Institute for Health and Care Excellence 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 17 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

## _**Innovation**_ 

- 4.22 The committee considered whether nivolumab was an innovative treatment. It noted that nivolumab had been awarded ‘promising innovative medicine’ designation by the Medicines and Health products Regulatory Agency and was aware that before the marketing authorisation was granted, nivolumab was available for people in the NHS through the early access to medicines scheme. It also heard from the clinical and patient experts that nivolumab was an important new option for people with relapsed or refractory Hodgkin lymphoma. The committee agreed that nivolumab was innovative and promising, but that it had not been presented with any evidence of additional benefits that were not captured in the QALY measure. 

## _**End-of-life considerations**_ 

- 4.23 The committee considered the advice about life-extending treatments for people with a short life expectancy in NICE’s final Cancer Drugs Fund technology appraisal process and methods. The company made the case that nivolumab met the criteria for life-extending treatments for people with a short life expectancy (normally less than 24 months). The committee noted that the company’s modelling predicted a mean overall survival in the comparator treatment arm of more than 24 months. However, the committee also considered the data from the Haematological Malignancy Research Network provided by the company in response to consultation, which showed shorter survival and suggested that the Cheah study may have been optimistic. The committee acknowledged that nivolumab did not unequivocally meet the criterion for short life expectancy but that it was plausible that the criterion could apply. It therefore agreed that on balance, nivolumab met the criterion for short life expectancy, and that it would take this into account in its decision-making. 

- 4.24 The committee also discussed whether there was sufficient evidence to show that the treatment offers an extension to life of at least an additional 

- National Institute for Health and Care Excellence Page 17 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 18 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

3 months compared with current NHS treatment. The committee noted that the cost-effectiveness analysis from which the survival benefit of nivolumab could be inferred did not reflect the committee’s preferred analysis, and that because of the immaturity of the trial data and the lack of UK comparator data, all the estimates were uncertain. However, it concluded that based on the evidence presented, nivolumab met the criterion for extending life by at least an additional 3 months. 

## _**Committee’s conclusions**_ 

- 4.25 The committee was aware that an ICER of around £30,000 per QALY gained required certainty about the assumptions underpinning the ICER in order to be considered a cost-effective use of NHS resources (see section 6.3 of the NICE guide to the methods of technology appraisal). It considered that in this case, significant uncertainty remained because of the immaturity of the nivolumab trial data, the lack of comparator data fully relevant to UK practice, and uncertain outcomes and rates of subsequent allogeneic stem cell transplant in the UK. However, the committee also took into account the poor prognosis of people with relapsed or refractory Hodgkin lymphoma after autologous stem cell transplant and brentuximab vedotin, and the case for nivolumab meeting the end-of-life criteria (see sections 4.23 and 4.24), and concluded that there was sufficient justification for recommending nivolumab as a cost-effective use of NHS resources. 

- 4.26 The committee understood that there were some people with relapsed or refractory Hodgkin lymphoma who were at the last line of treatment after failure of allogeneic stem cell transplant. It agreed that, although the analysis presented did not include this group, there was no biological reason why they would not benefit from treatment with nivolumab, and so they should not be disadvantaged. The committee therefore concluded that the recommendation should also cover these people. 

National Institute for Health and Care Excellence Page 18 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 19 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

## _**Summary of appraisal committee’s key conclusions**_ 

|**TAXXX**|**Appraisal title: Nivolumab for treating**<br>**relapsed or refractory classical Hodgkin**<br>**lymphoma**|**Section**|
|---|---|---|
|**Key conclusion**|||
|Nivolumab is recommended, within its marketing authorisation, as an<br>option for treating relapsed or refractory classical Hodgkin lymphoma<br>in adults after autologous stem cell transplant and treatment with<br>brentuximab vedotin, when the company provides nivolumab with the<br>discount agreed in the patient access scheme.<br>Evidence for the clinical effectiveness of nivolumab was highly<br>uncertain because the data were immature and from single-arm<br>studies. In addition, the published evidence for comparator<br>treatments was limited, and the committee could not be certain that<br>the data used for standard of care fully represented UK current<br>practice.<br>The evidence review group’s (ERG’s) deterministic incremental cost-<br>effectiveness ratio (ICER) for nivolumab compared with standard of<br>care was more than £30,000 per quality-adjusted life year (QALY)<br>gained. When accounting for the high rates of subsequent allogeneic<br>stem cell transplant included in this analysis, the committee<br>considered that the most plausible ICER was around £30,000 per<br>QALY gained. Although significant uncertainty remained about the<br>assumptions underpinning the cost-effectiveness analysis, the<br>committee took into account the poor prognosis of people with<br>relapsed or refractory Hodgkin lymphoma after autologous stem cell<br>transplant and brentuximab vedotin, and the case for nivolumab<br>meeting the end-of-life criteria, and concluded that there was||1.1<br>4.10<br>4.21<br>4.25|



National Institute for Health and Care Excellence 


Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 20 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

|sufficient justification for recommending nivolumab as a cost-effective<br>use of NHS resources.|sufficient justification for recommending nivolumab as a cost-effective<br>use of NHS resources.||
|---|---|---|
|**Current practice**|||
|Clinical need of<br>patients, including<br>the availability of<br>alternative<br>treatments|The committee recognised that there is an<br>unmet clinical need for patients whose<br>disease does not achieve a partial or<br>complete response to salvage therapy such<br>as brentuximab vedotin, after autologous stem<br>cell transplant fails.|4.2|
|**The technology**|||
|Proposed benefits of<br>the technology<br>How innovative is<br>the technology in its<br>potential to make a<br>significant and<br>substantial impact<br>on health-related<br>benefits?|The committee heard from clinical experts that<br>treatment with nivolumab was generally well<br>tolerated because it has more manageable<br>side effects than existing treatments, and can<br>significantly improve patients’ quality of life.<br>Nivolumab had been awarded ‘promising<br>innovative medicine’ designation by the<br>Medicines and Health products Regulatory<br>Agency, and before the marketing<br>authorisation was granted, it was available for<br>people in the NHS through the early access to<br>medicines scheme. The committee agreed<br>that nivolumab was innovative and promising.|4.3<br>4.22|




National Institute for Health and Care Excellence Page 20 of 29 Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 21 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

|What is the position<br>of the treatment in<br>the pathway of care<br>for the condition?|The committee concluded that based on<br>current clinical practice, nivolumab would be<br>used in patients who have had autologous<br>stem cell transplant and brentuximab vedotin,<br>when brentuximab vedotin has been used as<br>salvage therapy to either enable an<br>autologous stem cell transplant or to enable<br>an allogeneic stem cell transplant following<br>failure of autologous stem cell transplant.<br>The committee understood there were some<br>people with relapsed or refractory Hodgkin<br>lymphoma who were at the last line of<br>treatment after failure of allogeneic stem cell<br>transplant, and considered that the<br>recommendation should also cover this group.|4.4<br>4.26|
|---|---|---|
|Adverse reactions|The most common adverse reactions with<br>nivolumab in clinical trials were diarrhoea,<br>nausea, fatigue, pyrexia and rash.|2|
|**Evidence for clinical effectiveness**|||
|Availability, nature<br>and quality of<br>evidence|The evidence came from 2 non-comparative<br>single-arm trials: CheckMate 205 (cohorts B<br>and C) and CA209-039, with a total of<br>193 patients.|4.5|




National Institute for Health and Care Excellence 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 22 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

|Relevance to<br>general clinical<br>practice in the NHS|The committee considered that data for the<br>comparator may not represent UK clinical<br>practice. However, when considering the new<br>evidence received from the company in<br>response to consultation, it concluded that the<br>Cheah study was the best available evidence<br>for standard of care.|4.7|
|---|---|---|
|Uncertainties<br>generated by the<br>evidence|The single-arm design of the trials, the small<br>number of patients included and the short<br>follow-up meant that there was a large degree<br>of uncertainty in the clinical evidence for<br>nivolumab.<br>There was a large degree of uncertainty about<br>the effectiveness of nivolumab compared with<br>standard of care because the data for the<br>comparator may not fully represent UK clinical<br>practice.|4.5<br>4.7|
|Are there any<br>clinically relevant<br>subgroups for which<br>there is evidence of<br>differential<br>effectiveness?|There are no clinically relevant subgroups for<br>which there is evidence of differential<br>effectiveness.|–|




National Institute for Health and Care Excellence 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 23 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

|Estimate of the size<br>of the clinical<br>effectiveness<br>including strength of<br>supporting evidence|There is substantial uncertainty about the<br>clinical effectiveness of nivolumab because of<br>the nature of the evidence for nivolumab (non-<br>comparative studies, small patient numbers<br>and short follow-up) and uncertainty about the<br>comparator’s relevance to UK practice.|4.5,<br>4.10|
|---|---|---|
|**Evidence for cost effectiveness**|||
|Availability and<br>nature of evidence|The company presented an economic model<br>that the committee accepted as representing<br>the treatment pathway for relapsed or<br>refractory Hodgkin lymphoma.|4.11|




National Institute for Health and Care Excellence Page 23 of 29 Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 24 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

|Uncertainties around<br>and plausibility of<br>assumptions and<br>inputs in the<br>economic model|The cost-effectiveness estimates were<br>uncertain because of the immaturity of the<br>nivolumab trial data (and long-term survival<br>modelling), the lack of comparator data fully<br>relevant to UK practice, and uncertain<br>outcomes and rates of subsequent allogeneic<br>stem cell transplant in the UK.<br>There was substantial uncertainty around the<br>long-term survival data because of the<br>immaturity of the nivolumab trial data.<br>There was significant uncertainty around the<br>long-term survival of people having allogeneic<br>stem cell transplant because of the small<br>number of patients in the relevant study, and<br>short follow-up.<br>Rates of allogeneic stem cell transplant in the<br>UK were uncertain.|4.21<br>4.12<br>4.14<br>4.15|
|---|---|---|




National Institute for Health and Care Excellence Page 24 of 29 Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 25 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

|Incorporation of<br>health-related<br>quality-of-life<br>benefits and utility<br>values<br>Have any potential<br>significant and<br>substantial health-<br>related benefits been<br>identified that were<br>not included in the<br>economic model,<br>and how have they<br>been considered?|The committee did not find the company’s<br>utility values plausible and it preferred the<br>ERG’s alternative assumptions around utility.<br>The committee was not presented with any<br>evidence of additional benefits of nivolumab<br>that were not captured in the QALY measure.|4.17,<br>4.18<br>4.22|
|---|---|---|
|What are the key<br>drivers of cost<br>effectiveness?|Overall survival with nivolumab.<br>Post-progression utility values.|4.12,<br>4.13,<br>4.18|




National Institute for Health and Care Excellence Page 25 of 29 Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 26 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

|Most likely cost-<br>effectiveness<br>estimate (given as<br>an ICER)|The committee noted that the company’s<br>revised base-case ICER, when corrected by<br>the ERG, was £26,664 per QALY gained. It<br>was aware that this incorporated an overall<br>survival extrapolation it deemed implausible.<br>The ERG’s exploratory analysis using more<br>plausible extrapolations increased the ICER to<br>over £30,000 per QALY gained. However, the<br>committee was aware that this analysis<br>included high rates of allogeneic stem cell<br>transplant, and because it considered that<br>actual rates may be lower, it concluded that<br>the most plausible ICER was likely to be<br>around £30,000 per QALY gained.|4.21|
|---|---|---|
|**Additional factors taken into account**|||
|Patient access<br>schemes (PPRS)|The company presented analyses that<br>included the confidential patient access<br>scheme for nivolumab.|–|
|End-of-life<br>considerations|Nivolumab did not unequivocally meet the<br>criterion for short life expectancy, but it was<br>plausible that the criterion could apply, and<br>therefore the committee agreed that on<br>balance, nivolumab met the criterion for short<br>life expectancy.<br>Nivolumab met the criterion for extending life<br>by at least an additional 3 months.|4.23,<br>4.24|




National Institute for Health and Care Excellence Page 26 of 29 Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 27 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

|Equalities<br>considerations and<br>social value<br>judgements|No equalities issues were identified that could<br>be addressed in the appraisal.<br>The committee agreed that it was important to<br>be clear that the recommendation would<br>include people for whom there were no more<br>treatment options (after autologous stem cell<br>transplant and brentuximab vedotin). It<br>therefore included a paragraph in the<br>guidance relating to people who were at the<br>last line of treatment, confirming that the<br>recommendation should also cover these<br>people.<br>The equality impact assessment provides<br>further information.|–<br>4.26|
|---|---|---|



## **5 Implementation** 

5.1 Section 7(6) of the National Institute for Health and Care Excellence (Constitution and Functions) and the Health and Social Care Information Centre (Functions) Regulations 2013 requires clinical commissioning groups, NHS England and, with respect to their public health functions, local authorities to comply with the recommendations in this appraisal within 3 months of its date of publication. Because nivolumab was made available in the NHS through the early access to medicines scheme, NHS England has indicated that this guidance will be implemented 30 days after final publication. 

5.2 The Welsh Assembly Minister for Health and Social Services has issued directions to the NHS in Wales on implementing NICE technology appraisal guidance. When a NICE technology appraisal recommends the use of a drug or treatment, or other technology, the NHS in Wales must National Institute for Health and Care Excellence Page 27 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 28 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

usually provide funding and resources for it within 3 months of the guidance being published. 

- 5.3 When NICE recommends a treatment ‘as an option’, the NHS must make sure it is available within the period set out in the paragraphs above. This means that, if a patient has classical Hodgkin lymphoma and the doctor responsible for their care thinks that nivolumab is the right treatment, it should be available for use, in line with NICE’s recommendations. 

- 5.4 The Department of Health and Bristol-Myers Squibb have agreed that nivolumab will be available to the NHS with a patient access scheme which makes it available with a discount. The size of the discount is commercial in confidence. It is the responsibility of the company to communicate details of the discount to the relevant NHS organisations. Any enquiries from NHS organisations about the patient access scheme should be directed to [NICE to add details at time of publication] 

## **6 Date for review of guidance** 

- 6.1 The guidance on this technology will be considered for review 3 years after publication of the guidance. The guidance executive will decide whether the technology should be reviewed based on information 

gathered by NICE, and in consultation with consultees and commentators. 

Professor Andrew Stevens 

Chair, appraisal committee C May 2017 

## **7 Appraisal committee members and NICE project team** 

## _**Appraisal committee members**_ 

The 4 technology appraisal committees are standing advisory committees of NICE. This topic was considered by committee C. 

National Institute for Health and Care Excellence Page 28 of 29 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 



<!-- page 29 -->

**CONFIDENTIAL UNTIL PUBLISHED** 

Committee members are asked to declare any interests in the technology to be appraised. If it is considered there is a conflict of interest, the member is excluded from participating further in that appraisal. 

The minutes of each appraisal committee meeting, which include the names of the members who attended and their declarations of interests, are posted on the NICE website. 

## _**NICE project team**_ 

Each technology appraisal is assigned to a team consisting of 1 or more health technology analysts (who act as technical leads for the appraisal), a technical adviser and a project manager. 

## **Anna Brett** 

Technical Lead 

## **Nicola Hay** 

Technical Adviser 

## **Stephanie Yates** 

Project Manager 

ISBN: [to be added at publication] 


National Institute for Health and Care Excellence 

Final appraisal determination – nivolumab for treating relapsed or refractory classical Hodgkin lymphoma Issue date: May 2017 

