<!-- page 1 -->

**CONFIDENTIAL** 

# **NATIONAL INSTITUTE FOR HEALTH AND CLINICAL EXCELLENCE** 

# **Final appraisal determination** 

# **Rituximab for the first-line maintenance treatment of follicular non-Hodgkin’s lymphoma** 

This guidance was developed using the single technology appraisal (STA) process. 

## **1 Guidance** 

1.1 Rituximab maintenance therapy is recommended as an option for the  treatment of people with follicular non-Hodgkin’s lymphoma that has responded to first-line induction therapy with rituximab in combination with chemotherapy. 

## **2 The technology** 

2.1 Rituximab (MabThera, Roche Products) is a chimeric (mouse/human) genetically engineered monoclonal antibody. It targets the CD20 surface antigen of mature B-cell lymphocytes. Rituximab has a marketing authorisation for the ‘treatment of follicular lymphoma patients responding to induction therapy’. Other licenced indications for rituximab in non-Hodgkin’s lymphoma include ‘the treatment of previously untreated patients with stage III-IV follicular lymphoma in combination with chemotherapy’; ‘the treatment of patients with stage III-IV follicular lymphoma who are chemoresistant or are in their second or subsequent relapse after chemotherapy’; and ‘the treatment of patients with CD20 positive diffuse large B cell non-Hodgkin's lymphoma in combination with 

National Institute for Health and Clinical Excellence Page 1 of 42 Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 2 -->

**CONFIDENTIAL** 

CHOP (cyclophosphamide, doxorubicin, vincristine, prednisolone) chemotherapy’. 

2.2 Allergic and skin reactions are the most common adverse effects of rituximab infusion. Reactions during infusion can include bronchospasm and hypotension, which can be severe or lifethreatening. Severe reactions occur more commonly in people with a high tumour burden, and the incidence and severity of infusion reactions decrease with successive infusions. Rituximab treatment can also be associated with blood and bone-marrow toxicity, characterised by neutropenia and leucopenia, which can lead to infections. In addition, treatment with rituximab may cause flu-like symptoms, and has been associated with progressive multifocal leukoencephalopathy. For full details of side effects and contraindications, see the summary of product characteristics. 

2.3 For people with previously untreated follicular lymphoma that has responded to first-line induction treatment, the recommended dose of rituximab as maintenance treatment is 375 mg/m² body surface area, administered by intravenous infusion once every 2 months. Treatment should start 2 months after the last dose of first-line induction therapy and continue until the disease progresses, or for a maximum period of 2 years. The cost of one 100-mg vial is £174.63, and one 500-mg vial is £873.15 (excluding VAT; ‘British national formulary’ [BNF] edition 61). The manufacturer estimates that for a person with an average body surface area of 1.8 m², the average cost of rituximab maintenance treatment for 2 years is £14,669 (excluding VAT). Costs may vary in different settings because of negotiated procurement discounts. 

National Institute for Health and Clinical Excellence 


Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 3 -->

**CONFIDENTIAL** 

## **3 The manufacturer’s submission** 

The Appraisal Committee (appendix A) considered evidence submitted by the manufacturer of rituximab and a review of this submission by the Evidence Review Group (ERG; appendix B). 

## 3.1 

The manufacturer presented information addressing the decision problem; that is, whether rituximab maintenance treatment is a clinically effective and cost-effective use of NHS resources, compared with standard management without rituximab for people with follicular lymphoma that has responded to first-line induction chemotherapy combined with rituximab. The outcomes defining effectiveness included progression-free survival, overall survival, response rates, adverse effects of treatment and health-related quality of life. 

## 3.2 

The manufacturer undertook a systematic literature review and identified only one trial, the Primary Rituximab and Maintenance (PRIMA) trial, that met its inclusion criteria. The manufacturer presented evidence analysed after a median follow-up of 25 months (at the close of the PRIMA trial), but also provided data from two post-study observational periods with median follow-up periods of 36 and 38 months. In the absence of long-term data from the PRIMA trial, the manufacturer used data from the European Organisation for Research and Treatment of Cancer (EORTC) 20981 study to model the expected longer term outcomes that may have been experienced by participants in the PRIMA trial, had the trial gone on longer. The patient population in the EORTC 20981 study (see section 3.4), however, was different from that of the PRIMA trial. 

3.3 The PRIMA trial was a phase III, open-label, multicentre, randomised trial with two treatment phases. The trial included 

National Institute for Health and Clinical Excellence Page 3 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 4 -->

**CONFIDENTIAL** 

1193 people with previously untreated advanced follicular lymphoma with an Eastern Cooperative Oncology Group (ECOG) status of 0 or 1 and a median age of 57 years. In the first phase (induction phase or first-line treatment), participants had one of three different regimens, all of which included rituximab: R-CVP (rituximab with cyclophosphamide, vincristine and prednisolone [n = 268]), R-CHOP (rituximab with cyclophosphamide, doxorubicin, vincristine, and prednisolone [n = 881]) or R-FCM (rituximab with fludarabine, cyclophosphamide  and mitoxantrone [n = 44]). People whose disease had either a partial or complete response to first-line treatment (n = 1019) entered the second phase of the trial, and were randomised to  receive either rituximab maintenance treatment (n = 506) or no treatment (that is, observation; n = 513). People in the maintenance arm received 375 mg/m² rituximab intravenously: one dose every 8 weeks for 2 years, for a total of 12 doses or until disease progression, whichever occurred first. The trial was designed initially to estimate event-free survival as the primary outcome. However, during the course of the trial, the manufacturer amended the protocol in line with recommendations from regulatory authorities and changed the primary outcome to progression-free survival. Length of follow-up was increased from 5 to 7 years, and the study population was increased from 900 to 1200 participants. Secondary clinical outcomes included overall survival, event-free survival, time to next anti-lymphoma treatment, overall response rate at the end of the maintenance observation phase, the proportion of people with histological transformation at first progression, quality of life and safety. Quality-of-life data were collected in the trial using the Functional Assessment of Cancer Therapy – General (FACT-G) questionnaire and the EORTC Quality of Life Questionnaire – Core 30 (EORTC QLQ-C30). After a median follow-up of 25 months, a 

National Institute for Health and Clinical Excellence Page 4 of 42 Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 5 -->

**CONFIDENTIAL** 

Data and Safety Monitoring Committee judged that the trial had met its primary objective at the pre-specified interim analysis and recommended closure of the trial. However, investigators continued to follow patients during an observational post-study period to collect longer term data. 

3.4 The EORTC 20981 study was a phase III, open-label randomised trial that included people with relapsed or resistant follicular non-Hodgkin’s lymphoma (n = 465) who had not previously been treated with CHOP (cyclophosphamide, doxorubicin, vincristine, and prednisolone) or R-CHOP. Instead, patients had been treated with at least 2 months of single-agent therapy (such as chlorambucil) and/or at least two consecutive cycles of combination chemotherapy (such as CVP [cyclophosphamide, vincristine and prednisolone]) or purine analogues. Therefore, these patients differed from those in the decision problem in that their disease had progressed after first-line therapy, and they had not been previously treated with R-CHOP, R-CVP or R-FCM as in the PRIMA trial. Participants were randomised to treatment with R-CHOP or CHOP alone after enrolment. People whose disease responded to second-line therapy (n = 334) were then randomised to either second-line maintenance treatment with 375 mg/m² rituximab (one dose every 3 months for 2 years or until relapse) or observation until relapse. 

3.5 The results of the PRIMA trial showed that after 25 months’ median follow-up, the risk of disease progression was halved in the rituximab maintenance arm compared with the observation arm (hazard ratio [HR] 0.50; 95% confidence interval [CI] 0.39 to 0.64; p < 0.0001) as assessed by the study investigators. This result was based on 18.4% (93 of 505) of people in the rituximab maintenance arm and 33.9% (174 of 513) of people in the observation arm 

National Institute for Health and Clinical Excellence Page 5 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 6 -->

**CONFIDENTIAL** 

having experienced an event (disease progression, relapse or death). The estimate of the hazard ratio associated with treatment was slightly higher when assessed by an independent review committee. After a median follow-up of 36 months, progression-free survival was statistically significantly improved in people randomised  to the rituximab maintenance arm (PFS 74.9%; 95% CI 70.9 to 78.9) compared with those randomised to the observation arm (PFS 57.6%; 95% CI 53.2 to 62.0). The risk of disease progression was significantly reduced for people in the rituximab maintenance arm (HR 0.55; 95% CI 0.44 to 0.68; p < 0.0001). However, too few patients randomised to the rituximab maintenance arm had progressed during the study period to estimate the median time to progression. For patients randomised to observation, the median time to progression was estimated to be 48.3 months (95% CI 38.0 to not reached). After 36 and 38 months’ median follow-up, a statistically significant difference in overall survival could not be established between the two arms because of the low number of deaths that had occurred. 

3.6 During first-line induction therapy, most people in the PRIMA trial experienced an adverse event and 25% experienced a serious adverse event, consistent with the known safety profiles of these induction regimens. After the first-line maintenance phase of the trial, significantly more grade 3 or 4 adverse events occurred in people in the rituximab maintenance arm (24%) compared with people in theobservation arm (17%; risk ratio 1.46; 95% CI: 1.14 to 1.87; p=0.0026). 

- 3.7 In the EORTC 20981 study, second-line maintenance treatment with rituximab significantly improved progression-free survival compared with observation (median 3.7 years versus 1.3 years). Five-year overall survival was not significantly different between the 

National Institute for Health and Clinical Excellence Page 6 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 7 -->

**CONFIDENTIAL** 

arms (74% in the rituximab maintenance arm and 64% in the observation arm). Second-line maintenance treatment with rituximab was associated with statistically significant increases in grade 3 and 4 infections compared with observation. 

3.8 The manufacturer also provided a summary of other studies, as supporting evidence, of the efficacy and safety of rituximab maintenance in people with previously untreated or relapsed or refractory follicular lymphoma. In the ECOG 1496 study, rituximab maintenance led to longer progression-free survival compared with observation (HR 0.4; p<0.0001) in people who had previously received CVP as induction therapy. Interim data from another study (SAKK 35/98), which is still ongoing to compare a short course of rituximab maintenance (375 mg/m² every two months for a total of four doses) and prolonged rituximab maintenance (375mg/m² every two months for a maximum of five years) with observation, demonstrated a longer event-free survival after prolonged rituximab maintenance compared with observation in people with either previously treated or previously untreated follicular lymphoma after induction with rituximab montherapy. Preliminary safety results from this study also indicate that prolongation of maintenance therapy beyond two years does not lead to an obvious increase in toxicity. 

3.9 The manufacturer produced a Markov economic model to estimate all costs and benefits over a lifetime resulting from the treatment of follicular lymphoma with rituximab compared with observation after first-line induction with different regimens of rituximab and chemotherapy (R-CHOP, R-CVP or R-FCM). Although listed as a comparator in the decision problem for this appraisal, ibritumomab tiuxetan was considered by the manufacturer to not be an appropriate comparator for inclusion in the economic model 

National Institute for Health and Clinical Excellence Page 7 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 8 -->

**CONFIDENTIAL** 

because of limited evidence available to support its benefits, and because data for local use suggested that it is seldom prescribed in the UK. The model had four distinct health states: progression-free survival while in the first-line maintenance phase (PF1), progression-free survival after receiving second-line induction treatment with rituximab in combination with chemotherapy (PF2), progressive disease (PD) and death. The manufacturer assumed that all people enter the economic model in the PF1 health state after successfully completing induction treatment (that is, the start of the model reflected the second phase of the PRIMA trial). The model had a cycle of 1 month and a time horizon of 25 years. A half cycle correction was applied to the model. 

3.10 Data from the PRIMA trial (after 38 months’ median follow-up) and the EORTC 20981 study were used by the manufacturer to estimate the transition probabilities between the health states in the economic model. To estimate median progression-free survival, which could not be estimated from the PRIMA trial directly, the manufacturer used the Gompertz function to extrapolate progression-free survival data beyond the end of the PRIMA trial. The manufacturer considered that this function provided a better fit than alternative functions. Based on the results from the PRIMA trial, the EORTC 20981 study and expert opinion, the manufacturer assumed that people in the PF1 health state retain a clinical benefit from rituximab maintenance treatment for 6 years; that is, 4 years beyond the end of treatment in the PRIMA trial. After this time, the risk of disease progression for people in the PF1 health state was assumed to be equal in both the rituximab maintenance and 

observation arms of the model (that is, both groups progress at the same rate after 6 years). Data from the EORTC 20981 study were used to derive the long-term outcomes, including death, for people 

National Institute for Health and Clinical Excellence Page 8 of 42 Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 9 -->

**CONFIDENTIAL** 

according to the treatment they received after progressing from the PF1 health state. 

- 3.11 In the PRIMA trial, participants did not routinely complete EQ-5D questionnaires. Instead, health-related quality-of-life data were collected in the PRIMA trial using the FACT-G and EORTC QLQC30 questionnaires developed to assess the quality of life of people with cancer. Overall, no differences in health-related quality-of-life data were observed between the rituximab maintenance and observation arms. 

- 3.12 The manufacturer conducted a systematic literature review to identify studies addressing quality of life, but it considered that only one study (Pettengel et al. 2008) met the inclusion criteria. In this study, 215 adults with follicular lymphoma and an ECOG score of 0−2 completed EQ-5D questionnaires during outpatient appointments across eight sites in the UK. Patients were placed in one of five categories according to the stage of their disease: ‘active disease – newly diagnosed’, ‘active disease – relapsed’, ‘partial response’, ‘complete response to therapy (or remission)’ and ‘disease free (no detectable disease)’. Mean utility values from this study were 0.88 (from ‘disease free’ category), 0.79 (from ‘complete response to therapy’ category) and 0.62 (from ‘active disease – relapsed’ category). These utility values were assigned to the PF1, PF2 and PD health states respectively in the manufacturer’s economic model. The economic model did not include values for the disutility associated with grade 3 and 4 adverse events, or with receiving chemotherapy. 

- 3.13 The manufacturer included costs associated with drug acquisition and administration, supportive care, management of adverse events and monitoring for each health state in the economic model. The primary sources of these costs were the BNF (edition 56 was 

- National Institute for Health and Clinical Excellence Page 9 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 10 -->

**CONFIDENTIAL** 

used by the manufacturer, and edition 59 by the ERG; however, the costs were the same in both editions), the NHS Reference Cost Schedule 2008/09 and the Personal Social Services Research Unit 2009 (unit costs of health and social care). The manufacturer assumed that grade 3 and 4 adverse events incur equivalent costs, as estimated from the PRIMA and EORTC 20981 studies. Costs and benefits were discounted at 3.5% per year. 

## 3.14 

In the base-case analysis from the manufacturer’s original submission, which assumed that the clinical benefit of rituximab is sustained over 6 years, the incremental cost-effectiveness ratio (ICER) of rituximab maintenance treatment compared with observation was £15,978 per quality-adjusted life year (QALY) gained (incremental costs = £18,681; incremental QALYs = 1.169). Sensitivity analyses explored the impact of varying costs of adverse events (±50%), monthly supportive care (±50%), and administering rituximab (for example, nursing time; upper = £267, lower = £176). In sensitivity analyses, the manufacturer also tested the impact of varying the time horizon (20 years and 30 years), using other types of parametric functions to extrapolate progression-free survival data from the PRIMA trial, and assuming that people who progress from the PF1 health state die (probability of death was 100%, extreme scenario) rather than experience disease progression. From the analyses, the manufacturer concluded that the model was not sensitive to assumptions around the type of parametric 

extrapolation fitted to the PRIMA data, around costs of supportive care and administration, or around the time horizon. The model was sensitive to assumptions regarding the duration of treatment effect; when the manufacturer assumed that the effect of treatment stopped after 47 months (instead of after 72 months as in the base case), the ICER increased to £21,151 per QALY gained. When the manufacturer assumed that all people died after progressing from National Institute for Health and Clinical Excellence Page 10 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 11 -->

**CONFIDENTIAL** 

the PF1 health state (extreme scenario), the ICER decreased to £13,901 per QALY gained. 

3.15 The manufacturer conducted probabilistic sensitivity analyses of all major parameters in the model except age, weight and height. The mean ICER from this analysis was £15,770 per QALY gained, and the manufacturer estimated that the probability of rituximab maintenance treatment being cost effective at £20,000 per QALY gained or less was 84.2%, and at £30,000 per QALY gained or less was 99.7%, compared with observation. The manufacturer concluded that these results demonstrated that the ICER was robust even under a wide range of variation in the model parameters. 

3.16 The ERG considered that the PRIMA trial was well designed and, although it was an open-label trial, the results of progression-free survival could be considered robust because the trial used a blinded independent review committee. In the ERG’s view, the rituximab chemotherapy regimens used in the induction phase of the PRIMA trial (that is, R-CHOP, R-CVP and R-FCM) were appropriate and in line with the rituximab chemotherapy regimens used in UK clinical practice. Overall, the ERG considered the results of the PRIMA trial to be generalisable to the UK setting, and that the manufacturer’s decision not to include ibritumomab tiuxetan as a comparator in the economic analysis was justified. 

- 3.17 The ERG was concerned that follow-up data were not available beyond 4 years and that the manufacturer could not estimate the median time to progression or to death by treatment group. The ERG cautioned that the data were immature (few events), which might have led the results to overestimate the clinical benefits of rituximab maintenance treatment. The ERG noted a metaregression analysis (Bassler et al. 2010), which found large 

- National Institute for Health and Clinical Excellence Page 11 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 12 -->

## **CONFIDENTIAL** 

differences in the size of treatment effects between trials that were stopped early (regardless of the reason) and similar trials that ran for their originally specified time period. Using data from this study, the ERG adjusted the progression-free survival hazard ratio from the PRIMA trial to account for early reporting bias and noted that the hazard ratio increased by 30.7% from 0.55 (manufacturer’s base case) to 0.719 (95% CI 0.575 to 0.889). The ERG suggested that sensitivity analyses that include the adjusted progression-free survival hazard ratio should be considered by the Committee. 

3.18 The ERG noted that treatments administered after participants’ disease had progressed may have affected the rate of overall survival in the PRIMA trial. The ERG stated that the postprogression treatments in the manufacturer’s submission were in line with those used in UK clinical practice. However, from the data provided, the ERG was unsure whether the time at which these treatments were offered in the trial reflected the time that they would be offered in routine practice. 

3.19 Although the ERG identified a number of problems with the structure and implementation of the manufacturer’s model, the ERG did not expect these problems to have a major impact on the cost-effectiveness results. The ERG noted that the manufacturer did not model the disutilities associated with grade 3 and 4 adverse events. The ERG stated that this omission would favour the rituximab maintenance arm because people treated with rituxmab experience more adverse events than those not treated with rituximab (observation). The ERG was concerned that the manufacturer may have underestimated the costs of adverse events experienced in the PF2 health state because most of the people in the PRIMA trial had not progressed beyond the first-line 

National Institute for Health and Clinical Excellence Page 12 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 13 -->

**CONFIDENTIAL** 

maintenance or observation phase at the time of data analysis (up to 38 months). 

3.20 The ERG noted the low proportion of patients censored (less than 3%) during the first 800 days of the PRIMA trial, and that this proportion increased greatly (70% for rituximab maintenance and 50% for observation) by 1600 days. Consequently, the ERG believed that the Kaplan–Meier estimate of progression-free survival becomes uncertain after 800 days. The ERG had concerns about the use of long-term modelling to inform the duration of treatment benefit estimated in the economic model. The ERG noted that the manufacturer used the Gompertz parametric function in their original analyses, which generated the highest overall estimate compared with other algorithms (such as an exponential function), to model progression-free survival. 

- 3.21 The ERG was concerned about the manufacturer’s use of data from the EORTC 20981 study to inform the economic model. The ERG noted that the participants in this study  received different induction treatments to those in the PRIMA study (the EORTC 20981 study included people if their disease had relapsed after two previous non-anthracycline-containing chemotherapy regimens) and that only half of the patients in the EORTC 20981 study received induction treatment with a rituximab-containing regimen. Therefore, the ERG questioned whether the manufacturer could reliably use the outcomes from the EORTC 20981 study to predict future outcomes for participants in the PRIMA trial. 

- 3.22 The ERG noted that, in the base case, the manufacturer assumed rituximab maintenance treatment had a clinical benefit for 6 years (that is, the hazard ratio from the PRIMA trial was applied for 6 years). In addition, the ERG noted that a large proportion of the gain in progression-free survival in the model arises beyond 

- National Institute for Health and Clinical Excellence Page 13 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 14 -->

**CONFIDENTIAL** 

4 years. Therefore, the ERG cautioned that if the gain in progression-free survival progressively declines, the ICER could substantially increase depending on the time period over which one assumes a difference between the treatment arms (that is, the time until the progression-free survival curves for each arm converge). The ERG also noted that the ICERs in the manufacturer’s analyses were sensitive to the age at which a patient is assumed to start treatment and suggested that the manufacturer should have adjusted this variable in its sensitivity analyses. 

3.23 The ERG noted that the manufacturer’s model projects future benefits associated with the increased time that a person’s disease remains progression free. The manufacturer’s base-case modelling estimated that the mean time before a person’s disease progresses is 8.64 years for the observation arm and 10.65 years for people who receive rituximab maintenance therapy; a gain of 2.01 years. The ERG noted that the manufacturer’s analysis assumed that almost all of this gain in progression-free survival occurs in the PF1 health state. This implied that the majority (89.2%) of the gains in progression-free survival achieved directly by extending the firstline induction response translated into overall survival gains. The ERG cautioned that this should represent the ‘best possible’ scenario and would require strong supportive evidence from clinical trials before it could be accepted. The ERG explored how different conversion rates of  progression-free survival gain to overall survival gain affect the estimated ICER, and predicted that at least 50% of progression-free survival gain would need to be converted into overall survival gain to achieve an ICER below £30,000 per QALY gained. The ERG further noted that if a function other than the Gompertz parametric function were used to extrapolate and convert progression-free survival into overall survival, then the 

National Institute for Health and Clinical Excellence Page 14 of 42 Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 15 -->

**CONFIDENTIAL** 

conversion rate would need to be even higher for the ICER to remain below £30,000 per QALY gained. 

- 3.24 The ERG noted that the manufacturer’s model included utility values of 0.88 and 0.79 for the PF1 and PF2 health states respectively. The ERG considered that the same utility value should be used in both health states, because people in both states are in remission or have a full response. The ERG conducted a sensitivity analysis assuming that both health states have a utility value of 0.79, and noted that the QALY gain associated with maintenance treatment with rituximab dropped by more than 10% and the ICER increased by 11%. 

- 3.25 In response to comments on the first and second appraisal consultation documents, the manufacturer provided revised costeffectiveness analyses that modelled the effect on the ICER of different assumptions including progression-free survival translating into overall survival in a range from 50% to 100%; the clinical benefit from rituximab lasting for 28 months, 36 months or 48 months; and the mean age of a patient at induction being 62.5 years. Although the Committee requested analysis of potential utility gains associated with delaying the need for chemotherapy after relapse, the manufacturer was unable to incorporate these because of limitations in the structure of the model. 

- 3.26 In response to the ERG’s concern during the second Appraisal Committee meeting that the duration of clinical benefit (that is, the period during which rituximab is better than, rather than equal to, observation) may last only 28 months (based on the cumulative hazard plots from the PRIMA trial), the manufacturer provided an alternative method to model the rituximab treatment effect stopping at 28 months. This entailed using an exponential function (instead of the Gompertz function from the original submission) to 

- National Institute for Health and Clinical Excellence Page 15 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 16 -->

**CONFIDENTIAL** 

extrapolate the hazard ratio observed in the rituximab arm for 28 months to the observation arm (HR 0.48; 95% CI 0.377 to 0.613). From 28 months onwards a HR of 1.00 was then applied to both arms in the model. The manufacturer considered that this alternative modelling approach was a more accurate method for this particular sensitivity analysis, but emphasised that it represented the worst-case clinical scenario and was not in line with available clinical evidence or expert opinion and therefore should be treated with caution. 

3.27 The manufacturer noted that the cost of first-line rituximab induction therapy was included incorrectly in the original economic model and that once this had been amended, and the age at the start of treatment adjusted to 62.5 years, the revised base-case ICER (which assumed that rituximab maintenance treatment had a clinical benefit for 72 months) decreased to £15,404 per QALY gained (incremental costs = £16,918; incremental QALYs = 1.10). The manufacturer considered that the assumptions in its revised base-case analysis allowed for an undiscounted conversion rate of 89.2% from progression-free survival to overall survival. The manufacturer explained that the conversion rate is not a specific input in the model, and therefore, to analyse the effect of assuming different conversion rates, other parameters in the model had to be altered. When a conversion rate of 70%, 80% or 90% was assumed in the manufacturer’s senstivity analysis, the ICERs ranged from £17,349 to £18,615 per QALY gained when the duration of clinical benefit from rituximab maintenance was 28 months (using an exponential function); £25,038 to £27,397 per QALY gained when the duration of clinical benefit was 36 months and £21,507 to £23,355 per QALY gained when the duration of clinical benefit was 48 months (both using the Gompertz function). The manufacturer questioned the plausibility of these revised 

National Institute for Health and Clinical Excellence Page 16 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 17 -->

**CONFIDENTIAL** 

analyses because they were based on assumptions that the manufacturer considered worse than those observed in clinical practice and in the clinical trials. 

3.28 The ERG provided an additional critique of the sensitivity analyses conducted by the manufacturer in response to the two appraisal consultation documents (sections 3.25 to 3.27). It noted that the manufacturer had not corrected the model for certain errors that the ERG had previously identified. After revising these errors, the ERG noted that the new base-case ICER increased slightly to £17,136 per QALY gained. The ERG considered that the structure of the manufacturer’s model did not allow sufficient flexibility to enable the sensitivity analyses, which the Committee had requested from the manufacturer, to be robustly undertaken. 

3.29 The ERG conducted its own exploratory sensitivity analyses of the clinical scenarios requested by the Committee; that is, assuming rituximab maintenance has a clinical benefit of 28 months, 36 months or 48 months and a conversion rate of progression-free survival to overall survival of 70%, 80% and 90%. The ERG considered that it was not possible to adjust the parameters in the manufacturer’s model to assess the impact of different assumptions on the proportion of progression-free survival gain which may be expected to result in overall survival gain. Instead, the ERG adjusted the outcomes and costs generated by the model to reflect long-term outcome scenarios, and calculate the post-progression survival rate per patient. This estimate was subsequently discounted using a simple linear regression equation and used to revise the estimated overall discounted cost per patient in the model. 

3.30 After adjusting the mean age of the population in the model at the start of treatment to 62.5 years, and using a hazard ratio for National Institute for Health and Clinical Excellence Page 17 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 18 -->

**CONFIDENTIAL** 

progression-free survival of 0.55 (in line with the manufacturer’s base case), the ICERs in the ERG’s analyses ranged from £24,595 to £27,558 per QALY gained, if the duration of clinical benefit was 48 months; £31,067 to £35,327 per QALY gained, if the duration of clinical benefit was 36 months; and £38,234 to £43,934 per QALY gained, if the duration of clinical benefit was assumed to be only 28 months. The ERG also presented sensitivity analyses using its revised hazard ratio of 0.719 (adjusted for early reporting bias) and noted that the ICERs ranged from £39,319 to £66,870 per QALY gained. The ERG also explored the effect on the ICER of adjusting the hazard ratios for progression free survival for specific patient ages to reflect a reduction in clinical effect  with the increase of age, however this did not change the ICER substantively. 

3.31 Full details of all the evidence are in the manufacturer’s submission and the ERG report; these and the responses to consultation on the first and second appraisal consultation documents (ACD) from consultees and commentators are available from www.nice.org.uk/guidance/TAXXX 

## **4 Consideration of the evidence** 

4.1 The Appraisal Committee reviewed the data available on the clinical and cost effectiveness of rituximab maintenance treatment for people with follicular non-Hodgkin’s lymphoma that has responded to first-line induction therapy with rituximab in combination with chemotherapy, having considered evidence on the nature of follicular non-Hodgkin’s lymphoma and the value placed on the benefits of rituximab by people with the condition, those who represent them, and clinical specialists. It also took into account the effective use of NHS resources and comments received during consultation on both appraisal consultation documents. 

National Institute for Health and Clinical Excellence Page 18 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 19 -->

**CONFIDENTIAL** 

4.2 The Committee noted that the decision problem for this topic defines the population as ‘adults with advanced follicular lymphoma that has responded to first-line chemotherapy’, and that the population considered by the manufacturer was ‘adults with advanced follicular lymphoma that has responded to first-line treatment with rituximab plus chemotherapy’. The manufacturer indicated that the population in its analysis was restricted to those who had high tumour burden (indicative of advanced disease) and who had received first-line treatment with rituximab plus chemotherapy because this reflected standard first-line treatment used in UK clinical practice. The Committee noted that the manufacturer assumed that rituximab maintenance would be given for a maximum period of 2 years or until disease progression, in line with the marketing authorisation. The Committee also noted that the manufacturer had not identified any clinical evidence to support the use of ibritumomab tiuxetan as a maintenance treatment for people who have received first-line treatment with rituximab in combination with chemotherapy, and that ibritumomab tiuxetan is infrequently used in the UK. For these reasons the manufacturer excluded ibritumomab tiuxetan from the list of the comparators originally specified in the decision problem. The Committee accepted the manufacturer’s justifications for the changes to the decision problem. 

4.3 The Committee was aware that rituximab in combination with chemotherapy is currently the standard of care in the UK for first-line induction therapy of people with follicular non-Hodgkin’s lymphoma. The Committee noted that ‘Rituximab for the treatment of follicular lymphoma’ (NICE technology appraisal guidance 110) recommends R-CVP for the first-line induction treatment of 

advanced follicular non-Hodgkin’s lymphoma, but that other rituxmab-containing chemotherapeutic regimens (such as R-CHOP 

National Institute for Health and Clinical Excellence Page 19 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 20 -->

**CONFIDENTIAL** 

and R-FCM) are routinely used, but have not yet been appraised by NICE. The Committee noted that ‘watchful waiting’ (observation) is the current standard treatment for people with advanced follicular non-Hodgkin’s lymphoma that has responded to first-line induction therapy. The Committee heard from the clinical specialists that current management aims to prolong remission, delay progression (and therefore delay the use of chemotherapy) and improve quality of life. The clinical specialists expressed the view that rituximab maintenance treatment after first-line induction therapy constituted optimal management for non-Hodgkin’s lymphoma because it can offer people longer periods of remission and better quality of life. The Committee was also aware that rituximab is used in combination with chemotherapy for people whose disease has relapsed or did not respond to treatment, or as monotherapy for maintenance treatment after successful second-line treatment of recurrent or refractory disease (in line with ‘Rituximab for the treatment of relapsed or refractory stage III or IV follicular nonHodgkin’s lymphoma [review of technology appraisal guidance 37]’ [NICE technology appraisal guidance 137]). 

4.4 The Committee heard from patient experts that using rituximab maintenance treatment instead of watchful waiting may delay the need for eventual chemotherapy on relapse of the disease. The patient experts also expressed the view that chemotherapy is associated with more adverse events than rituximab, that it may cause symptoms worse than those caused by follicular non-Hodgkin’s lymphoma itself, and that chemotherapy therefore has a substantial negative impact on an individual’s quality of life. The patient experts stated that while on chemotherapy they experienced symptoms of weakness and fatigue and were not able to do simple routine tasks without the support of family and carers. However, they were aware that people who received rituximab 

National Institute for Health and Clinical Excellence Page 20 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 21 -->

**CONFIDENTIAL** 

maintenance treatment did not have adverse effects associated with chemotherapy and were able to continue with their normal daily routine. 

## _**Clinical effectiveness**_ 

4.5 The Committee considered the data presented by the manufacturer on the clinical effectiveness of rituximab maintenance treatment after first-line induction with rituximab plus chemotherapy. The Committee noted that the manufacturer derived data on efficacy primarily from the PRIMA trial that compared rituximab maintenance with observation in people whose disease had responded to first-line induction therapy. The Committee noted that the most recent data from this trial were available from the post-study observational follow-up period, which had a median follow-up of 38 months, and indicated that progression-free survival was statistically significantly improved in people who had been randomised to rituximab maintenance treatment compared with people who had been randomised to observation. The Committee was aware that the manufacturer could not estimate time to progression for patients randomised to rituximab, because too few people had progressed during the trial, and the manufacturer therefore had to extrapolate this value using a statistical distribution. The Committee noted the concerns of the ERG that because progression-free survival had been estimated from the period after the end of the trial, patients may have received other therapies, which in turn could have affected the chance of disease progression. The Committee also noted that despite following patients beyond the end of the trial, the manufacturer could not estimate the overall survival associated with rituximab maintenance treatment because of the small number of deaths during this period. The Committee was aware that the trial stopped earlier than 

National Institute for Health and Clinical Excellence Page 21 of 42 Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 22 -->

**CONFIDENTIAL** 

originally planned on advice from the trial’s statisticians, and heard from the ERG that there is evidence suggesting that studies that have stopped earlier than planned often overestimate the clinical benefit. However, the Committee was satisfied, after advice from the clinical specialists, that progression-free survival for people treated with rituximab maintenance therapy in the PRIMA trial reflected the clinicians’ observations from clinical practice. The Committee concluded that the available evidence shows that first-line maintenance treatment with rituximab significantly improves progression-free survival compared with observation (36 months’ median PFS: 74.9% vs 57.6% respectively; HR 0.55; p<0.0001), but that the size of the overall survival benefit could not be determined. 

4.6 The Committee was aware that the PRIMA trial was the only trial that directly addressed the decision problem, and included the relevant population, intervention, comparison and outcomes. The Committee heard from the clinical specialists that the results from the PRIMA trial inform clinical practice in the UK. The Committee learned from the manufacturer that another trial (ECOG 1496) demonstrated that rituximab maintenance led to longer progression-free survival compared with observation, but that this trial had been conducted in people who had not previously had first-line induction treatment with rituximab-containing chemotherapy. The Committee understood that another trial (SAKK 35/98) had observed a longer event-free survival for people randomised to rituximab maintenance compared with those who had been randomised to no treatment (observation), but that the participants of this trial had either not been treated before rituximab maintenance or had only received an induction regimen with rituximab monotherapy, not rituximab combined with chemotherapy. 

National Institute for Health and Clinical Excellence Page 22 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 23 -->

**CONFIDENTIAL** 

4.7 The Committee considered the adverse-event profile of rituximab. It noted that the incidence of grade 3 or 4 adverse events was significantly higher in the rituximab maintenance arm than in the observation arm of the PRIMA trial (section 3.6). However, the Committee heard from the clinical specialists and patient experts that rituximab maintenance treatment is generally well tolerated and that adverse events are easily managed. The patient experts also considered the adverse effects associated with rituximab maintenance therapy to be less severe than those experienced with chemotherapy on relapse of disease. The Committee concluded that, overall, most adverse events associated with rituximab treatment are not severe, and that using rituximab to extend remission may delay the need for chemotherapy and, in turn, delay the associated adverse events. 

## _**Cost effectiveness**_ 

4.8 The Committee reviewed the original and revised economic analyses provided by the manufacturer and the exploratory sensitivity analyses performed by the ERG. It heard from the ERG that inconsistencies and errors were identified in the manufacturer’s revised model, but that correcting them had only a small effect on the manufacturer’s base-case results. The Committee noted that in the PRIMA trial the median age at randomisation was 57 years. However, it heard from the clinical specialists that the mean age at the start of first-line treatment in the UK is usually between 60 and 65 years. The Committee acknowledged that people in clinical trials tend to be younger and fitter than those in clinical practice, but it noted from sensitivity analyses conducted by the ERG that the ICER varied depending on the age assumed at the start of treatment. Therefore the Committee  considered that the average age of people with advanced non-Hodgkin’s lymphoma seen in UK 

National Institute for Health and Clinical Excellence Page 23 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 24 -->

**CONFIDENTIAL** 

clinical practice should be used in the analysis to provide a more accurate estimate. The Committee considered the revised base-case ICER from the manufacturer of £15,400 per QALY gained, which assumed that the mean age at induction was 62.5 years. The Committee heard from the ERG that the method that the manufacturer had used to adjust for age in its economic model did not reflect the prognostic importance of incident age. The Committee considered exploratory sensitivity analyses from the ERG in which the hazard ratios for progression free survival were adjusted for specific patient ages to reflect a reduction in clinical effect  with the increase of age. The Committee noted that age was not the only variable that had an impact on prognosis and, therefore considered that the ERG’s adjustment of the hazard ratios for different age groups was not needed. The Committee was satisfied that the manufacturer’s base-case analysis had appropriately adjusted for age and reflected the average patient population seen in UK clinical practice. 

4.9 The Committee noted that the manufacturer had assumed in the base case that the clinical benefit of rituximab maintenance would last for 6 years (2 years of treatment and 4 years of sustained benefit once treatment was stopped). The Committee heard from the ERG that the manufacturer’s extrapolation of the clinical benefit of rituximab beyond the period observed in the PRIMA trial assumed a proportional increase in survival with time, which may not reflect the true effect. The Committee also noted the ERG’s concerns that patient-level data from the PRIMA trial indicated that the duration of  effect from rituximab maintenance treatment appears to be 28 months, after which time patients treated with rituximab maintenance therapy experience a rate of progression no better or worse than that of patients not treated with rituximab maintenance therapy. The Committee heard from the clinical 

National Institute for Health and Clinical Excellence Page 24 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 25 -->

**CONFIDENTIAL** 

specialists that data from the PRIMA trial demonstrated that rituximab maintenance treatment is clinically effective to 36 months at least and without evidence that the effect diminishes over time; therefore, assuming a duration of benefit of only 28 months, as suggested by the ERG, may underestimate the actual effect of treatment. The Committee also heard from the clinical specialists that the period over which rituximab is likely to have an additional benefit over observation is probably 3 to 4 years (that is, 1 to 2 years beyond treatment). However, it further heard from the clinical specialists that it was not possible to predict a definite time period, and a duration of effect of up to 6 years, as seen in the EORTC 20981 study for second-line rituximab maintenance treatment, could be plausible. The Committee considered sensitivity analyses conducted by the manufacturer that assumed a duration of treatment effect of 28 months, 36 months and 48 months and noted that the ICERs ranged from £17,300 to £27,400 per QALY gained. The Committee noted that these estimates were lower than those calculated by the ERG for the same scenarios (range: £24,600 to £43,900 per QALY gained) but acknowledged that the manufacturer and the ERG had used different modelling approaches to calculate their results (section 3.29). The Committee considered that the duration of clinical benefit of rituximab maintenance was a key driver of cost effectiveness, but was satisfied that the manufacturer’s sensitivity analyses presented the most plausible range of estimates for the treatment effect in line with clinical opinion and the available data. 

4.10 The Committee noted that the manufacturer’s revised base-case analysis assumed that most (89.2%) of the progression-free survival benefit translated to an overall survival gain in its model. The Committee heard from the clinical specialists that it was not possible to verify the specific conversion rate from progression-free National Institute for Health and Clinical Excellence Page 25 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 26 -->

**CONFIDENTIAL** 

survival to overall survival from the literature or clinical experience, but that they would expect a conversion rate of at least 70%. The Committee also heard from the clinical specialists that patients with non-Hodgkin’s follicular lymphoma live longer than in the past, and it is reasonable to assume that this is at least partly due to the introduction of treatment with rituximab. The Committee considered that the manufacturer should have sought data from patient registries or observational data to validate the conversion rate assumed for the base-case estimate, and to confirm the degree to which rituximab maintenance treatment might prolong life. However, it was satisfied that the manufacturer’s sensivity analyses, which assumed conversion rates of 70%, 80% and 90%, provided a plausible range of conversion rate estimates. The Committee heard from the manufacturer that the conversion rate was not an actual input in the model and could only be adjusted by artificially modifying other parameters. As such, the manufacturer was concerned that its revised analyses, which were requested by the Committee, were driven by implausible assumptions. The Committee noted the manufacturer’s concerns but was satisfied that the sensitivity analyses addressed the uncertainty that the Committee initially had about the translation from progression-free survival to overall survival gain in the original analysis. 

4.11 The Committee considered the concerns of the ERG that the early closure of the PRIMA trial may have overestimated the benefit from rituximab, and therefore the hazard ratio for progression-free survival (0.55) derived from the PRIMA trial should be increased to adjust for this bias. The Committee noted the revised sensitivity analyses from the ERG, which took account of the adjusted hazard ratio, but considered that adjusting for early reporting bias is not routinely included in technology appraisals and is not a current requirement in the NICE methods guide. The Committee therefore National Institute for Health and Clinical Excellence Page 26 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 27 -->

**CONFIDENTIAL** 

concluded that the manufacturer had used an appropriate hazard ratio and that the ERG’s revised analyses using the higher hazard ratio would not be considered. 

4.12 The Committee discussed the utility values used in the manufacturer’s model. The Committee appreciated that no differences in health-related quality of life were observed between the arms of the PRIMA trial. The Committee considered sensitivity analyses from the ERG that showed that changes to the gains in utility in different health states in the model had a marginal effect on the base-case ICER, and the Committee was therefore persuaded that the ICERs presented by the manufacturer were largely driven by gains in overall survival. 

4.13 The Committee noted that the ICERs for rituximab maintenance compared with observation in the manufacturer’s submission and sensitivity analyses were less than £30,000 per QALY gained for most scenarios. The Committee also noted that the ERG’s exploratory sensitivity analyses, which assumed a duration of clinical benefit from rituximab maintenance treatment of 36 to 48 months (in line with clinical opinion), resulted ICERs ranging from £24,600 to £35,000 per QALY gained, depending on the conversion rate of progression free survival to overall survival gain assumed. The Committee was aware that the model did not include the utility associated with delaying chemotherapy, and that if it were included, it would decrease the ICER (that is, improve the cost effectiveness) to an estimate which would be considered as a costeffective use of NHS resources. Therefore, the Committee considered that rituximab maintenance therapy should be recommended as an option for the treatment of people with follicular non-Hodgkin’s lymphoma that has responded to first-line 

National Institute for Health and Clinical Excellence Page 27 of 42 Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 28 -->

**CONFIDENTIAL** 

induction treatment with rituximab in combination with chemotherapy. 

## _**Summary of Appraisal Committee’s key conclusions**_ 

|**TAXXX (STA)**|**Appraisal title: Rituximab for the first-line**<br>**maintenance treatment of follicular non-Hodgkin’s**<br>**lymphoma**|**Section**|
|---|---|---|
||||
|**Key conclusion**|||
|Rituximab maintenance therapy is recommended as an option for the<br>treatment of people with follicular non-Hodgkin’s lymphoma that has<br>responded to first-line induction therapy with rituximab in combination with<br>chemotherapy.||1.1, 4.13|
|**Current practice**|||
|Clinical need of<br>patients,<br>including the<br>availability of<br>alternative<br>treatments|The Committee heard from the clinical specialists that<br>current management aims to prolong remission, delay<br>progression (and therefore delay the use of<br>chemotherapy), and improve quality of life. ‘Watchful<br>waiting’ (observation) is the current standard treatment<br>for people with advanced follicular non-Hodgkin’s<br>lymphoma that has responded to first-line induction.<br>therapy.|4.3|
|**The technology**|||
|Proposed<br>benefits of the<br>technology<br>How innovative<br>is the<br>technology in its<br>potential to<br>make a<br>significant and<br>substantial<br>impact on<br>health-related<br>benefits?|The clinical specialists expressed the view that rituximab<br>maintenance treatment constituted optimal management<br>because it could offer people longer periods of remission<br>and better quality of life if used after first-line induction<br>therapy.<br>Patient experts expressed the view that using rituximab<br>maintenance treatment instead of watchful waiting may<br>delay the need for eventual chemotherapy on relapse of<br>the disease.|4.3<br>4.4|
|What is the<br>position of the<br>treatment in the<br>pathway of care<br>for the<br>condition?|Rituximab has a UK marketing authorisation for the<br>‘treatment of follicular lymphoma patients responding to<br>induction therapy’.|2.1|



National Institute for Health and Clinical Excellence 


Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 29 -->

**CONFIDENTIAL** 

|Adverse effects|The incidence of grade 3 or 4 adverse events was<br>significantly higher in the rituximab maintenance arm<br>than in the observation arm of the PRIMA trial (24% vs<br>17%, p=0.0026).<br>The Committee heard from the clinical specialists and<br>patient experts that rituximab maintenance treatment is<br>generally well tolerated and that adverse events are<br>easily managed. The patient experts also highlighted that<br>they consider the side effects associated with rituximab<br>maintenance therapy to be less severe than those<br>experienced with chemotherapy, which may be given if<br>the disease relapses.|3.6, 4.7|
|---|---|---|
|**Evidence for clinical effectiveness**|||
|Availability,<br>nature and<br>quality of<br>evidence|The manufacturer derived efficacy data primarily from the<br>PRIMA trial that compared rituximab maintenance with<br>observation in people whose disease had responded to<br>first-line induction therapy. The Committee noted that the<br>most recent data from this trial were available from the<br>post-study observational follow-up period, which had a<br>median follow-up of 38 months. The Committee heard<br>from the clinical specialists that the results from the<br>PRIMA trial inform clinical practice in the UK.<br>The Committee was aware that the trial stopped earlier<br>than originally planned on advice from the trial’s<br>statisticians, but heard from the ERG that evidence<br>suggests that studies which stop earlier than planned<br>often overestimate the clinical benefit. However, the<br>Committee was satisfied, after advice from the clinical<br>specialists, that progression-free survival for people<br>treated with rituximab maintenance therapy in the PRIMA<br>trial reflected the clinicians’ observations from clinical<br>practice.|4.5, 4.6|
|Relevance to<br>general clinical<br>practice in the<br>NHS|The Committee noted that in the PRIMA trial the median<br>age at randomisation was 57 years. However, it heard<br>from the clinical specialists that the mean age at the start<br>of first-line treatment in the UK is usually between 60 and<br>65 years. Although the Committee acknowledged that<br>people in clinical trials tend to be younger and fitter than<br>those in clinical practice, it noted from sensitivity<br>analyses conducted by the ERG that the manufacturer’s<br>base-case ICER varied depending on the age assumed<br>at the start of treatment and therefore may have added<br>uncertainty.<br>The Committee considered the revised base-case from<br>the manufacturer, which assumed that the mean age at<br>induction was 62.5 years. Itwas satisfied that this|4.8|



National Institute for Health and Clinical Excellence 


Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 30 -->

**CONFIDENTIAL** 

||analysis had appropriately adjusted for age and reflected<br>the average patient population seen in UK clinical<br>practice.||
|---|---|---|
|Uncertainties<br>generated by<br>the evidence|The Committee noted that because of the small number<br>of deaths during the trial period, overall survival<br>associated with rituximab maintenance treatment could<br>not be estimated.<br>The Committee noted that the manufacturer assumed in<br>the base case that the clinical benefit of rituximab<br>maintenance would last for 6 years (2 years of treatment<br>and 4 years of sustained benefit once treatment was<br>stopped). The Committee noted the ERG’s concerns that<br>patient-level data for rituximab maintenance treatment<br>from the PRIMA trial indicated that the duration of<br>treatment effect appears to be 28 months. The<br>Committee heard from the clinical specialists that data<br>from the PRIMA trial indicated that rituximab<br>maintenance treatment is clinically effective to at least 36<br>months and there is no evidence that the effect<br>diminishes over time; therefore assuming a duration of<br>benefit of only 28 months, as suggested by the ERG,<br>may underestimate the actual effect of treatment. The<br>Committee heard from the clinical specialists that<br>rituximab is likely to provide a benefit for 3 to 4 years<br>(that is, 1 to 2 years beyond treatment); however, it was<br>not possible to predict a definite time period.|4.5<br>4.9|
|Are there any<br>clinically<br>relevant<br>subgroups for<br>which there is<br>evidence of<br>differential<br>effectiveness?|Not applicable.|–|
|Estimate of the<br>size of the<br>clinical<br>effectiveness<br>including<br>strength of<br>supporting<br>evidence|The Committee concluded that the available evidence<br>shows that first-line maintenance treatment with<br>rituximab improves progression-free survival compared<br>with observation (36 months’ median PFS: 74.9% vs<br>57.6% respectively; HR 0.55; p<0.0001),  but that the<br>size of the overall survival benefit could not be<br>determined.|4.5|
|**Evidence for cost effectiveness**|||
|Availability and<br>nature of<br>evidence|The Committee heard from the ERG that inconsistencies<br>and errors were identified in the manufacturer’s model,<br>but that correcting them only had a small effect on the|4.8|
|National Institute for Health and Clinical Excellence<br>Page 30 of 42|||



Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 31 -->

**CONFIDENTIAL** 

||manufacturer’s base-case results.<br>The Committee heard from the manufacturer that its<br>revised analyses, which were requested by the<br>Committee, were driven by implausible assumptions. The<br>Committee noted the manufacturer’s concerns but was<br>satisfied that the sensitivity analyses addressed the<br>uncertainty that the Committee initially had when it<br>considered the original analysis.|4.10|
|---|---|---|
|Uncertainties<br>around and<br>plausibility of<br>assumptions<br>and inputs in<br>the economic<br>model|The Committee noted that the manufacturer had<br>assumed that the clinical benefit of rituximab<br>maintenance would last for 6 years (2 years of treatment<br>and 4 years of sustained benefit once treatment was<br>stopped). The Committee heard from the ERG that the<br>manufacturer’s extrapolation of the clinical benefit of<br>rituximab beyond the observed period in the PRIMA trial<br>assumed a proportional increase in survival with time,<br>which may not reflect the true effect.<br>The Committee considered sensitivity analyses<br>conducted by the manufacturer that assumed a duration<br>of treatment effect of 28 months, 36 months and<br>48 months and noted that the ICERs ranged from<br>£17,300 to £27,400 per QALY gained. The Committee<br>noted that these estimates were lower than those<br>calculated by the ERG for the same scenarios but<br>acknowledged that the manufacturer and the ERG had<br>used different modelling approaches (section 3.29). The<br>Committee was satisfied that the manufacturer’s<br>sensitivity analyses presented the most plausible range<br>of estimates for the treatment effect in line with clinical<br>opinion and the available data.<br>The Committee noted that the manufacturer’s revised<br>base-case analysis assumed that most (89.2%) of the<br>progression-free survival benefit translated to an overall<br>survival gain in its model. The Committee heard from the<br>clinical specialists that it was not possible to verify the<br>specific conversion rate from progression-free survival to<br>overall survival from the literature or clinical experience,<br>but that they would expect a conversion rate of at least<br>70%. The Committee was satisfied that the<br>manufacturer’s sensitivity analyses, which assumed a<br>conversion rates of 70%, 80% and 90%, provided a<br>plausible range of conversion rate estimates.<br>The Committee considered the concerns of the ERG that<br>the early closure of the PRIMA trial may have<br>overestimated the benefit from rituximab, and therefore<br>the hazard ratio for progression-free survival (0.55)<br>derived from the PRIMA trial should be increased to<br>adjustforthis bias. The Committeenoted therevised|4.9<br>4.10<br>4.11|
|National Institute for Health and Clinical Excellence<br>Page 31 of 42<br>Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular non-<br>Hodgkin’s lymphoma<br>Issue date: May 2011|||





<!-- page 32 -->

**CONFIDENTIAL** 

||sensitivity analyses from the ERG, which took account of<br>the adjusted hazard ratio, but considered that adjusting<br>for early reporting bias is not routinely included in<br>technology appraisals and is not a current requirement in<br>the NICE methods guide.||
|---|---|---|
|Incorporation of<br>health-related<br>quality-of-life<br>benefits and<br>utility values<br>Have any<br>potential<br>significant and<br>substantial<br>health-related<br>benefits been<br>identified that<br>were not<br>included in the<br>economic<br>model, and how<br>have they been<br>considered?|The manufacturer’s model included utility values of 0.88<br>and 0.79 for the PF1 and PF2 health states respectively.<br>The Committee considered sensitivity analyses from the<br>ERG that showed that changes to the gains in utility in<br>different health states in the manufacturer’s model had a<br>marginal effect on the base-case ICER, and the<br>Committee was therefore persuaded that the ICERs<br>presented by the manufacturer were largely driven by<br>gains in overall survival.<br>The Committee was aware that the model did not include<br>the utility associated with delaying chemotherapy, and<br>that if it were included, it would likely decrease the ICER<br>(that is, improve the cost effectiveness). Although the<br>Committee requested analysis of potential utility gains<br>associated with delaying the need for chemotherapy after<br>relapse, the manufacturer was unable to incorporate<br>these because of limitations in the structure of the model.|3.12,<br>3.24,<br>4.12<br>3.25,<br>4.13|
|Are there<br>specific groups<br>of people for<br>whom the<br>technology is<br>particularly cost<br>effective?|Not applicable.|–|
|What are the<br>key drivers of<br>cost<br>effectiveness?|The key drivers of cost effectiveness were assumptions<br>about the duration of clinical benefit of rituximab<br>maintenance, the conversion rate of progression-free<br>survival to overall survival and the underestimation in the<br>economic model of the utility associated with delaying<br>chemotherapy treatment.<br>The Committee was satisfied that the manufacturer’s<br>sensitivity analyses presented the most plausible range<br>of estimates for the duration of treatment effect and the<br>translation from progression-free survival to overall<br>survival gain.|4.9, 4.10|
|Most likely cost-<br>effectiveness<br>estimate (given<br>as an ICER)|The Committee noted that the ICERs for rituximab<br>maintenance compared with observation in the<br>manufacturer’s submission and sensitivity analyses were<br>less than £30,000 per QALY gained for most scenarios.<br>The Committee also noted that the ERG’s exploratory|4.13|



National Institute for Health and Clinical Excellence Page 32 of 42 Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 



<!-- page 33 -->

**CONFIDENTIAL** 

||sensitivity analyses, which assumed a duration of clinical<br>benefit from rituximab maintenance treatment of 36 to 48<br>months (in line with clinical opinion), had ICERs ranging<br>from £24,600 to £35,000 per QALY gained, depending<br>on the conversion rate of progression free survival to<br>overall survival gain assumed. The Committee was<br>aware that the model did not include the utility associated<br>with delaying chemotherapy, and that if it were included,<br>it would  decrease the ICER (that is, improve the cost<br>effectiveness) to an estimate which would be considered<br>as a cost-effective use of NHS resources. Therefore the<br>Committee considered that rituximab maintenance<br>therapy should be recommended as an option for<br>treatment for people with non-Hodgkin’s lymphoma that<br>has responded to first-line induction therapy with<br>rituximab in combination with chemotherapy.||
|---|---|---|
|**Additional factors taken into account**|||
|Patient access<br>schemes<br>(PPRS)|Not applicable.|–|
|End-of-life<br>considerations|Not applicable.|–|
|Equalities<br>considerations<br>and social value<br>judgements|No equalities issues were raised during the scoping<br>exercise or during the course of the appraisal.|–|



## **5 Implementation** 

- 5.1 The Secretary of State and the Welsh Assembly Minister for Health and Social Services have issued directions to the NHS in England and Wales on implementing NICE technology appraisal guidance. When a NICE technology appraisal recommends use of a drug or treatment, or other technology, the NHS must usually provide funding and resources for it within 3 months of the guidance being published. If the Department of Health issues a variation to the 3- month funding direction, details will be available on the NICE website. When there is no NICE technology appraisal guidance on a drug, treatment or other technology, decisions on funding should be made locally. 

National Institute for Health and Clinical Excellence Page 33 of 42 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 34 -->

**CONFIDENTIAL** 

- 5.2 NICE has developed tools to help organisations put this guidance into practice (listed below). These are available on our website (www.nice.org.uk/guidance/TAXXX). [NICE to amend list as needed at time of publication] 

   - Slides highlighting key messages for local discussion. 

   - Costing template and report to estimate the national and local savings and costs associated with implementation. 

   - Implementation advice on how to put the guidance into practice and national initiatives that support this locally. 

   - A costing statement explaining the resource impact of this guidance. 

**==> picture [10 x 13] intentionally omitted <==**

- Audit support for monitoring local practice. 

## **6 Related NICE guidance** 

## **Published** 

- Rituximab for the treatment of relapsed or refractory stage III or IV follicular non-Hodgkin’s lymphoma (review of technology appraisal guidance 37). NICE technology appraisal guidance 137 (2008). Available from 

- www.nice.org.uk/guidance/TA137 

- Rituximab for the treatment of follicular lymphoma. NICE technology 

- appraisal guidance 110 (2006). Available from 

www.nice.org.uk/guidance/TA110 

- Improving outcomes in haematological cancers – the manual. NICE cancer service guidance haemato-oncology (2003). Available from 

- www.nice.org.uk/guidance/CSGHO 


National Institute for Health and Clinical Excellence 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 35 -->

**CONFIDENTIAL** 

## **Under development** 

NICE is developing the following guidance (details available from www.nice.org.uk): 

Rituximab for the treatment of follicular lymphoma (review of technology appraisal guidance 110). NICE technology appraisal. Publication expected December 2011. 

## **7 Review of guidance** 

- 7.1 The guidance on this technology will be considered for review in May 2014. The Guidance Executive will decide whether the technology should be reviewed based on information gathered by NICE, and in consultation with consultees and commentators. 

Amanda Adler 

Chair, Appraisal Committee April 2011 


National Institute for Health and Clinical Excellence 

Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 36 -->

**CONFIDENTIAL** 

## **Appendix A: Appraisal Committee members and NICE project team** 

## _**A Appraisal Committee members**_ 

The Appraisal Committees are standing advisory committees of NICE. Members are appointed for a 3-year term. A list of the Committee members who took part in the discussions for this appraisal appears below. There are four Appraisal Committees, each with a chair and vice chair. Each Appraisal Committee meets once a month except in December, when there are no meetings. Each Committee considers its own list of technologies, and ongoing topics are not moved between Committees. 

Committee members are asked to declare any interests in the technology to be appraised. If it is considered there is a conflict of interest, the member is excluded from participating further in that appraisal. 

The minutes of each Appraisal Committee meeting, which include the names of the members who attended and their declarations of interests, are posted on the NICE website. 

## **Dr Amanda Adler (Chair)** 

Consultant Physician, Addenbrooke's Hospital, Cambridge 

## **Dr Jeff Aronson** 

Reader in Clinical Pharmacology, University Department of Primary Health Care, University of Oxford 

## **Dr Ray Armstrong** 

Consultant Rheumatologist, Southampton General Hospital 

## **Dr Peter Barry** 

Consultant in Paediatric Intensive Care, Leicester Royal Infirmary 

## **Dr Michael Boscoe** 

Consultant Cardiothoracic Anaesthetist, Royal Brompton and Harefield NHS Foundation Trust 

National Institute for Health and Clinical Excellence Page 36 of 42 

> Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 37 -->

**CONFIDENTIAL** 

## **Professor John Cairns** 

Professor of Health Economics Public Health and Policy, London School of Hygiene and Tropical Medicine 

## **Dr Mark Chakravarty** 

External Relations Director, Pharmaceuticals and Personal Health, Oral Care Europe 

## **Professor Fergus Gleeson** 

Consultant Radiologist, Churchill Hospital, Oxford 

## **Mrs Eleanor Grey** 

Lay member 

## **Dr Neil Iosson** 

General Practitioner 

## **Dr Rosa Legood** 

Lecturer, London School of Hygiene and Tropical Medicine 

## **Mr Terence Lewis** 

Lay member 

## **Professor Ruairidh Milne** 

Director of Strategy and Development, and Director for Public Health Research, NIHR Evaluation, Trials and Studies Coordinating Centre, University of Southampton 

## **Dr Rubin Minhas** 

General Practitioner and Clinical Director, BMJ Evidence Centre 

## **Dr Peter Norrie** 

Principal Lecturer in Nursing, DeMontfort University 

## **Professor Stephen Palmer** 

Professor of Health Economics, Centre for Health Economics, University of York 

## **Dr Sanjeev Patel** 

Consultant Physician & Senior Lecturer in Rheumatology, St Helier University Hospital 

National Institute for Health and Clinical Excellence 


Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 38 -->

**CONFIDENTIAL** 

## **Dr John Pounsford** 

Consultant Physician, Frenchay Hospital, Bristol 

## **Dr Casey Quinn** 

Lecturer in Health Economics, Division of Primary Care, University of Nottingham 

## **Dr John Rodriguez** 

Assistant Director of Public Health, NHS Eastern and Coastal Kent 

## **Mr Alun Roebuck** 

Consultant Nurse in Critical and Acute Care, United Lincolnshire NHS Trust 

## **Dr Florian Alexander Ruths** 

Consultant Psychiatrist and Cognitive Therapist, Maudsley Hospital, London 

## **Mr Navin Sewak** 

Primary Care Pharmacist, NHS Hammersmith and Fulham 

## **Mr Roderick Smith** 

Finance Director, West Kent Primary Care Trust 

## **Mr Cliff Snelling** 

Lay member 

## **Professor Ken Stein (Vice Chair)** 

Professor of Public Health, Peninsula Technology Assessment Group (PenTAG), University of Exeter 

## **Professor Andrew Stevens** 

Professor of Public Health, Department of Public Health and Epidemiology, University of Birmingham 

## **Dr Colin Watts** 

Consultant Neurosurgeon, Addenbrooke’s Hospital 

## **Mr Tom Wilson** 

Director of Contracting and Performance, NHS Tameside and Glossop 

National Institute for Health and Clinical Excellence 


> Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 39 -->

**CONFIDENTIAL** 

## _**B NICE project team**_ 

Each technology appraisal is assigned to a team consisting of one or more health technology analysts (who act as technical leads for the appraisal), a technical adviser and a project manager. 

## **Panagiota Vrouchou and Alfred Sackeyfio** 

Technical Leads 

## **Fiona Rinaldi** 

Technical Adviser 

**Jeremy Powell** Project Manager 

National Institute for Health and Clinical Excellence 


Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 40 -->

**CONFIDENTIAL** 

## **Appendix B: Sources of evidence considered by the Committee** 

- A The Evidence Review Group (ERG) report for this appraisal was prepared by the Liverpool Reviews and Implementation Group: 

**==> picture [11 x 15] intentionally omitted <==**

      - Bagust A, Boland A, Blundell M, et al. Rituximab for the firstline maintenance treatment of follicular non-Hodgkin’s lymphoma, October, 2010 

- B The following organisations accepted the invitation to participate in this appraisal as consultees and commentators. They were invited to comment on the draft scope, the ERG report and the appraisal consultation documents (ACD1 and ACD2). Organisations listed in I were also invited to make written submissions. Organisations listed in II and III had the opportunity to give their expert views. Organisations listed in I, II and III also have the opportunity to appeal against the final appraisal determination. 

   - I Manufacturer/sponsor: 

**==> picture [11 x 14] intentionally omitted <==**

   - Roche Products 

- II Professional/specialist and patient/carer groups: 

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 14] intentionally omitted <==**

**==> picture [11 x 14] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 14] intentionally omitted <==**

- British Society for Haematology 

- Cancer Networks Pharmacists Forum 

- Cancer Research UK 

- Leukaemia CARE 

- Lymphoma Association 

- Royal College of Nursing 

- Royal College of Pathologists 

- Royal College of Physicians, Medical Oncology Joint Special Committee 

- United Kingdom Oncology Nursing Society 

III Other consultees: 

**==> picture [11 x 15] intentionally omitted <==**

## Department of Health 

National Institute for Health and Clinical Excellence 


Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 41 -->

**CONFIDENTIAL** 

**==> picture [11 x 14] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

   - NHS Camden 

   - Welsh Assembly Government 

- IV Commentator organisations (did not provide written evidence and without the right of appeal): 

**==> picture [11 x 14] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 14] intentionally omitted <==**

**==> picture [11 x 14] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

   - British National Formulary 

   - Commissioning Support Appraisals Service 

   - Department of Health, Social Services and Public Safety for Northern Ireland 

   - Leukaemia & Lymphoma Research 

   - Medicines and Healthcare products Regulatory Agency NHS Quality Improvement Scotland 

- C The following individuals were selected from clinical specialist and 

patient expert nominations from the non-manufacturer/sponsor consultees and commentators. They gave their expert personal view on rituximab by attending the initial Committee discussion and providing written evidence to the Committee. They were also invited to comment on the ACD1 and ACD2. 

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 15] intentionally omitted <==**

**==> picture [11 x 14] intentionally omitted <==**

- Professor Peter Johnson, Professor of Medical Oncology, nominated by National Cancer Research Institute/Royal College of Physicians/Royal College of Radiologists/Association of Cancer Physicians/Joint Collegiate Council for Oncology – clinical specialist 

- Dr Helen McCarthy, Consultant Haematologist, nominated by the Royal College of Pathologists – clinical specialist 

- Dr Robert Marcus, Consultant Haematologist, nominated by National Cancer Research Institute/Royal College of Physicians/Royal College of Radiologists/Association of Cancer Physicians/Joint Collegiate Council for Oncology – clinical specialist 

- Mandy Childs, nominated by Lymphoma CARE – patient expert 

- Elizabeth Nelson, nominated by the Lymphoma Association – patient expert 

National Institute for Health and Clinical Excellence 


Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma 




<!-- page 42 -->

**CONFIDENTIAL** 

- D Representatives from the following manufacturer/sponsor attended Committee Meetings. They contributed only when asked by the Committee chair to clarify specific issues and comment on factual accuracy. 

**==> picture [11 x 15] intentionally omitted <==**

## Roche Products 

National Institute for Health and Clinical Excellence 


Final appraisal determination – Rituximab for the first-line maintenance treatment of follicular nonHodgkin’s lymphoma Issue date: May 2011 

