{"id":4376,"date":"2025-05-23T11:28:15","date_gmt":"2025-05-23T17:28:15","guid":{"rendered":"https:\/\/allphasepharma.com\/dir\/?p=4376"},"modified":"2025-05-24T00:39:05","modified_gmt":"2025-05-24T06:39:05","slug":"the-utility-of-futility","status":"publish","type":"post","link":"https:\/\/allphasepharma.com\/dir\/2025\/05\/23\/4376\/the-utility-of-futility\/","title":{"rendered":"THE UTILITY OF FUTILITY"},"content":{"rendered":"\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/05\/HR-BLOG-FUTILITY.jpg?ssl=1\"><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" width=\"530\" height=\"149\" src=\"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/05\/HR-BLOG-FUTILITY.jpg?resize=530%2C149&#038;ssl=1\" alt=\"\" class=\"wp-image-4384\" srcset=\"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/05\/HR-BLOG-FUTILITY.jpg?w=640&amp;ssl=1 640w, https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/05\/HR-BLOG-FUTILITY.jpg?resize=300%2C84&amp;ssl=1 300w\" sizes=\"auto, (max-width: 530px) 100vw, 530px\" \/><\/a><\/figure>\n\n\n\n<p>Companies can stop studies before reaching projected enrollment numbers.&nbsp; It could be a decision based on a planned interim analysis (IA) or it could be for &nbsp;\u2018administrative\u2019 reasons.&nbsp; The latter may not indicate that a company has fallen on hard times financially; it could be the result of operational problems with recruitment, or in response to regulatory changes, or due to an outside event like Covid.<\/p>\n\n\n\n<p>Usually a DSMB handles the unblinded data review and IA.&nbsp; A safety review is always done with particular attention to deaths, premature discontinuations, SAEs and AESIs, Hy\u2019s Law cases, etc.&nbsp; DSMB members also need access to efficacy data to weigh risks and benefits, ie, the therapeutic index of a new drug.&nbsp; This can be a particularly difficult for NCEs going for their first efficacy testing.<\/p>\n\n\n\n<p>The purpose of a futility analysis is to stop a trial if a benefit seems unlikely to materialize upon further enrollment.&nbsp; Clearly, a trial should not run to completion when early test results indicate that patients may not benefit. &nbsp;<\/p>\n\n\n\n<p>Timing of the first IA needs to be carefully selected&nbsp; to ensure sufficient information on outcomes, enough to capture an emerging efficacy trend<a href=\"#_ftn1\" id=\"_ftnref1\">[1]<\/a>,<a href=\"#_ftn2\" id=\"_ftnref2\">[2]<\/a>,<a href=\"#_ftn3\" id=\"_ftnref3\">[3]<\/a><\/p>\n\n\n\n<p>The topic of our blog today centers on the operational aspects of conducting an IA in the course of an ongoing study.&nbsp; We would argue not to stop a study, even if the first IA indicates futility.&nbsp; We would rather put a study on temporary hold, esp. those with brisk enrollment as a single patient outcome can change the assessment in small sample sizes.<\/p>\n\n\n\n<figure class=\"wp-block-pullquote\"><blockquote><p>Timing of the 1st IA is extremely important as it sets the smallest possible trial size and requires the most extreme results<\/p><cite>K Viele. Interpretation of Trials that Stop Early.  JAMA 2016, 315:1646<\/cite><\/blockquote><\/figure>\n\n\n\n<p>Let me explain.&nbsp; Stopping a study often means stopping an entire program, and a lot depends on getting it right. Determination of futility may be based on very few cases <sup>4<\/sup>. <\/p>\n\n\n\n<p>More information accumulates between time of data cut-off and the time the DSMB provides its verdict.&nbsp; &nbsp;Why not look at the totality of accrued efficacy data, including supporting and secondary endpoints, run a per-protocol analysis of PP valid cases and not just of the ITT population?&nbsp; Data from patients with incomplete treatment should not be ignored.<\/p>\n\n\n\n<p>The operational aspects of the IA process should be taken into account.&nbsp; Too often it is assumed that data cut-off, data analysis and declaring futility all happen instantaneously and simultaneously.&nbsp; This is never the case.<\/p>\n\n\n\n<p>Once a certain cut-off date is reached, several operational steps still need to be completed, all of which take time. &nbsp;A study continues recruiting patients as noone wants to stop a trial awaiting the outcome of the IA.&nbsp; The longer the data cleaning continues, the more patients and information accrue after data cut-off.<\/p>\n\n\n\n<p>Verification is time consuming but a necessary task before a DSMB can be convened and a company can make a decision.&nbsp; Therefore, the IA population becomes a subset of what is actually available at the time when a company, based on DSMB recommendation, accepts or rejects the futility analysis and stops a trial for good.<\/p>\n\n\n\n<p>The operational work takes time, effort and money even for small trials. &nbsp;Here are a few examples:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>30-day post treatment survival\/mortality is the key endpoint in sepsis studies and relatively easy to determine.&nbsp; Not all endpoints are categorical and as easy to verify.&nbsp;<\/li>\n\n\n\n<li>Take the EASI or PASI scores in dermatology studies, which may need to be confirmed with before and after photos.<\/li>\n\n\n\n<li>The completeness of all the MACE components in CV trials need to be verified.&nbsp;<\/li>\n\n\n\n<li>How about the PANSS Total Score in schizophrenia studies which is so complex that special training is usually required for reproducible scoring? &nbsp;&nbsp;&nbsp;<\/li>\n\n\n\n<li>Batched analysis for microbiology outcomes is not an option if the patient response endpoint is a combination of both clinical and micro data.&nbsp; If a central lab cannot provide this data at the time of the IA, should one rely on local lab microbiology reports?<\/li>\n\n\n\n<li>Special issues exist when treatment effects materialize relatively late, like in oncology or neurology trials.<\/li>\n<\/ul>\n\n\n\n<p>Bottom line: Collecting outcome events and scores requires cross-checks and data verification. This takes time and diligence.  Meanwhile, the trial is running its course.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-pullquote\"><blockquote><p>Remember: No company is compelled to call off a trial based on a futility analysis.<\/p><\/blockquote><\/figure>\n\n\n\n<p>Data cleaning is mostly relegated to CROs by the sponsor.&nbsp; However, CROs are not in the habit of doing data cleaning in synchrony with enrollment; instead they batch up this work for site visits as convenient.&nbsp; Working under time pressure for the IA cut-off date makes their work processes less efficient and more costly.&nbsp; In a moderately fast enrolling trial, clean-up and preparations for an IA can take weeks during which enrollment continues.<\/p>\n\n\n\n<p>If the IA was planned to capture the midway point for data accumulation (50% of enrollment), the trial may be close to 75% of enrollment by the time the data is clean.&nbsp; In such cases, there is little benefit in stopping for futility as the trial is pretty much over.<\/p>\n\n\n\n<p>If a company wants to stop enrollment in order to avoid costs, they would plan for an early futility test using a large efficacy delta and do it with 20-35% of patients enrolled.\u00a0 This way, data cleaning and futility can be done when less than half the enrollment has occurred, resulting in considerable cost savings if the trial is stopped.<\/p>\n\n\n\n<p>Indeed, futility can be established using rather small sample sizes.&nbsp; In some instances, only 10 to 15 patients per arm are needed, if the statistical criteria for futility testing represent high hurdles to justify study continuation<a href=\"#_ftn4\" id=\"_ftnref4\">[4]<\/a>.  Sponsors may elect to use more stringent criteria, if there is interest in phasing out a therapeutic area or a competing funding need.<\/p>\n\n\n\n<p>In the absence of precedent data, choice of alpha and delta is based on judgment.&nbsp; Corporate finance and marketing will weigh in here; it is no longer a purely statistical or scientific exercise that frames the conditions for a futility analysis.<\/p>\n\n\n\n<p>By setting the bar for efficacy too high or making decisions on futility too early, sponsors can make drugs \u2018fail\u2019 or appear ineffective.\u00a0In the language of Press Releases we are told that a program was scuttled, because it did \u00a0not \u201cmeet our high standards or expectations\u201d.\u00a0\u00a0 Often the real reason why a study was stopped will never be revealed.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p><strong>REFERENCES<\/strong><br \/><a href=\"#_ftnref1\" id=\"_ftn1\">[1]<\/a> Chang Y. Futility stopping in clinical trials, optimality and practical considerations.\u00a0 Biopharm Stat 30:1050, 2020<br \/><a href=\"#_ftnref2\" id=\"_ftn2\">[2]<\/a> Ciolino J. Guidance on interim analysis methods in clinical trials. J Clinical Translat Science 7: e124, 1<br \/><a href=\"#_ftnref3\" id=\"_ftn3\">[3]<\/a> Togo K.\u00a0Optimal Timing for Interim Analyses in Clinical Trials, J Biopharmaceut Stat 23:5, 1067, 2013<br \/><a href=\"#_ftnref4\" id=\"_ftn4\">[4]<\/a> Simon R. Optimal Two-Stage Designs for Phase II Clinical Trials. \u00a0Controlled Clinical Trials 10:1, 1989<\/p>\n\n\n\n<p><strong>ABBREVIATIONS<\/strong><br \/>AESI\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 adverse event of special interest<br \/>CRO\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 contract research organization<br \/>DSMB\u00a0\u00a0\u00a0\u00a0  drug safety monitoring board<br \/>EASI\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Eczema Area and Severity Index<br \/>IA\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 interim analysis<br \/>ITT\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 intent-to-treat analysis<br \/>MACE\u00a0\u00a0\u00a0\u00a0  Psoriasis Area and Severity Index<br \/>NCE\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 new chemical entity<br \/>PANSS\u00a0\u00a0   Positive &amp; Negative Schizophenia Symptom Score<br \/>PASI\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0  Psoriasis Area and Severity Index<br \/>PP\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 per protocol analysis<br \/>SAE\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 serious\/severe adverse event<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Companies can stop studies before reaching projected enrollment numbers.&nbsp; It could be a decision based on a planned interim analysis (IA) or it could be for &nbsp;\u2018administrative\u2019 reasons.&nbsp; The latter may not indicate that a company has fallen on hard times financially; it could be the result of operational problems <a class=\"more-link\" href=\"https:\/\/allphasepharma.com\/dir\/2025\/05\/23\/4376\/the-utility-of-futility\/\">Continue reading <span class=\"screen-reader-text\">  THE UTILITY OF FUTILITY<\/span><span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":4384,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[140,18],"tags":[1271,2194,2196,524,2193,2197,2195,1583,1057],"class_list":["post-4376","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-interesting_facts","category-the_viewpoint","tag-allphase-pharma-consulting","tag-data-cleaning","tag-data-cut-off","tag-dsmb","tag-futility-analysis","tag-futility-statistics","tag-futility-timing","tag-harald-reinhart","tag-interim-analysis"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/05\/HR-BLOG-FUTILITY.jpg?fit=640%2C180&ssl=1","jetpack_shortlink":"https:\/\/wp.me\/p4KWFr-18A","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":6362,"url":"https:\/\/allphasepharma.com\/dir\/2026\/03\/31\/6362\/igan-therapeutics-the-race-is-on\/","url_meta":{"origin":4376,"position":0},"title":"IgAN Therapeutics &#8211; The Race is On","author":"Harald","date":"March 31, 2026","format":false,"excerpt":"Is there a new trend in the journal world: \u00a0publication of interim analysis (IA) results? The NEJM recently published two articles back to back, both highlighting 9 month 'interim' data from Phase 3 pivotal trials in IgAN. The primary efficacy endpoint used in either study was UPCR at 9 months,\u2026","rel":"","context":"In &quot;Recent Literature&quot;","block_context":{"text":"Recent Literature","link":"https:\/\/allphasepharma.com\/dir\/category\/recent_literature\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2026\/03\/UPCR-vs-GFR.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2026\/03\/UPCR-vs-GFR.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2026\/03\/UPCR-vs-GFR.jpg?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":5735,"url":"https:\/\/allphasepharma.com\/dir\/2025\/11\/08\/5735\/comparison-of-baff-april-inhibitors-2\/","url_meta":{"origin":4376,"position":1},"title":"COMPARISON OF BAFF \/ APRIL INHIBITORS \u2013 2","author":"Harald","date":"November 8, 2025","format":false,"excerpt":"Shortly after posting our last blog on tacicepts, new data was published in the NEJM on the pivotal Phase 3 trial of atacicept.\u00a0 This publication by Lafayette et al. provides results from an IA of the ongoing ORIGIN-3 trial.[1] \u00a0We updated our table with this new information that centers on\u2026","rel":"","context":"In &quot;Recent Literature&quot;","block_context":{"text":"Recent Literature","link":"https:\/\/allphasepharma.com\/dir\/category\/recent_literature\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/11\/atacicept-ORIGIN-3-Interim-e1762657582817.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/11\/atacicept-ORIGIN-3-Interim-e1762657582817.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/11\/atacicept-ORIGIN-3-Interim-e1762657582817.jpg?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":5771,"url":"https:\/\/allphasepharma.com\/dir\/2025\/11\/17\/5771\/tacicepts-vying-for-your-attention\/","url_meta":{"origin":4376,"position":2},"title":"TACICEPTS VYING FOR YOUR ATTENTION","author":"Harald","date":"November 17, 2025","format":false,"excerpt":"Two posters on tacicepts caught our eyes. First is the Tumlin publication on povetacicept, an oral presentation in the \"Late-Breaking Research\" session. This is an interim look at Phase 1b study data reporting on 17 IgAN patients treated for 48 weeks with a dose of 80 mg and 30 patients\u2026","rel":"","context":"In &quot;Recent Literature&quot;","block_context":{"text":"Recent Literature","link":"https:\/\/allphasepharma.com\/dir\/category\/recent_literature\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/11\/TACICEPTS-VYING-FOR-ATTENTION-scaled.jpg?fit=1200%2C338&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/11\/TACICEPTS-VYING-FOR-ATTENTION-scaled.jpg?fit=1200%2C338&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/11\/TACICEPTS-VYING-FOR-ATTENTION-scaled.jpg?fit=1200%2C338&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/11\/TACICEPTS-VYING-FOR-ATTENTION-scaled.jpg?fit=1200%2C338&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/11\/TACICEPTS-VYING-FOR-ATTENTION-scaled.jpg?fit=1200%2C338&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":2892,"url":"https:\/\/allphasepharma.com\/dir\/2016\/11\/14\/2892\/inconclusive-data-in-ia-experts-fill-the-void-to-avoid-horror-vacui\/","url_meta":{"origin":4376,"position":3},"title":"Inconclusive Data in IA: Experts Fill the Void To Avoid Horror Vacui","author":"Harald","date":"November 14, 2016","format":false,"excerpt":"Often we come across a study which raises more questions than it answers.\u00a0 Sometimes we read a study publication again and again, and still we cannot figure out what the take-away learning is, as results are simply inconclusive or discordant. Occasionally we encounter studies with results that are so counterintuitive\u2026","rel":"","context":"In &quot;Recent Literature&quot;","block_context":{"text":"Recent Literature","link":"https:\/\/allphasepharma.com\/dir\/category\/recent_literature\/"},"img":{"alt_text":"ia-blog-header","src":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2016\/11\/IA-blog-header.jpg?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2016\/11\/IA-blog-header.jpg?resize=350%2C200 1x, https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2016\/11\/IA-blog-header.jpg?resize=525%2C300 1.5x"},"classes":[]},{"id":4416,"url":"https:\/\/allphasepharma.com\/dir\/2025\/05\/30\/4416\/baff-april-inhibitors-homing-in-on-igan\/","url_meta":{"origin":4376,"position":4},"title":"BAFF \/ APRIL Inhibitors Homing in on IgAN","author":"Harald","date":"May 30, 2025","format":false,"excerpt":"Today we discuss the group of BAFF\/APRIL inhibitors, specifically the three TACI mAb constructs that are currently in development. They were tested in a broad gamut of B-cell indications but failed to show efficacy in many. So far, consistent clinical success has been seen only in IgA nephropathy (IgAN), with\u2026","rel":"","context":"In &quot;Recent Literature&quot;","block_context":{"text":"Recent Literature","link":"https:\/\/allphasepharma.com\/dir\/category\/recent_literature\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/05\/HR-BLOG-BAFF-APRIL.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/05\/HR-BLOG-BAFF-APRIL.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2025\/05\/HR-BLOG-BAFF-APRIL.jpg?resize=525%2C300&ssl=1 1.5x"},"classes":[]},{"id":125,"url":"https:\/\/allphasepharma.com\/dir\/2014\/04\/18\/125\/waraboutdataaccess\/","url_meta":{"origin":4376,"position":5},"title":"The War about Data Access","author":"Harald","date":"April 18, 2014","format":false,"excerpt":"Several articles in the April 7 issue of BMJ were devoted to the epic battle fought by BMJ and Cochrane to gain unfettered access to the Tamiflu\u00ae and Relenza\u00ae data. Not just some data, but all the data. Considering that only 2 out of 10 Tamiflu studies were published in\u2026","rel":"","context":"In &quot;The Viewpoint&quot;","block_context":{"text":"The Viewpoint","link":"https:\/\/allphasepharma.com\/dir\/category\/the_viewpoint\/"},"img":{"alt_text":"Tamiflu tablets","src":"https:\/\/i0.wp.com\/allphasepharma.com\/dir\/wp-content\/uploads\/2014\/04\/Tamiflu-tablets-300x194.jpg?resize=350%2C200","width":350,"height":200},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/posts\/4376","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/comments?post=4376"}],"version-history":[{"count":13,"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/posts\/4376\/revisions"}],"predecessor-version":[{"id":4394,"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/posts\/4376\/revisions\/4394"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/media\/4384"}],"wp:attachment":[{"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/media?parent=4376"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/categories?post=4376"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/allphasepharma.com\/dir\/wp-json\/wp\/v2\/tags?post=4376"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}