Prova Health

🤖💡 In the latest Prova Health Journal Club, we're delighted to showcase the recent JAMA article on the testing and evaluation of Large Language Models (LLMs) in healthcare. The systematic review, co-authored by Lucy Orr-Ewing, Suhana Bedi, Yutong Liu and a team from Stanford University School of Medicine, Harvard Medical School, Joan & Irwin Jacobs Center for Health Innovation @ UC San Diego Health and FDA, offers valuable insights into how LLMs are being tested in real-world medical settings. The paper highlights the need for more comprehensive evaluations and standardised metrics to ensure LLMs can safely and effectively transform healthcare. Some of the authors’ key findings include:  🩺 Only 5% of studies of LLMs in healthcare used real patient care data, pointing to a gap in practical evaluations. 📏 Accuracy was the primary dimension of evaluation for over 95% of studies, while other measures featured less prominently. Fairness, bias and toxicity were assessed in just 16% of studies, with less than 5% looking at how LLMs are deployed.  🗂️ The scope for using LLMs for administrative tasks, including billing and note-taking, are under explored and warrant further investigation. There is clearly much work to be done to address these important research and knowledge gaps around the use of LLMs in clinical settings. Thanks to the authors for a timely and helpful contribution to the literature on this important emerging subject in digital health research! Check out the full article at the link below. Dev Dash Sanmi Koyejo Alison Callahan Jason Fries Michael Wornow Akshay Swaminathan Lisa Lehmann Mehr Kashyap Akash Chaurasia Nirav R. Shah Karandeep Singh Troy Tazbaz Arnold Milstein Michael Pfeffer Nigam Shah H. Christy Hong, MD MBA #AIinMedicine #LLM #HealthcareInnovation #ClinicalResearch

🇸🇦 Our CMO, Dr Saira Ghafur, and CEO, Gianluca Fontana, are back in the UK after a great visit to the Global Health Exhibition - ملتقى الصحة العالمي this week. 💬 As ever, it was great meeting connections old and new and we look forward to contributing to the ongoing innovation in Saudi healthcare!

🛫🇸🇦 On Monday and Tuesday next week, our Chief Executive Officer, Gianluca Fontana, and Chief Medical Officer, Dr Saira Ghafur, will be in Riyadh for the Global Health Exhibition - ملتقى الصحة العالمي.   🤝 If you are joining us there and would like to meet the team, get in touch and we’d love to have a chat!

🇬🇧 UK MedTech SMEs, you can now apply for up to £30,000 from the government to fund regulatory support in a range of critical areas. 💡 Prova Health can support with the application process and the regulatory expertise, with the input of our trusted advisor on all things regulation, Dr Iain Charlton CEng MIMechE. 📨 Get in touch with our team if you'd like to know more at hello@provahealth.com.

🚨 New opportunity to fund regulatory support 🚨 MedTech Accelerator: Rapid Regulatory Support Fund Deadline 31 October   The Office for life sciences (via CPI) is funding MedTech SMEs for up £30k to receive support from regulatory experts. There is a total of £4.2m available, so an opportunity for over 100 winning bidders. The application form is very short (see attached). See more info below.   Get in touch if you are interested in applying for this and be supported by Prova Health and our regulatory expert Dr Iain Charlton CEng MIMechE. We can help with the application as well as with regulatory expertise in case of success. Please reshare if you know someone who may benefit! 💷 What is the max funding? £30,000 ⏳ When is the submission deadline? Thursday 31st October ⌛ When will results be announced? Friday 29th November ❓ What can funding cover? - Regulatory strategy  - Guidance relating to standards - Guidance on MDR, IVDR, FDA - Guidance on Technical File development  - Mock audits  - Quality management systems - Clinical guidance pertaining to regulatory affairs - Advice on reimbursement models - Global registrations - Contributions towards remedial action (for example electrical safety testing, biocompatibility testing etc)  - Notified body costs

📲📈 Demonstrating the value of digital health solutions can be more challenging than for conventional drugs, as digital solutions can provide unique advantages beyond clinical outcomes. 💵 This is the case especially for generating economic evidence, as the complexity of digital health solutions creates challenges in identifying common evaluation principles that may be used in other healthcare settings. 📊 In this series on the challenges of generating economic evidence for digital health solutions, we’ve focused on the unique hurdles to demonstrating the economic impact technologies can have, from identifying comparators and standards of care across regions and practices to navigating the ability of healthcare systems to engage with and adopt digital solutions. We’ve now reached the final of 7️⃣ key challenges: capturing the relevant outcomes. Why is this challenging? 🎯 Digital health solutions have a wide range of potential impacts, including clinical, organisational, behavioural, and technical outcomes. 📝 Some digital solutions are more public health style interventions, while some may be more administrative interventions. 💭 Traditional health economic outcomes, such as quality-adjusted life years (QALY), may not adequately capture these multidimensional outcomes. 💸 As such, it can be more challenging to demonstrate the potential impact of digital health solutions. To learn more about generating economic evidence for digital health solutions, read the latest Prova Health white paper, developed in collaboration with York Health Economics Consortium and leading health economics experts, at the link below. If you’re looking for support in generating economic evidence for your digital health solution, get in touch! #healtheconomics #digitalhealth #medtech

🔎 Why is evidence becoming so important in digital health? Crucially, what do innovators need to know about generating clinical and economic evidence for their solutions? Last week, our Chief Medical Officer and co-founder, Dr Saira Ghafur, joined Dr. Zhong Wei Khor for the LinkedIn Live event Clinical Evidence Generation: A guide for health tech companies. During the discussion, Saira outlined how health tech companies should approach evidence generation, the key differences between generating evidence for HealthTech (including AI) and traditional pharmaceuticals, as well as new, innovative methods for generating evidence for these products in safe and effective ways. This conversation should serve as an excellent intro to the world of digital health evidence generation for founders and innovators. You can access a recording of the event at the link below. If you'd like to learn more about how Prova Health can support you with your evidence needs, get in touch with us at hello@provahealth.com.

💡 How can digital health innovators demonstrate the value of their technologies, when faced with the challenge of navigating the varying abilities of health systems to engage and adopt them? 💷 In this series, we have focused on the numerous, unique challenges of generating economic evidence for digital health solutions. 🔄 The ‘evidence paradox’ will be familiar to many innovators. This is the challenging scenario facing many solution developers, who need effective access to health systems in order to generate compelling evidence. Health systems, however, need to see compelling evidence before granting that access. 💸 While often a challenge for clinical evidence generation, this is also true for generating economic evidence for digital health technologies. 👍 The success of digital health solutions depends on the healthcare system's readiness to adopt them. This includes factors like infrastructure, training and changes in clinical pathways. 📈 There are also implications for geographic variation and the ability for higher capitated regions to have economies of scale in some areas, for example in AI-based pathology readers. 👩⚕️ Evaluating the organisational impact is also crucial for successful implementation, but often overlooked. ⌨ Furthermore, digital solutions need to be interoperable with other digital systems in the healthcare system. 📲 Ensuring connectivity and data exchange can also be challenging, and any assessments should consider this aspect. ✅ Taking these factors into consideration can make a significant difference for innovators attempting to generate evidence for the economic value of their digital health solutions. 📑 To learn more about generating economic evidence for digital health solutions, read the latest Prova Health white paper, developed in collaboration with York Health Economics Consortium and leading health economics experts: https://lnkd.in/d57-AEcm 📩 If you’re looking for support in generating economic evidence for your digital health solution, get in touch! #healtheconomics #digitalhealth #medtech

Are you a digital health innovator? If so, you may be wondering... 1️⃣ How should HealthTech companies approach clinical evidence generation? 2️⃣ What are the important differences between HealthTech/AI and traditional pharmaceuticals when it comes to evidence generation? 3️⃣ What new, innovative ways do we have currently to generate evidence effectively and safely for HealthTech/AI? 4️⃣ What should innovators know about generating economic evidence? If that sounds like you, you may be interested in last night's LinkedIn Live with our Chief Medical Officer and co-founder, Dr Saira Ghafur, and Dr. Zhong Wei Khor. 📩 If you'd like to learn more about clinical or economic evidence generation for health tech companies, get in touch with us at hello@provahealth.com!

💬 "Health is a human right. But as I pointed out in my review, and as the IPPR demonstrates today, it is also vital to a strong economy. With record numbers out of work because of sickness, there is no path to either wellbeing or growth without prioritising health. That is a powerful platform for sustained, ambitious action by the new government." 🔎 It's been encouraging to see the many thought provoking responses to Professor the Lord Darzi of Denham OM KBE PC FRS's Independent investigation of the NHS in England since its publication last week. 🖋️ Our co-founder and Chair has not stopped there, and yesterday penned an opinion piece in The Guardian on the potential cures to the problems diagnosed in the Darzi report. 📑 Written in parallel with the publication of the final report from the IPPR Commission on Health and Prosperity, which Ara co-chaired with Dame Sally Davies, the article draws on the report's recommendations in highlighting a potential path to recovery for the NHS in England. Solutions include: 📈 Cross-government targets for healthy life expectancy, taking inspiration from climate targets such as net-zero. 🫱🏼🫲🏾 Greater partnership between government and both businesses and employers, as organisations with "tremendous influence over our health" - both good and bad. 💰 Health levies to generate funds for investing in health, particularly for children. To read Ara's opinion piece and the full report, visit t the links below.