# AI and note taking

**URL:** <https://ehealthforum.nz/t/ai-and-note-taking/30078>\
**Category:** Open Forum\
**Tags:** notes, scribe, emerging-tech, ai\
**Created:** [October 25, 2023, 9:40pm UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078 "2023-10-25T21:40:20Z")\
**Posts on this page:** 17\
**Page:** 2

<div class="post-metadata">

**Author:** ![Andrea](https://ehealthforum.nz/user_avatar/ehealthforum.nz/andrea/32/10527_2.png) [@Andrea](https://ehealthforum.nz/u/Andrea)\
**Post date:** [May 29, 2024, 8:51am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/24 "2024-05-29T08:51:16Z")

</div>

Now - nearly June 2024 - are more GP’s and other clinics using Nabla? or is there anything better?

---

<div class="post-metadata">

**Author:** ![RMcBeth](https://ehealthforum.nz/user_avatar/ehealthforum.nz/rmcbeth/32/2683_2.png) [@RMcBeth](https://ehealthforum.nz/u/RMcBeth)\
**Post date:** [May 30, 2024, 12:20am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/25 "2024-05-30T00:20:55Z")

</div>

Hi @Andrea see t[his article](https://www.hinz.org.nz/news/news.asp?id=666584&terms=%22nabla%22) in eHealthNews and eHealthTalk NZ podcast episode 42 with @karl and @richard.medlicott [https://www.hinz.org.nz/page/PodcastEpisodes](https://www.hinz.org.nz/page/PodcastEpisodes) wherever you get your podcasts.  
Current estimates are around 400 GPs are trialling it and I know a number of PHOs and the RNZCGPs are working on guidance around use of these tools.

---

<div class="post-metadata">

**Author:** ![Andrea](https://ehealthforum.nz/user_avatar/ehealthforum.nz/andrea/32/10527_2.png) [@Andrea](https://ehealthforum.nz/u/Andrea)\
**Post date:** [May 30, 2024, 7:19am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/26 "2024-05-30T07:19:48Z")

</div>

Thank you! great to know there is a study on the use of it. hope to hear more soon!

Andrea

---

<div class="post-metadata">

**Author:** ![Cheryl\_Fenwick\_Evans](https://ehealthforum.nz/user_avatar/ehealthforum.nz/cheryl_fenwick_evans/32/9758_2.png) [@Cheryl\_Fenwick\_Evans](https://ehealthforum.nz/u/Cheryl_Fenwick_Evans)\
**Post date:** [September 30, 2024, 3:27am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/27 "2024-09-30T03:27:29Z")

</div>

Kia Ora. Any more developments from Primary Care on this?

---

<div class="post-metadata">

**Author:** ![NathanK](https://ehealthforum.nz/user_avatar/ehealthforum.nz/nathank/32/6064_2.png) [@NathanK](https://ehealthforum.nz/u/NathanK)\
**Post date:** [October 17, 2024, 9:43pm UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/28 "2024-10-17T21:43:55Z")

</div>

A wee update on the situation in secondary care from the most recent D&D Pānui:

> # **Health NZ tests AI for clinical notes**
> 
> ![image](https://ehealthforum.nz/uploads/default/original/2X/b/bf35140db250a50cc3a072cde9f951585cd82cf1.png)  
> Health NZ is testing AI-driven clinical documentation to alleviate the burden on clinicians. Our New Technology & Innovation team, in collaboration with Awa Digital, has created an app named Tuhi, currently being piloted by 15 clinicians. The app utilises large language models (LLMs) to transcribe voice into text and transform these into comprehensive clinical notes. This technology aims to lessen cognitive load and enhance clarity in clinical reasoning. Te Whatu Ora handled 75.5 million outpatient and community visits in the first quarter of the year, and using this at scale and saving just one minute per visit translates to potential cost savings of $50 million.
> 
> However, challenges like data security, affirmation bias, and the need for models to handle mixed languages and accents, including local ones like Te Reo and tikanga, persist. We are addressing these issues with up to 50 beta users at Wellington Hospital. A formal evaluation will also assess the Tuhi app’s acceptability and experience to enhance healthcare delivery efficiency and effectiveness.
> 
> This initiative marks a major advance in leveraging AI to enrich healthcare delivery. Te Whatu Ora is dedicated to investigating and deploying these technologies to enhance the efficiency and efficacy of clinical documentation.
> 
> For more information about Tuhi contact @jon_herries , New Technology and Innovation

---

<div class="post-metadata">

**Author:** ![chris.paton](https://ehealthforum.nz/user_avatar/ehealthforum.nz/chris.paton/32/4348_2.png) [@chris.paton](https://ehealthforum.nz/u/chris.paton)\
**Post date:** [October 22, 2024, 5:45am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/29 "2024-10-22T05:45:13Z")

</div>

Does Tuhi anonymise the data before uploading to the LLM? If so, how is this done? It is something I have been confused about with commercial AI scribes - I’m not sure how this could be done reliably without using a LLM to do it in the first place! It would be good to see some data on how reliable anonymisation is.

My feeling is that we should wait for reliable on-device LLMs before using AI scribes with confidential patient data. I don’t think this is very far off although on-device models will probably be smaller and more prone to hallucinations. If I was a patient I would probably prefer more hallucinations (if the note can be properly checked by me and my clinician) than having my data sent to a cloud-based LLM.

---

<div class="post-metadata">

**Author:** ![chris.paton](https://ehealthforum.nz/user_avatar/ehealthforum.nz/chris.paton/32/4348_2.png) [@chris.paton](https://ehealthforum.nz/u/chris.paton)\
**Post date:** [October 23, 2024, 12:31am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/30 "2024-10-23T00:31:59Z")

</div>

Interesting JAMA article on AI scribes - this section piqued my interest:

“Third, even summaries that appear generally accurate could include small errors with important clinical influence. These errors are less like full-blown hallucinations than mental glitches, but they could induce faulty decision-making when they complete a clinical narrative or mental heuristic. For example, a chest radiography report noted indications of chills and nonproductive cough, but our LLM summary added “fever” (Figure, C). Including “fever,” although a 1-word mistake, completes an illness script that could lead a physician toward a pneumonia diagnosis and initiation of antibiotics when they might not have reached that conclusion otherwise.”

> **[AI-Generated Clinical Summaries Require More Than Accuracy](https://jamanetwork.com/journals/jama/fullarticle/2814609)**
>
> This Viewpoint discusses AI-generated clinical summaries and the necessity of transparent development of standards for their safe rollout.

---

<div class="post-metadata">

**Author:** ![rradecki](https://ehealthforum.nz/user_avatar/ehealthforum.nz/rradecki/32/5284_2.png) [@rradecki](https://ehealthforum.nz/u/rradecki)\
**Post date:** [October 24, 2024, 1:57am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/31 "2024-10-24T01:57:13Z")

</div>

I also like this related/unrelated JAMA commentary for its disdain for the concept of “vigilance” in clinical proofreading – but I would say its some of its 5 proposed potential solutions are bordering on dystopian …

> **[The Limits of Clinician Vigilance as an AI Safety Bulwark](https://jamanetwork.com/journals/jama/fullarticle/2816582)**
>
> This Viewpoint examines the potential problems of clinician reliance on the use of artificial intelligence (AI) in health care and offers suggestions on how AI could be designed to promote clinician vigilance.

---

<div class="post-metadata">

**Author:** ![chris.paton](https://ehealthforum.nz/user_avatar/ehealthforum.nz/chris.paton/32/4348_2.png) [@chris.paton](https://ehealthforum.nz/u/chris.paton)\
**Post date:** [October 24, 2024, 2:48am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/32 "2024-10-24T02:48:16Z")

</div>

I suspect the answer to this is to take an empircal approach - we don’t really know how problematic AI is going to be so we should design studies that assess whether or not AI systems reduce errors and improve efficiency in real world use. I suspect that they probably do improve things at the moment (i.e. automated summaries are better than human-written ones, even with some hallucinations) and will greatly improve things in the near future due to the rapid advance of the technology. That said, I can see scenarios where the use of AI could cause serious harm at quite a large scale (LLM-based health chatbots for example) so we need to be very careful going forwards.

---

<div class="post-metadata">

**Author:** ![jon\_herries](https://ehealthforum.nz/user_avatar/ehealthforum.nz/jon_herries/32/6584_2.png) [@jon\_herries](https://ehealthforum.nz/u/jon_herries)\
**Post date:** [October 24, 2024, 3:38am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/33 "2024-10-24T03:38:40Z")

</div>

No - we are using a private instance.

Jon

---

<div class="post-metadata">

**Author:** ![NathanK](https://ehealthforum.nz/user_avatar/ehealthforum.nz/nathank/32/6064_2.png) [@NathanK](https://ehealthforum.nz/u/NathanK)\
**Post date:** [October 27, 2024, 6:22pm UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/34 "2024-10-27T18:22:01Z")

</div>

Hopefully you are using a model with better performance on the hallucination front than Open AI’s Whisper:

> **[AI transcription tool used in US hospitals invents things no one said -...](https://www.1news.co.nz/2024/10/27/ai-transcription-tool-used-in-us-hospitals-invents-things-no-one-said-researchers/)**
>
> The software invented a non-existent medication called “hyperactivated antibiotics" in one example.

---

<div class="post-metadata">

**Author:** ![chris.paton](https://ehealthforum.nz/user_avatar/ehealthforum.nz/chris.paton/32/4348_2.png) [@chris.paton](https://ehealthforum.nz/u/chris.paton)\
**Post date:** [October 27, 2024, 9:13pm UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/35 "2024-10-27T21:13:28Z")

</div>

Here’s one of the studies referred to in that article:

> **[Careless Whisper: Speech-to-Text Hallucination Harms | Proceedings of the...](https://dl.acm.org/doi/10.1145/3630106.3658996)**

I personally think that hallucination is going to become a non-issue fairly soon. There are fairly obvious technical solutions to hallucinations but they cost money in terms of compute (e.g. RAG, chain of thought, etc.). LLM services seem to prefer just to say ‘don’t use for medical purposes’ rather than offer solutions that don’t hallucinate but that cost more to run.

I’m hopeful that Apple will build in on-device LLMs that do accurate transcription and summarisation securely as part of Apple Intelligence. They seemt to be delaying release at the moment though as probably not good enough in internal tests for them yet.

---

<div class="post-metadata">

**Author:** ![mca](https://ehealthforum.nz/user_avatar/ehealthforum.nz/mca/32/14740_2.png) [@mca](https://ehealthforum.nz/u/mca)\
**Post date:** [October 29, 2024, 9:58pm UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/36 "2024-10-29T21:58:40Z")

</div>

I think a discussion about clinical use of AI should include some thoughts on teaching clinical reasoning… so just putting my 2 cents in here 🙂 at the risk of being too theoretical…  
One book I have is “Teaching Clinical Reasoning” by Robert Trowbridge et al.  
At least this should help in developing clinical decision support if that’s a priority for anyone… not sure about AI…

---

<div class="post-metadata">

**Author:** ![ErinJB](https://ehealthforum.nz/user_avatar/ehealthforum.nz/erinjb/32/11094_2.png) [@ErinJB](https://ehealthforum.nz/u/ErinJB)\
**Post date:** [October 31, 2024, 8:43am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/37 "2024-10-31T08:43:44Z")

</div>

I am literally just finishing up an assignment for bioethics paper for Digital Health postgrad on on ambient AI scribes, and whether the promised benefits of lessening the effects of burnout on (ambulatory care) clinicians and subsequently patients is worth the potential risks.

There is a large amount of mainly US-based (per Meaningful Use mandates) journal articles on this topic.

If I had ignored [eHealthnews.nz](http://eHealthnews.nz) updates I wouldnt have had to keep re-writing it 😆

---

<div class="post-metadata">

**Author:** ![mca](https://ehealthforum.nz/user_avatar/ehealthforum.nz/mca/32/14740_2.png) [@mca](https://ehealthforum.nz/u/mca)\
**Post date:** [November 2, 2024, 8:14pm UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/38 "2024-11-02T20:14:28Z")

</div>

ooh this sounds fascinating! 🙂

---

<div class="post-metadata">

**Author:** ![jon\_herries](https://ehealthforum.nz/user_avatar/ehealthforum.nz/jon_herries/32/6584_2.png) [@jon\_herries](https://ehealthforum.nz/u/jon_herries)\
**Post date:** [November 4, 2024, 1:32am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/39 "2024-11-04T01:32:00Z")

</div>

I think the expectation that it would be “100% right” hits the mark but misses the point for a few reasons:

1. The typist doesn’t always get it right when you dictate a letter.
2. Sometimes humans mis-diagnose patients when we have the right information in front of us
3. Sometimes we mishear patients or forget to write down what we heard or write down the wrong thing.

Biggest take away if you are trying these tools is, don’t succumb to automation bias (only a somewhat Sisyphean task). They will do 80% of the job not 100%. You need to review, edit and confirm that they are right.

I think in that context they provide a lot of value even if they only do 80% of the job (@Ruth_Large posted some great reasons on LinkedIn).

Just to stir the pot - perhaps if they did 100% you could have robots be clinicians?

---

<div class="post-metadata">

**Author:** ![NathanK](https://ehealthforum.nz/user_avatar/ehealthforum.nz/nathank/32/6064_2.png) [@NathanK](https://ehealthforum.nz/u/NathanK)\
**Post date:** [December 17, 2025, 10:02am UTC](https://ehealthforum.nz/t/ai-and-note-taking/30078/40 "2025-12-17T10:02:19Z")

</div>

Well, it has been radio silence from Health NZ about whatever happened to Tuhi (which sounded like a genuinely good idea).

At least the press is asking questions:

> **[Why Health NZ dumped its AI tool Tuhi for Heidi](https://businessdesk.co.nz/article/policy/why-health-nz-dumped-its-ai-tool-tuhi-for-heidi)**
>
> Health New Zealand has abandoned its homegrown AI clinical scribe, opting for commercial products that clinicians had already been using behind the scenes. ...

[Previous page](https://ehealthforum.nz/t/ai-and-note-taking/30078.md?page=1)
