Kipu Intelligence: Note Audit Configuration

This feature is currently in limited release to a select group of clients and will be rolling out to everyone in the coming months.

The Kipu Intelligence Note Audit AI tool allows users to link one or more rule sets to evaluation templates. When these evaluation templates are used, Kipu Intelligence can score the evaluation responses for compliance according to the rules chosen in the template. These rules are added to evaluation templates, which must also be set up. For instructions on creating evaluation templates, click here.

Required Permissions: Note Audit: Manage together with the Super Admin, Records Admin, or Manage Templates/Manage Templates: Consents and Evaluations permissions

Kipu Intelligence is a useful tool, but it is not a substitute for clinical judgement. Always review the information provided and use your own discretion. 

Configure Note Audit Rules

1. To begin, navigate to Templates > Evaluations.

2. Click on the edit button for the template you want to configure. 

   

3. Click Configure to set up or edit the rule set(s). If no rule sets have been configured, the system will indicate that the evaluation is not configured for Note Audit.

   

   • Once at least one rule set is configured for the evaluation template, the box updates to show either the associated rule set name (when only one rule set is added) or the total number of rule sets (when multiple rule sets are added).
4. There are two types of Note Audit rule sets: standard rule sets provided by Kipu and custom rule sets.

Standard Note Audit Rule Sets

Kipu provides the most commonly used rule sets and requirements by default. Use the following instructions to add a rule set to your template. 

1. Once you click the Configure button, you will land on the Kipu tab by default.
2. You can locate the desired rule set by searching for it by name in the Search for Rule Sets field or by using the page navigation arrows at the bottom of the list. 
   

3. Enable the rule set by setting the toggle to enabled. You can view the rule set's details by clicking on the arrow on the right.

   

   • If you enable a single rule set, the evaluation will only use the rules in that rule set when auditing the documentation.
   • You can enable multiple rule sets for a single evaluation template, including both standard and custom rule sets. When multiple rule sets are enabled, the evaluation applies all rules across the selected rule sets when auditing documentation. Avoid selecting rule sets with conflicting requirements, as this may affect audit results. Additionally, do not select more than 100 rules in total. 
4. Clicking on the arrow for a rule set displays all the rules and weights given to each item.
5. Once a rule set is enabled for an evaluation template, it is applied to all evaluations created using that template going forward. Evaluations added to a patient’s chart before the rule set was enabled will not include Note Audit rules.

For instructions on using Note Audit on patient documentation, check out this article.

Custom Note Audit Rule Sets

There are two methods by which you can create custom note audit rule sets. The first is to contact Kipu Support and provide the following information for a completely custom rule set. 

• Rule set name
• Individual rule names and weights

The second is to create a copy of an existing Kipu rule set and modify it as needed.

Note: If a Kipu rule set is copied into a custom rule set and Kipu updates the original rule set, those changes will be reflected in all custom copies of that rule set. Kipu will notify users when any changes are made.

1. From an evaluation template, open the rule set you want to duplicate, and click the copy icon.

2. Update the description and the extended description as needed. Then click Submit. 

   

   1. Note: The text entered in the Description box will appear as the title in the Custom list, so we recommend making it easily identifiable.
3. Disable individual rules to remove them from the rule set. Click the edit pencil to change rule weights. 
   
4. Changing the weight assigned to a rule will change its importance, meaning that the system will give it a bigger or smaller percentage out of 100% when calculating the score. Click Submit to log your changes and return to the rule set.
   
5. Custom rule sets will appear in the Custom tab. However, they must be published before they can be enabled.
   
6. To edit a rule set's descriptions and to publish it, open the rule set and click the edit icon in the blue box. 
   

7. In the Edit a Rule Set window you can edit the following information:

   Description: The text entered in the Description box will appear as the title in the Custom list. Extended Description: This description appears in the rule set title box and should meaningfully describe the rule set. Published: Select this checkbox when your rule set is ready to be used. Once a rule set is published, it can be enabled for use in evaluation templates. If you want to remove an existing rule set from use entirely (rather than simply disabling it for the current evaluation), uncheck the Published box.  Click Submit to save your changes.

8. Once a rule set is published, it can be enabled for use in an evaluation template.
9. When the rest of your evaluation template is ready for use, check out this article to learn how Note Audit works in evaluations!