National Center for Cognitive Informatics & Decision Making

Products

(Please also see individual project pages for more detail)

Project 1A

• Rapid Usability Assessment Protocol (Overview)
• TURF Framework: (Zhang & Walji, 2011 and NIST Workshops 2011 Presentation and 2012 Presentation)
• TURF Software: See beta testing information (beta version released at AMIA 2012)

• EHR Usability Guidelines: coming in 2013

Project 1B

• MATH for Evidence-Based HIT Video 

Project 2A

• SIRSI: A prototypical Cognitive Support Application to Clinical Decision Making in relation to diagnosing and treating Sepsis. Contact Trevor Cohen for details.

Project 3

• MAPLE Knowledge Base: A validated knowledge base that can be used to infer problems from medications, laboratory results, billing data, procedures and vital signs. The knowledge base is available at http://jamia.bmj.com/content/18/6/859/suppl/DC1 .
• Problem-Medication Linkage Knowledge Base: An ontology-based knowledge base containing nearly 34 million distinct problem-medication pairs by:
• 1) using the “may_treat” relationship within NDF-RT, mapping the medications and problems to RxNorm and SNOMED-CT, and
• 2) inferring additional relationships using the “ingredient_of” and “isa” relationships between similar medications in RxNorm and derivative problems in SNOMED-CT.

An early version of this work with 7 million problem-medication pairs was described in an AMIA proceedings paper, cited below, and a substantially revised version is listed below as: A method and knowledge base for automated inference of patient problems from structured data in an electronic medical record. The full KB (34 million pairs) is included as an Appendix in this manuscript.

Project 4

•  Medication Reconciliation Demo (UTHealth)
• TwinList Demo (University of Maryland) Updated March 2012 

You may also download the latest high resolution version of the TwinList video (22.6 MB, 1024 x 768 resolution) HERE

Software

• The reconciliation Algorithm computing similarity between drugs is available at https://github.com/jherskovic/MedRec
• Twinlist user interface source code available on request (so we can keep track of dissemination) - Contact Catherine Plaisant
• Our MEDREC UI source code available at https://github.com/jherskovic/MedRecUI
• A Mathematica notebook containing code to automate SYFSA analysis  Available on request  Todd R Johnson 

Publications (Alphabetical Order of First author)

• Butler KA, Haselkorn M, Bahrami A, & Schroder K. Introducing the MATH method and toolsuite for evidence-based HIT (AMA-IEEE, 2011)
• D’Amore J. The Promise of the Continuity of Care Document. Master’s Thesis School of Biomedical Informatics, University of Texas Health Science Center at Houston. 2011.
• D’Amore JD, Sittig DF, Ness RB. How the Continuity of Care Document Can Advance Medical Research and Public Health, American Journal of Public Health 2012 Mar 15. PMID: 22420795 http://ajph.aphapublications.org/doi/abs/10.2105/AJPH.2011.300640
• D’Amore JD, Sittig DF, Wright A, Iyengar MS, Ness RB. The Promise of the CCD: Challenges and Opportunity for Quality Improvement and Population Health. AMIA Fall Symposium, 2011:285-94. PMID: 22195080
• Description of Twinlist: Chao T. Visual techniques for medication reconciliation: spatial metaphor, animated explanation, and flexible decision-making (Undergrad Honor Project report - Dec 2011)
• Feblowitz JC, Wright A, Singh H, Samal L, Sittig DF. Summarization of clinical information: A conceptual model. J Biomed Inform. 2011 Aug;44(4):688-99. PMID: 21440086
• Harrington, C., Wood, R., Breuer, J., Pinzon, O., Howell, R., Pednekar, M., Zhu, M., & Zhang, J. (2011). Using a Unified Usability Framework to Dramatically Improve the Usability of an EMR Module. Proceedings of AMIA 2011.
•  Johnson, T. and Markowitz, E. “A Framework for Systematic Yet Flexible Systems Analysis) (Submitted) Contact Todd Johnson for access.
• Kannampallil TG, Franklin A, Mishra R, Almoosa KF, Cohen T, & Patel VL. Understanding the nature of information seeking behavior in critical care: Implications for the design of health information technology. Artificial Intelligence in Medicine 2012
• Laxmisan A, McCoy AB, Wright A, Sittig DF. Clinical Summarization Capabilities of Commercially-available and Internally-developed Electronic Health Records. Applied Clinical Informatics 2012; 3: 80–93. doi:10.4338/ACI-2011-11-RA-0066
• Lowry, S. Z., Quinn, M. T., Ramaiah, M., Brick, D., Patterson, E. S., Zhang, J., Abbott, P., & Gibbons, M. C. (2012). A human factors guide to enhance EHR usability of critical user interactions when supporting pediatric patient care. (NISTIR 7865). National Institute of Standards and Technology.
• Markowitz E, Bernstam E, Herskovic J, Zhang J, Shneiderman B, Plaisant C, & Johnson T. Medication Reconciliation: Work Domain Ontology, Prototype Development, and a Predictive Model (AMIA Fall 2011)
• McCoy AB, Wright A, Kahn MG, Shapiro J, Bernstam EV, Sittig DF. “Matching Identifiers in Electronic Health Records: Implications for Duplicate Records and Patient Safety.” BMJ Healthcare Quality & Safety (in press) 2013.
• McCoy AB, Wright A, Laxmisan A, Ottosen MJ, McCoy JA, Butten D, Sittig DF. Development and evaluation of a crowdsourcing methodology for knowledge base construction: identifying relationships between clinical problems and medications. J Am Med Inform Assoc. 2012 Sep 1;19(5):713-8. Epub 2012 May 12. http://www.ncbi.nlm.nih.gov/pubmed/22582202
• McCoy AB, Wright A, Laxmisan A, Singh H, Sittig DF. A Prototype Knowledge Base and SMART App to Facilitate Organization of Patient Medications by Clinical Problems. AMIA Fall Symposium, 2011:888-94. PMID: 22195147
• Murphy DR, Reis B, Kadiyala H, Hirani K, Sittig DF, Khan MM, Singh H. Electronic health record-based messages to primary care providers: valuable information or just noise? Arch Intern Med. 2012 Feb 13;172(3):283-5. PMID: 22332167 http://archinte.jamanetwork.com/article.aspx?articleid=1108701
• Murphy DR, Reis B, Sittig DF, Singh H. Notifications received by primary care practitioners in electronic health records: a taxonomy and time analysis. Am J Med. 2012 Feb;125(2):209.e1-7. PMID: 22269625 www.ncbi.nlm.nih.gov/pubmed/22269625
• Osheroff JA, Teich JM, Levick D, Saldana L, Velasco FT, Sittig DF, Rogers KM, Jenders RA. Improving Outcomes with Clinical Decision Support: An Implementer’s Guide, Second Edition Healthcare Information and Management Systems Society, 2012.
• Pantazos K, Tarkan S, Plaisant C, & Shneiderman B. Promoting Timely Completion of Multi-Step Processes -- A Visual Approach to Retrospective Analysis. 2012
• Pantazos, K., Tarkan, S., Plaisant, C., Shneiderman, B. Exposing Delays in Multi-Step Processes by Retrospective Analysis
• Payne, T, Butler K, Ruggerio F, Middleton B. Improving Usability, Quality and Safety: Key Lessons from Airplane Cockpit Design (AMIA 2012) See the Boeing video included during this panel presentation
• Radecki RP, Sittig DF. Application of Electronic Health Records to the 2011 Joint Commission’s National Patient Safety Goals. Journal of the American Medical Association 2011 Jul 6;306(1):92-3. PMID: 21730246 http://jama.jamanetwork.com/article.aspx?articleid=1104039
• Rind A, Wang T, Aigner W, Miksch S, Wongsuphasawat K, Plaisant, C, & Shneiderman B. Interactive Information Visualization for Exploring and Querying Electronic Health Records: A Systematic Review. 2010.
• Saitwal H, Qing D, Jones S, Bernstam EV, Chute CG & Johnson TR. Cross-terminology mapping challenges: A demonstration using medication terminological systems. J Biomed Inform. 2012; 45: 613–625. doi:10.1016/j.jbi.2012.06.005
• Schumacher, R. M., Patterson, E., S., North, R., Zhang, J., Lowry, S. Z., Quinn, M. T., Ramaiah, M, & National Institute of Standards and Technology. (2012). Technical evaluation, testing and validation of the usability of electronic health records. (NISTIR 7804). National Institute of Standards and Technology.
• Singh H, Classen DC, Sittig DF. Creating an Oversight Infrastructure for Electronic Health Record-Related Patient Safety Hazards. J Patient Saf. 2011 Dec;7(4):169-174. PMID: 22080284
• Sittig DF, Ash JS. On the importance of using a multidimensional socio-technical model to study health information technology. Ann Fam Med. 2011 Sep-Oct;9(5):390-1. PMID: 21911756
• Sittig DF, Singh H. Defining Health Information Technology-related Errors: New Developments Since To Err is Human. Archives of Internal Medicine 171(14): 1279-1282; 2011. PMID: 21788544
• Sittig DF, Singh H. Electronic Health Records and National Patient Safety Goals. New England Journal of Medicine 2012 Nov 8;367(19):1854-60. doi: 10.1056/NEJMsb1205420.
• Sittig DF, Singh H. Legal, Ethical, and Financial Dilemmas in Electronic Health Record Adoption and Use. Pediatrics 2011; 127:e1042–e1047. PMID: 21422090. doi:10.1542/peds.2010-2184
• Sittig DF, Singh H. Rights and Responsibilities of Physician Users of Electronic Health Records. Canadian Medical Association Journal Feb 13, 2012. PMID: 22331971. doi:10.1503/cmaj.111599
• Sittig DF, Wright A, Meltzer S, Simonaitis L, Evans RS, Nichol WP, Ash JS, Middleton B. Comparison of clinical knowledge management capabilities of commercially-available and leading internally-developed electronic health records. BMC Medical Informatics & Decision Making. 2011 Feb 17;11(1):13. PMID: 21329520
• Tarkan, S., Franklin, L., Plaisant, C., Shneiderman, B. Design Guidelines for Ensuring Timely Management of Medical Orders
• Tarkan, S., Plaisant, C., Shneiderman, B., Hettinger, A. Z., Improving Timely Clinical Lab Test Result Management: A Generative XML Process Model to Support Medical Care [UPDATE VERSION UNDER PREPARATION]
• Tarkan, S., Plaisant, C., Shneiderman, B., Hettinger, A. Z., Reducing Missed Laboratory Results: Defining Temporal Responsibility, Generating User Interfaces for Test Process Tracking, and Retrospective Analyses to Identify Problems (AMIA Fall 2011)
• Wright A, Feblowitz J, McCoy AB, Sittig DF. Comparative Analysis of the VA/Kaiser and NLM CORE Problem Subsets: An Empirical Study Based on Problem Frequency. AMIA Fall Symposium, 2011:1532-40. PMID: 22195218
• Wright A, Henkin S, Feblowitz J, McCoy AB, Bates DW, Sittig DF. “Federal Incentives for Electronic Health Record Adoption: Early Results of the HITECH Act” New England Journal of Medicine (in press) 2013.
• Wright A, Pang J, Feblowitz JC, Maloney FL, Wilcox AR, Ramelson HZ, Schneider LI, & Bates DW. A method and knowledge base for automated inference of patient problems from structured data in an electronic medical record. J Am Med Inform Assoc 2011;18:6;859-867. doi:10.1136/amiajnl-2011-000121
• Zhang J & Walji MF. TURF: Toward a unified framework of EHR Usability. J Biomed Inform 2011; 44: 1056-1067.