follow us on facebook follow us on twitter email us

Provider User-Experience Challenge

About the Challenge
Create health provider apps that sync consumers' data using open APIs.

Posted By: Department of Health and Human Services
Category: Software/Apps
Submission Dates: 12 a.m. ET, Jun 02, 2016 - 2 p.m. ET, Nov 07, 2016 Winners Announced: Dec 15, 2016

 

Read the press release announcing the final, Phase 2 winners! Congratulations to them all!

 

The Provider User-Experience (UX) Challenge incents the development of applications that use open, standardized APIs to enable innovative ways for providers to interact with patient health data. This challenge will focus on demonstrating how data made accessible to apps through APIs can positively impact providers’ experience with EHRs by making clinical workflows more intuitive, specific to clinical specialty, and actionable.

The lack of interoperability between electronic health record (EHR) systems remains a significant barrier to the modernization of health IT. Fast Healthcare Interoperability Resources (FHIR), developed by HL7, is a standard designed to increase the liquidity of granular patient data. The FHIR API allows data to move between vendor systems both within and across different providers, not to mention through third-party applications for direct use by both clinicians and consumers. Among several opportunities now enabled by this interoperability standard are the new channels being opened up for improving a provider’s user experience when interacting with EHRs and the “consumability” of interrelated health data.

***Watch the recording of the March 31 Informational Webinar***

The challenge has two phases. Phase 1 requires the submission of technical and business plans for the application (app) while Phase 2 requires that a working app be available for consumers. Phase 2 of the competition will not be limited to only those who won Phase 1 – all Phase 1 competitors, and those who did not participate in Phase 1, can submit a final app at the end of Phase 2. The final application must meet the following requirements:

  • Uses FHIR Draft Standard for Technical Use 2 (DSTU2)
  • Leverages data as specified in the 2015 Edition Common Clinical Data Set (in the Data column)
  • Verified compatibility with different health IT developer systems implemented in production settings, 1 of which must be from the top 10 systems measured by Meaningful Use attestation per HealthIT.gov. Apps must be integrated with a minimum of 3 unique health IT developer systems in 2 unique provider settings.
    • There are two options to assess MU attestation here, by Healthcare Professionals or by Hospitals. The top 10 system can be selected from Primary EHR Vendor – not Secondary EHR Vendor – in either of these reports.
  • Has been tested with users in production settings
  • Available to providers through at least one of the following modes: direct from web, iOS Store, or Android Stores

 

Phase 2 Participation Requirements

The second phase, to run from June 2 to November 7, will entail the actual development of the apps, verification of technical capabilities, user testing/piloting, and public release of the apps. This will include remote testing with providers and health IT developers to test the technical abilities of the apps to connect to in-production systems. Participants will submit:

  • Working app
    • Provide the url to download/access the app.
  • Video demonstrating the app (maximum of 5 minutes)
    • Provide the url of the video on YouTube or Vimeo.
    • The video must highlight the use of FHIR to integrate with EHR vendor systems, including demonstration of data exchange with each system. The rest of the video should address the remaining evaluation criteria: functionality and quality of data aggregation, privacy and security of patient data, impact potential in a clinical setting, and user experience and visual appeal.
  • Slide deck describing app (maximum of 15 slides)
    • Overall, the slide deck should complement the video demonstration. It should include a list of the active FHIR integrations with EHRs at provider settings, as demonstrated in the video. It should describe other functionality pertaining to the review criteria, particularly anything that was not covered in the video.

The grand prize winner will receive $50,000 and a second place winner will receive $25,000. There will be an additional $25,000 prize for the app that connects to the greatest number of unique health IT developer systems implemented in production settings (the “Ultimate Connector”), which can be won by any entry, including the grand prize or 2nd place winner.

Phase 1 Participation Requirements

Participants interested in competing for Phase 1 awards will need to submit an app development plan that must include:

  • Mockup/wireframes of the app
    • Provide a clear sense of the look, feel, and interactions of the app.
  • Technical specifications, including but not limited to planned data sources, system architecture, and compliance with HIPAA regulations (and other applicable law)
    • Provide a realistic idea of what data sources, and from who, will be included; how that data will be integrated together and in service to the consumer’s needs; how data privacy and security will be implemented.
  • Business/sustainability plan
    • How does the submitter propose to enter the market and lead to a successful app? The plan should include the following:
      1. Issue analysis, demonstrating understanding of the issue (1 page)
      2. Solution description, describing the solution and how it addresses the issues (2 pages)
      3. Financial estimates, including revenues and expenses (2 pages)
      4. Engagement plan, including targeted customer base and stakeholders (2 pages)
  • Provider partnership
    • Submitters are strongly encouraged to partner with a healthcare provider or EHR vendor for activities such as app development or pilot testing; evidence of partnership should be demonstrated with signed letters of intent on partner letterhead (i.e., we will not be reviewing actual business agreements).

To augment technical development and enhance the likelihood of a successful app that will continue to exist beyond the end of the challenge, a progress update/matchmaking event will be held that will seek to connect participants with provider partners.

In Phase 1, up to five app proposals will be recognized as winners and awarded up to $15,000 each.

Judging Criteria

Phase 2 - Number, sources, and types of data aggregation using FHIR

Success in achieving the technical requirements for the challenge

Phase 2 - Functionality and quality of data aggregation

Assessment will include how well the app aggregates data pulled from different sources into a presentation that is usable and coherent

Phase 2 - Privacy and security of patient data

Submission must demonstrate how the app functionality and structure safeguard patient health data

Phase 2 - Impact potential in clinical setting

To what extent does the app improve on the status quo, such as through time saved, convenience, completeness/thoroughness of patient information, ease of integration into current workflows, and integration with their current health IT

Phase 2 - User experience and visual appeal

Assessment will include whether the app follows best practices in conveying information online, how intuitive is its navigation, and overall user-friendliness

Phase 1 - Technical feasibility of plan, including number of EHR sources targeted

Includes number of EHR sources targeted and how realistic those plans are (i.e., don’t list every single EHR in existence without having done any due diligence about whether it’s possible).

Phase 1 - Adherence to data privacy and security best practices and applicable law (including HIPAA)

Apps must demonstrate they will adhere to the provisions, as applicable, of the Privacy Rule and Security Rule of the Health Insurance Portability and Accountability Act of 1996 (HIPAA), in addition to best practices for safeguarding patient health data.

Phase 1 - Strength of business/sustainability plan

Assessment will include how well the submitter understands the issues underlying the challenge, how well the proposed solution addresses them, and rigor, methodology, and reality of the plan.

Phase 1 - Impact potential in clinical setting

How would the proposed solution address clinician needs in the clinical setting, including utility, usability, integration into current workflows, and integration with their existing health IT.

Phase 1 - Provider and/or health IT developer partnerships

Extent to which submitter has partnered or come to agreements with stakeholders to, for example, co-design, develop, or test the app.

How to Enter

Participants will submit:

  • Working app
    • Provide the url to download/access the app.
  • Video demonstrating the app (maximum of 5 minutes)
    • Provide the url of the video on YouTube or Vimeo.
    • The video must highlight the use of FHIR to integrate with EHR vendor systems, including demonstration of data exchange with each system. The rest of the video should address the remaining evaluation criteria: functionality and quality of data aggregation, privacy and security of patient data, impact potential in a clinical setting, and user experience and visual appeal.
  • Slide deck describing app (maximum of 15 slides)
    • Overall, the slide deck should complement the video demonstration. It should include a list of the active FHIR integrations with EHRs at provider settings, as demonstrated in the video. It should describe other functionality pertaining to the review criteria, particularly anything that was not covered in the video.
Prizes
Phase 2 First Prize - Herald Health $50,000.00 Its solution helps clinicians manage the overwhelming flow of alerts and information by allowing them to create highly customizable push notifications. These can be tailored to both individual patients and groups and exported to fellow users.
Phase 2 Second Prize and Connector Award - University of Utah Health Care / Intermountain Healthcare / Duke Health System $50,000.00 Their solution is a clinical decision support tool that can provide recommendations for the treatment of babies with jaundice detected at birth based on the level of liver waste products found in their blood.
Phase 2 Honorable Mention - PHRASE Health This solution uses clinical decision support to help clinicians align with priorities such as public health alerts.
Phase 1 Winner - Herald Health $15,000.00 The Herald platform leverages FHIR to surface the patient information that clinicians need the most. It’s integration of FHIR will help enable highly customizable, IFTTT-like (“if this, then that”) alerts based on real-time EHR data.
Phase 1 Winner - PHRASE Health $15,000.00 PHRASE (Population Health Risk Assessment Support Engine) Health aims to create a clinical decision support platform, compatible with the SMART on FHIR platform, to bridge the gap between public health and clinicians by intuitively creating rules to identify at-risk populations. This would help better manage emerging illnesses, incorporate more external data sources into the identification of at-risk patients, and allow for the two-way exchange of data and knowledge between public health and frontline providers.
Phase 1 Winner - University of Utah Health Care / Intermountain Healthcare / Duke Health System $15,000.00 A multi-institutional, collaborative effort to redevelop a SMART on FHIR application to provide clinical decision support for timely diagnosis of newborn bilirubin and management according to evidence-based best practices. The collaboration intends to integrate the app across each member’s EHR platform.
Phase 1 Winner - WellSheet $15,000.00 WellSheet’s web application seeks to utilize machine learning and natural language processing to prioritize relevant information during a patient visit. Its algorithm simplifies workflows that must incorporate multiple data sources, including those enabled by FHIR, and presents information in a single screen.

45 Discussions for "Provider User-Experience Challenge"

  • Show Replies [+]
    VRB
    As part of phase 2 requirements, it was mentioned that we provide the url to download/access the app. In this case, can the App URL be linked to a EHR sandbox for a particular patient? We cannot provide access to the production environment! However, our video and powerpoint will be created using the production environment within an EHR.

    • Reply
      awong
      Hi VRB, For testing purposes, you can provide a url to a sandboxed environment. However, one of the reasons we're asking for a public-facing url to download the app is to verify that it is available for general use/purchase, not just for the challenge. So if you have that also, please provide. Thanks for your question, Adam

    • Reply
      awong
      Hi Simranpreet, To demonstrate technical capabilities in the video, you could use dummy data. If you have video editing software, you could do some blurring out of certain sensitive data, though at this point I'm going past my own limited AV knowledge. Thanks for your question, Adam

  • Show Replies [+]
    Simranpreet Kaur
    A submission was made for Phase 1 and we have since then changed the topic for Phase 2 submission. Will we have to submit the same requirements for Phase 1 along with Phase 2 requirements? or will only Phase 2 requirements be sufficient?

    • Reply
      awong
      Hi Simranpreet, Phase 2 submissions will be evaluated based only on the criteria for Phase 2. Thanks for your question, Adam

  • Show Replies [+]
    awong
    Challenge submitters, Thank you all for your participation in ONC's Provider User Experience Challenge. Winners were notified earlier today, and will be announced publicly on Monday via press release around 3:00 pm ET. The website will be updated accordingly. As a reminder, participation in Phase 2 is not dependent on Phase 1 participation or results - anyone can still submit and win in Phase 2, which ends November 7. We look forward to what's coming next! -Adam Wong, and the ONC Challenge Team

    • Reply
      Noel Hollis
      Hi Adam! How would we register for the second phase of this challenge? Since it has closed I cannot seem to find a registration button or form. - Noel Hollis

    • Reply
      jshapiro
      Hi Ken - Winners of Phase 1 will be announced Monday afternoon around 3pm. This challenge.gov will be updated to show the winners. Thank you Josh

  • Show Replies [+]
    Steve
    I received a confirmation when I did the submission that my application was received but I never did receive a corresponding email confirmation. Can you confirm you have received it?

    • Reply
      jshapiro
      Hi Steve - Can you please tell me the title of your submission and i'll look it up now? Thanks Josh

      • Reply
        Brian
        Josh - Could you also confirm if the submission for EpocratesPatient went through? It was recently brought to my attention that the dropbox link submitted might not be publicly accessible. Thanks, Brian

      • Reply
        Brian
        Josh – Could you also confirm if the submission for EpocratesPatient went through? It was recently brought to my attention that the dropbox link submitted might not be publicly accessible. Thanks, Brian

  • Show Replies [+]
    David Do
    Just tried to submit but got an error message Access Denied You don't have permission to access "http://www.challenge.gov/wp-content/themes/challenge-gov-theme/challenge-post-process.pho" on this server. Reference #xxxxxxxx

      • Reply
        awong
        Hi Ken, Were you able to successfully submit? Can you give me the name of your submission and the username it was submitted under, and I’ll check to make sure we received it. Thanks, Adam

    • Reply
      awong
      Hi David, Were you able to successfully submit? Can you give me the name of your submission and the username it was submitted under, and I'll check to make sure we received it. Thanks, Adam

  • Show Replies [+]
    K. Kjersten Reich
    Can you please advise on what form the award will take? We have a developer interested from a major academic institution. We are curious what terms and conditions would be required for award management. The information we can see so far explains that the award would be a prize, which is not an award mechanism we are yet familiar with. Up to now, our organization has received grants and contracts from DHHS.

    • Reply
      awong
      Hi K., The form of the award is not a grant or contract and does not have terms or conditions attached to it post-award. The prize awards are pre-determined and not based on costs, and Facilities & Administration rates do not apply. You may need to explore with your developer/institution a different way of accepting a prize award. Thanks for you question, Adam

  • The App I'm considering, will Support only the DocumentReference Resource. Meaning, only C-CDA and XSD.b documents will be retrieved (as these type documents are Attested, they can be used to reconcile this Data back into the EHR). Please inform if this App qualifies for your contest. Also, will the App's be required to create Documents in the FHIR Servers?

  • Show Replies [+]
    Kensaku Kawamoto, MD, PhD, MHS
    Is an application focused on being able to re-use novel functionality across institutions and EHR systems in a standards-based manner leveraging FHIR considered responsive, even if there is not an intent to share data across the institutions? E.g., the app would be used by institutions A, B, and C using a standard FHIR-based interface, but institution A's app will be run using institution A's data, institution B's app will be run using institution B's data, etc

    • Reply
      awong
      Hi Kensaku, Our focus here is the exchange and use of data between organizations using different types of EHR platforms. So, for example, we want to see institution A be able to pull together and use data about a single patient from institutions A, B, and C. Thanks for your question, Adam

    • Reply
      awong
      Hi Carla, Here’s the link to the webinar recording: http://bit.ly/1SLG1gB. The link is also now on the front page. The link to download the slides is also in process, and will be added to the front page. Thanks, Adam

    • Reply
      awong
      Hi Glenn, Here’s the link to the webinar recording: http://bit.ly/1SLG1gB. The link is also now on the front page. The link to download the slides is also in process, and will be added to the front page. Thanks, Adam

  • Show Replies [+]
    Sandeep Giri
    Re "Apps must be integrated with a minimum of 3 unique health IT developer systems in 2 unique provider settings" - how do you define a "unique health IT developer system"? For example, can it be a development instance of Epic or Cerner within a healthcare provider's IT infrastructure (that contains test data), or does the app need to be integrated with a production instance of Epic or Cerner with live Patient data?

    • Reply
      awong
      Hi Sandeep, We're most interested in integrations with production instances with live patient data. These will be valued (scored) more highly than integrations with development instances. Thanks for your question, Adam Wong

    • Reply
      Adam Wong
      Hi Qing, If you are an individual participating singly or in a group, you must be a citizen or permanent resident of the US; a private business must be incorporated in and maintain a primary place of business in the US. Thanks, Adam

    • Reply
      Adam Wong
      Hi Rui, There are two options to assess this, by Healthcare Professionals (http://dashboard.healthit.gov/quickstats/pages/FIG-Vendors-of-EHRs-to-Participating-Professionals.php) or by Hospitals (http://dashboard.healthit.gov/quickstats/pages/FIG-Vendors-of-EHRs-to-Participating-Hospitals.php). The top 10 system can be selected from Primary EHR Vendor - not Secondary EHR Vendor - in either of these reports. Thanks, Adam

Add to the Discussion

Solutions
No solutions have been posted for this challenge yet.
Rules

The statutory authority for this challenge competition is Section 105 of the America COMPETES Reauthorization Act of 2010 (Public L. No 111-358).

Eligibility Rules for Participating in the Competition:

To be eligible to win a prize under this challenge, an individual or entity:

  1. Shall have registered to participate in the competition under the rules promulgated by the Office of the National Coordinator for Health Information Technology.
  2. Shall have complied with all the requirements under this section.
  3. In the case of a private entity, shall be incorporated in and maintain a primary place of business in the United States, and in the case of an individual, whether participating singly or in a group, shall be a citizen or permanent resident of the United States.
  4. May not be a Federal entity or Federal employee acting within the scope of their employment.
  5. Shall not be an HHS employee working on their applications or submissions during assigned duty hours.
  6. Shall not be an employee of the Office of the National Coordinator for Health IT.
  7. Federal grantees may not use Federal funds to develop COMPETES Act challenge applications unless consistent with the purpose of their grant award.
  8. Federal contractors may not use Federal funds from a contract to develop COMPETES Act challenge applications or to fund efforts in support of a COMPETES Act challenge submission.

An individual or entity shall not be deemed ineligible because the individual or entity used Federal facilities or consulted with Federal employees during a competition if the facilities and employees are made available to all individuals and entities participating in the competition on an equitable basis.

Entrants must agree to assume any and all risks and waive claims against the Federal Government and its related entities, except in the case of willful misconduct, for any injury, death, damage, or loss of property, revenue, or profits, whether direct, indirect, or consequential, arising from my participation in this prize contest, whether the injury, death, damage, or loss arises through negligence or otherwise.

Entrants must also agree to indemnify the Federal Government against third party claims for damages arising from or related to competition activities.

Submission Requirements

In order for a submission to be eligible to win this Challenge, it must meet the following requirements:

  1. No HHS or ONC logo – The product must not use HHS’ or ONC’s logos or official seals and must not claim endorsement.
  2. Functionality/Accuracy – A product may be disqualified if it fails to function as expressed in the description provided by the user, or if it provides inaccurate or incomplete information.
  3. Security – Submissions must be free of malware. Contestant agrees that ONC may conduct testing on the product to determine whether malware or other security threats may be present. ONC may disqualify the product if, in ONC’s judgment, the app may damage government or others’ equipment or operating environment.

Additional Information:

General Conditions: ONC reserves the right to cancel, suspend, and/or modify the Contest, or any part of it, for any reason, at ONC’s sole discretion.

Intellectual Property: Each entrant retains title and full ownership in and to their submission.  Entrants expressly reserve all intellectual property rights not expressly granted under the challenge agreement. By participating in the challenge, each entrant hereby irrevocably grants to Sponsor and Administrator a limited, non-exclusive, royalty-free, worldwide license and right to reproduce, publically perform, publically display, and use the Submission to the extent necessary to administer the challenge, and to publically perform and publically display the Submission, including, without limitation, for advertising and promotional purposes relating to the challenge.

Authority: 15 U.S.C. 3719.

Submit Solution
Challenge Followers
Public Profile: 3
Private Profile: 64