Authors: Vik Malhotra, Jaideep Patel Prerequisite Data Pipeline: Payer Medallion Project
A modern, interactive Streamlit dashboard for healthcare payor analytics, built as a Databricks App.
This app lets you instantly explore claims data, analyze cost drivers, understand denial trends, identify provider performance, and spotlight outlier activity — all on governed Unity Catalog production data.
Key Features
- Horizontal, filterable selectors for catalog, schema, and table
- Metrics row for executive KPIs (claims, charges, denial rate, member/provider count)
- Claims workflow and status breakdown
- Denials analysis, provider leaderboard, diagnosis insights, and outlier detection
- Modular, extensible code — adapt for your own analytics needs
This dashboard expects a high-quality claims_enriched gold table generated by our Payer Medallion medallion-architecture claims pipeline.
Start here if you need a production-grade healthcare payor claims dataset:
➡️ Payer Medallion Repo
1. Clone this repo
git clone https://github.com/bigdatavik/payer-app
cd payer-app2. Install dependencies
pip install -r requirements.txt(Minimum required: streamlit, pandas, databricks-sql-connector, databricks-sdk, pyarrow)
3. Configure environment
- Ensure your Databricks SQL warehouse is running and your environment variables are set for authentication (see “Deployment” below).
4. Run the app
streamlit run app.py- Select your Unity Catalog catalog/schema/table and begin exploring analytics!
- Dashboards are great for static BI and periodic reporting.
- Databricks Apps enable secure, interactive, code-driven analytics directly on Lakehouse data, with richer logic, user workflows, and fine-grained governance.
- Package the app per Databricks Apps documentation.
- Specify any required environment variables in your
app.yaml(e.g.DATABRICKS_WAREHOUSE_ID,DATABRICKS_TOKEN). - Attach app resources and env vars in the Apps UI, or define them in
app.yaml. - Start/redeploy your app using the UI as needed.
When you deploy this app, Databricks automatically creates a dedicated service principal identity for the app.
To allow the app to query any Unity Catalog catalog, schema, or table, you must grant the required permissions (such as USE CATALOG, USE SCHEMA, SELECT) to the app’s service principal.
You can find the app’s service principal ID in the Databricks Apps UI under the Authorization tab for your app.
Grant permissions using either the Catalog Permissions UI or with SQL commands, for example:
GRANT USE CATALOG ON CATALOG TO '';
GRANT USE SCHEMA ON SCHEMA . TO '';
GRANT SELECT ON TABLE .. TO '';
For more details, see the Databricks App authorization documentation.
Contributions, issues, and feature requests welcomed!
Please open a Pull Request, file an Issue, or contact the authors for serious collaboration.
This project is open source.
- Payer Medallion Project (gold table ETL)
- Medium article: From Raw Claims Data to Actionable Payer Insights
For questions or demos, please reach out or open an issue!
04310913a837b59f297ec6e7e7e4668cc703a7b0