New Member
August 26, 2023
Hi everyone,
I have a problem I am trying to solve where a created tool has seemingly outgrown Excel. The current process goes like this:
1. Raw data is pulled weekly
2. Transformations are applied to the data using Power Query and loaded to a separate workbook
3. Users (can be as many as 10+ at a time) edit the data
4. Power Query combines this data with other sources to produce a final report
The main issue I am combating is the number of users in the file and saves not merging with the server and copies of the main workbook having to be saved. For reference, the report length hovers around 25k rows. As well, an audit trail for the edits to the data would be wonderful to incorporate. I think moving this out of Excel to a more standard database format would be the best option. My proposed process would be:
1. Raw data is pulled weekly
2. Transformations are applied to the data using Power Query and loaded to a database using Power Automate
3. Users edit data using a front-end power app
4. Edits are merged back to the main database using Power Automate
5. Final transformations are applied and viewed in Power BI
My main question is, what is the best database for an application like this - Dataverse, SQL, Azure, etc.? and would Power Automate be able to handle 25k row-by-row updates from the Excel table to the database and then the Power App to the database? I appreciate any insight you all may have!!
Tony
1 Guest(s)