Connecting a large language model (LLM) to an enterprise resource planning (ERP) system sounds straightforward at first.
You connect the model to your ERP APIs, provide the relevant business context, define a few tools, and let employees ask questions in natural language.
For example:
“Show me the status of my pending purchase orders.”
“Which invoices are overdue?”
“Summarize inventory levels across our warehouses.”
“Find the customers with outstanding payments.”
The first prototype might work perfectly. The problem starts when you connect it to real users, real business data, and the permission rules that have been protecting that data for years.
I learned an important lesson from this architecture: an LLM should never become a shortcut around the ERP's existing authorization model.
The First Problem Was Not the LLM
Most ERP systems already have a complex permission structure.…