Change8
Error2 reports

Fix LocalEntryNotFoundError

in TGI

Solution

This error usually arises in tgi due to missing or incorrectly installed dependencies, especially custom or third-party modules. To fix it, ensure all required packages, including those specified in `requirements.txt` or necessary for specific model functionalities (like `punica_sgmv`), are installed using `pip install -r requirements.txt` or `pip install <missing_package_name>`. If the issue pertains to a custom module, verify the module's path is correctly included in the Python environment using `sys.path.append`.

Related Issues

Real GitHub issues where developers encountered this error:

Timeline

First reported:Mar 10, 2025
Last reported:Aug 1, 2025

Need More Help?

View the full changelog and migration guides for TGI

View TGI Changelog